Oh it's a PITA for sure, but it'll work for sure. I was just trying to let the OP know that his desire to have gloves w/out a jacket liner is possible, even if cumbersome.
Besides, in my experience the gloves are not nearly as effective unless you keep your core temp up, too. If your body is warm you can expect your hands to be warmer, too. Gloves alone did not impress me last year when I started using heated gear (my liner was back ordered for quite some time and I used the Y harness and gloves only).
Get a liner and gloves. .02