Yup, switching Screensets in full screen mode knocks you out of full screen mode, yes, it's annoying.
When I first started using Logic there was a problem with screen sets where if you switched between them it would show your Desktop for a few seconds. That issue was fixed in the past 5 years but because of this I just never incorporated screen sets into my workflow.