In my experience, the camera strictly follows the person to whom it has been "logged in"... I have to set the switch to another person with a new "tap lock" each time.

So far, there have been two of us, which has worked well. But we still have to practise who the camera is actually following (gestures).