If I wanted to connect to two systems simultaneously, is this possible? Or do I just need to open a 2nd browser tab to accomplish?

Exactly, just open up another tab and create a new session. Note the host you are connecting to must support additional simultaneous connectivity for that user account, this is OS and Protocol dependent but will work just fine.