Yes, just one at a time - only if the monster currently in Tokyo decides to leave (due to an attack) do you get to enter.
Things change a bit with 5 and 6 players, where Tokyo Bay opens up as well.
Things change a bit with 5 and 6 players, where Tokyo Bay opens up as well.