Sometimes you can rejoin if you restart the app quickly enough, but it doesn't always work.