The default behavior is to maintain a persistent session. Go into your extension preferences and configure it to terminate open sessions on browser close. Make sure the browser isn't configured to run in the background with all the windows closed.