Click the Quit button to leave exmh. It takes a few moments to close down because it saves some state information before quitting. The Quit button greys out after you click it, and you see a few status messages as exmh shuts itself down.