So you need to actually open a thread, not just select it, before you can see the Leave button. This is the bit I wasn't understanding. Quite counter-intuitive and clunky.
And you can't multi-tag and delete a batch. This is a considerable step backwards from when they were called Private Messages.