Novoflex close up adapter on Leica M lens

I have a Novoflex closeup adapter that I used with my Leica 50 mm M Summicron lens, and it is stuck on the lens. I press the button on the adapter to remove it, but it doesn't turn so I can remove it. Any suggestions?

Thanks