I was too polite as a young thing too. But when you’re in the company of a manipulator, they will persist, no matter how firm you are.
Well done for getting out of that situation before it got any worse.