Games usually say how long they take on the box. If it's too long just decline. If it goes over that usually in my experience it's because people are fucking around and making it take longer than it should instead of focusing on the game. Which is even more rude than leaving if it gets too late.