I thought you could only lose it once every 30 minutes. Granted there are a few variations of the game and there is no set grace time period, but I always allow 30 minutes. It's better that way. Because then when someone just forgets about the game you can remind them and annoy them again :P