Walking in midtown Manhattan one day, I passed Bryant Park and discovered this. The only downside (in my mind) is that, according to the posted rules, board games are banned. It closes at the end of the month for the season (and reopens next spring), so what are you waiting for? Here's an nice article about other good New York spots for book lovers.
Does your city or town have anything comparable?