we've had a few meet-ups at the eton house on danforth ave... they used to hold bbw parties there several years ago, so folks in the community knew where it was - but it's not really central.
esplanade is pretty easy to get to for out-of-towners who might want to take the train in, so the scotland yard pub is a good option. but i think most of the restaurants along there probably have large sitting space.
1 year