I've pretty much got everything planned for our long weekend in Boston. On Sunday, we're doing the aquarium whale watching trip, which departs from the wharf at 2:00pm. I'm looking for a casual Sunday brunch nearby so we can go around 11:30-12 and not be rushed to get to the wharf. I'm not looking for a champagne brunch or nice hotel brunch - just a good casual place if possible. Alternately, if there is a must-do place for an early casual lunch in the area, that's cool too.
Thanks everyone for all the suggestions! We went over Labor Day and had the most fabulous time. Rock-n-Voll and other Bostonians, I am jealous! Boston is now on our "maybe we should move here someday" list.
We did the Freedom Trail, ghost tour with Haunted Boston, ferry day trip to Salem, the "unofficial" Hahvard Tour in Cambridge, aquarium whale watch trip, and spent a lot of time wandering around. We had amazing dinners at Monica's in the North End, Atlantic Fish Company, and good fish and chips at Emmett's pub. In Salem we had lunch at Lobster Shanty (soo good) and in Cambridge had lunch at Grendel's Den (food ok, good beer/cider). Neptune Oyster was awesome - I gather it's kind of a tourist place, but the oysters were the real deal. We met lots of nice/friendly people and fell in love with the city.