An icon of the whaling era in a gorgeous seaside town that feels more New Englandy than the rest of the Hamptons. There are only eight guest rooms, so it's tough to book. A well-regarded restaurant lets you take a peek into the place. Service can be a little snarky.