My wife and I went to Smithville, NJ last weekend and it was pretty cool. Its by the water(not shoreline), but is more known for its shopping and colonial feel by the waterside-kind of like an old settlement.

They have a cheap bed and breakfast, a bunch of shops and eateries. It doesn't fit the OP's parameters, but anyone looking for a day trip might like the spot.
http://www.smithvillenj.com