If your kids are the active types, there are miles and miles of bike trails throughout the island that are fun to explore and are pretty much a daily activity. There are a ton of great restaurants and plenty of museums that are family oriented.
Don't get me wrong, its not Disney World, but between the beach, shopping at Harbor Town or around the island, the serenity, enterprising good times for the family shouldn't be that difficult.