Sink directly into Mother Earth at the Makauwahi Sinkhole on the South side of the island down the two-mile Mahaulepu Heritage Trail, just a short walk further through a forest of trees and piled up rocks. Unseen to most tourists, keep continuing on, (probably on all fours to get through the tight spots), but you will end up on the other side of a magnificent garden of Eden, aka the Makauwahi Cave, a massive sinkhole considered to be one of the richest sites of fossils in the US and a treasure chest for history buffs. The sinkhole sits on 17 acres of land with fossils dating back over 10,000 years of Kauai history.
The layers in the walls of the limestone sinkhole have preserved histories of hurricanes, droughts, and floods, including tons of bones of extinct animals. I don't suggest driving here (simply because the hike in is so scenic and beautiful!), but near the parking lot, there are tons of tortoises that you can get up close and personal with.
Tip: Free guided tours are available from 10am-2pm on Wednesdays, Friday, Saturdays, and Sundays.