The Crystal Cave The limestone Crystal Cave in Put-In-Bay, Ohio, was discovered in 1897 and can still be visited today. Vintage linen postcard showing the entrance and crystals from the Crystal Cave in Put-In-Bay, Ohio. Postcard showing the interior of one of the caves at the Crystal Cave in Put-In-Bay, Ohio.