If you are into culture and historical sites, your place is Ubud. This old town is located about one hour Northeast of Kuta. You can get here by public bus, by a rented motorbike, by taxi, or, the most convenient way, by a rented car with a driver.
In Ubud you will find many Hindu temples, cultural activities and handicraft shops.