The Tibetan Buddhist Lama Temple is a rather big complex. You should spare at least a couple of hours to visit it. I do not think it necessary to take a guided tour. Along the way, you will find plenty of boards with explanations (in English and Chinese).
After visiting the Lama Temple, if you still have some time left, I recommend taking a look at the nearby Confucian Temple.