In this picture you can see one of the refurbished buildings in Casco Viejo.
Panama City, like the rest of Panama, is a rather safe place. In the tourist areas, special tourist police patrol the streets. Tourist policemen are friendly, and will be more than happy to lend a hand to foreign visitors.
Some less touristy districts in Panama City are less safe, and should not be visited on your own, though.