Most people stay somewhere else on the mainland. The only people in Belize City are the people that live there and the people trying to get out and go elsewhere.
You could always just stay on the island and fly over for the trips although that could get costly...