Ambergris Caye isn't for everyone. It is unlike most other tourist destinations which is why so many love it. This is not the place to come if you like the cookie-cutter type of vacation or island.
Sorry you didn't have a good time. (although you probably should have done a bit more research)
By the way, A lot of people don't wear shoes here whether they can afford them or not. Thats part of the laid back atmosphere.