Hi Francie,
Yes, there are a couple of local groceries in Caye Caulker..they have baby food, formula, and diapers...
Bring what you can because it costs more on the island than in the states.
Lots of water sports...snorkeling, diving, riding bikes, paddle boards, sea kayaks...
Have a great time!