Other factors to consider are important amenities such as road access, electricity, city water and cable tv. Although cell phone coverage is now available every where on the island the same cannot be said about the other basic amenities.
Keep in mind that you may be able to purchase a lot for $50K in Palm Bay - but the cost to develop that lot will be considerably higher than construction costs closer to town.
Although a developed property such as a condo may not be the your "dream" property at the moment you may find that buying a vacation home that is immediately useable that has the potential to produce income and can be resold in the future could be your most practical option. It provides immediate gratification - with fairly fixed costs that you can budget. One of the many benefits of a condo is that the vast majority are located close to town and have amenities in place. Having shared grounds, pier and pool mean you can enjoy these features without having to bear all of the costs of maintenance.
If you would like to discuss this subject drop me a PM - I will be happy to discuss your particular concerns and interests.