There is that mentality. Developers have a long history of wanting mangroves removed. Florida has learned the lesson and is of some example for the rest of us.
http://funandsun.com/1tocf/natf/mangrove.html
http://www.reclamationproject.net/learn.htm
The cutting at night and under the guise of hurricane distraction is a technique by realtor's and developers in my neighborhood.
Government has never to my knowledge prosecuted anyone for it.
It all has to do with the perception they are unattractive and therefor make the property less marketable.
white sandy beach is highly marketable however an obvious deception when it washes away.

White Sands Dive Shop
https://whitesandsdiveshop.com/