Jesse - someone would need a specific reader to get my info - no more exposed than if my passport was stolen.
Someone walking past you with a reader in their coat pocket would automatically get your info. It's a new wave of identity theft.
Best thing you can do is protect your new passport with an RFID blocking wallet.