How to safely remove public data from online background checks?

I've found my name and public information on several background check websites like White Pages, Intelius, fastbackgroundcheck.com etc. I'd like to remove as much information as possible, but I've found that the websites ask not only for an email address (plus confirmation), but phone number, DOB, etc. after the email. I worry I'm just giving them more of my info or validating what they have.

How do I legitimately remove my profiles without giving them more of my data?

A lot of these are American websites, but does residing in the EU make a difference?