Scraping Emails from protected sites

#1

Hi,
how can I scrape emails from protected sites: I have to login to Facebook to be able to see the email on https://www.listennotes.com/podcasts/estamos-contigo-radio-obradoirocom-UEitVbWCMOY/

I would like to as well how I could scrape the URL of the "We"-Button. Thanks

#2

Hi Nosh,

This is currently not possible because SeoTools sends an anonymous HTTP request. It is possible to add headers but I doubt it would be possible to use headers to imitate successful Facebook-login and display the email.

One way would be to use some kind of browser extension and save all pages you are interested in. Then use XPathOnUrl on the local files. See the section "Local files".

Alternatively, I would go for a python scraper or some other library which supports browser control.