Hi;
I have several URLs from 'fanficton.net' and want to get page titles of them in Excel but it seems cloudflare blocks access to the site; I get "Attention Required! | Cloudflare" instead of page title. tried to change user agent info to the latest Google chrome on windows ( * Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome /87.0.4280.88 Safari/537.36.) in global HTTP settings , but still cloudflare blocks my access. Is there anyway to bypass cloudflare?
I have no problem opening 'fanfiction.net' on my browsers.
I couldn't solve it either, but works when using the PhantomJS Cloud Connector which is a headless browser. XPath //title returns "FanFiction".
Other have the same issue:
https://www.reddit.com/r/FanFiction/comments/kh3i10/sad_news_for_my_fanfiction_archiver/
1 Like
Thanks for attention;
I didn't find how to install PhantomJS Cloud Connector in Excel. Can you help me?
It should be in Other-> Scraping category. If not, look in the Manager:
https://seotoolsforexcel.com/manage-connectors/