Site returns 406 Not Acceptable


#1

Https://www.dandb.com/businessdirectory/

Can Not get scraping on this site. When ever trying to scrape using CSS or Xpath it says "406 Not Acceptable". Please need solution.


#2

Perhaps you are blocked from that site. Try with a proxy or different network? Works for me:
image