What's the best way to use XPathOnUrl for a huge pool of links?

So let's say I have a column full of links, hundreds of thousands of links, and I want to pull information from each link using XPathOnUrl. What would be the best way using SeoTools? I've tried simply doing it in a new column but Excel often crashes/runs forever.

Any advice would be appreciated.

1 Like

I used XPathOnUrl to scrape some geographic data, about 20,000 rows of data, and I had to do it in batches. In other words, drag the formula down about 50 to 100 rows or so at a time. I don't know of any automated way with the plugin itself to incrementally run the formula in batches on a certain subset of rows. Even in small batches, it took a few minutes for it to fetch all the data.

I would recommend turning of caching. This can be done in the settings file. My sheets also crashed when I ran Xpath on more than a few hundred cells but now i can do thousands at a time.