Google Search results in blank

#1

Hi,
anybody sees why I get every result as blank?
Thanks !!

#2

Hi, thank you for noticing this.

The News results has been remade and are generated by a different method compared to normal results. Had to remove it, together with sort option which Google removed a while back.

However, added domain and path fields, might be useful? Updated the connector if you want to try.

#3

Is it impossible to get only news sites ? Im only interested in editorial content (newspapers, magazines, etc). Thanks

#4

Not impossible but difficult. Have you tried DatafoSEO connector? It has a great Google News scraper among other things. Requires latest SeoTools build.

#5

No. Not a free tool I guess?

#6

Is it really difficult ? As difference in the URL I can see source=lnms&tbm=nws (difference between Google search and Google News)

#7

I believe DataforSEO have some initial free requests for new users.

That part is easy, capturing URL, Title etc is harder.

#8

Well, would need only URL or Domain

#9

You can edit the existing connector file and add another connector for Google News. Copy paste the 'Search results' connector, add the URL parameter for news, then create a suitable XPath for the URL field.

#10

Hmm not really sure how to do this

#11

Any help ? Thanks !!

#12

Where do I add the parameter ?

#13

Make a copy of GoogleSearch.xml, change the Id and Title attributes on line 2, make a copy of the followig node, line 25 to 73, change Id and Title to "News" or something.

<RestConnector Id="SearchResults" Title="Search Results">

You can change the URL in the Fetch.Url node to include news results. Then adjust the Xpaths in the Parse node below.

#14

Hi,
don´t understand this:

And this, as in Spain we don't have "real" Google News, so there is no google.com/news or news.google.com available (https://www.newsmediaalliance.org/google-news-shutdown-in-spain-not-as-bad-as-google-would-have-you-believe/)

You can change the URL in the Fetch.Url node to include news results. Then adjust the Xpaths in the Parse node below.

#15

Not sure what you mean but I believe one of these parameters sets results to news:

https://www.google.se/search?q=zlatan&source=lnms&tbm=nws

#16

Still don't know exactly what to change...
"

"

#17

You need a better text editor and some basic coding skills. Look in the 'Fetch' tag, this is where the URL is created.

unfinished guide

#18

Well I have no coding skill, that's one reason why I use the plugin :grinning:
This wasn't the editor I used. I made the screenshot on the Mac.

OK, will read the guide. Thought it would faster copy & paste style...