XpathOnUrl returns empty cell, I am trying to scrape Name, Location and experience from linkedin

Support
#1

I am trying to scrape Name, Location, experience etc from Linkedin.
I have searched specific people on linkedin using google search. I have to go to each link in google results and copy paste the information i need.
I am using XpathOnUrl for this purpose but I am getting empty cell instead of results, although i am able to scrape linkedin profile links from google search results.
Google search page url is: https://www.google.com.pk/search?q=marketing+manager+"ge+healthcare"+“Current.”+site:linkedin.com/in/+-uk+-sg&biw=1366&bih=362&noj=1&ei=BYsDV4vYEoe90gSLkoegBQ&start=440&sa=N

I used code =Dump(XPathOnUrl(https://www.google.com.pk/search?q=marketing+manager+%22ge+healthcare%22+%E2%80%9CCurrent.%E2%80%9D+site:linkedin.com/in/+-uk+-sg&biw=1366&bih=362&noj=1&ei=BYsDV4vYEoe90gSLkoegBQ&start=440&sa=N,"//h3[@class='r']/a","href"))
It worked and returned 10 linkedin profile links which is what i needed.
Now i want to further use XpathOnUrl on each of this linkedin url to go and scrape Name, Location, Experience.

For scraping name i am using code: =XPathOnUrl( linkedin_url , "//*[@id='name']/h1/span/span")
It returns empty cell. No error just empty cell. I have also tried changing @id='name' with @class='name' but no success.

Help in this regard is much appriciated.
@nielsbosma
Thanks

#2

Try the following Xpath, it works for me:

Name =XPathOnUrl( linkedin_url ,"///div[1]/div[2]/div[1]/h2/a/span")
Location =XPathOnUrl( linkedin_url ,"///dl//span")
Bio =XPathOnUrl( linkedin_url ,"///div[1]/div[2]/div[1]/p")
Followers =XPathOnUrl( linkedin_url ,"///div//strong")
Present Job =XPathOnUrl( linkedin_url ,"///td/ol/li")
Market =XPathOnUrl( linkedin_url ,"///dl/dd[2]")

2 Likes
#3

Thanks a lot for the help. Really appriciate it.

Every thing is working in this code now accept 'Name'. Btw i didn't see any h2 tag in codes for 'Name'

Here is the page script which is shown to me http://prntscr.com/ars55l

Can't figure it out i also changed the code for name but didn't work.

Thanks in advace.

#4

Well they say try try again and never lose hope.

I tried again and again and figured this code out which works for name.
=XPathOnUrl( Linkedin_URL,"///div//h1")

In case anyone else needed.

1 Like
#5

Thanks for the samples. I try to get XPathOnURL working for followers on a public Company Page.
I had a formula that worked for a few years, but it stopped working, so I am trying to find a new version.

I had no luck with the sample above.

The old formula was:
=XPathOnUrl("https://www.linkedin.com/company/mediafiler", "//*[@id='biz-follow-mod']/div/div/p/a/strong")

I tried these new ones but they keep returning blank cells. No error messages only blank cells:

=XPathOnUrl("https://www.linkedin.com/company/mediafiler", "//[@id='biz-follow-mod']/div/div/p")
=XPathOnUrl("https://www.linkedin.com/company/mediafiler","//[@id='biz-follow-mod']/div/div/div/p/*[@class='followers-count']")

Any ideas? Help would be very appreciated!

#6

These work perfectly fine. However, unable to get the contact number and email id.
I am trying with following
Contact Number XPathOnUrl(linkedinURL,"//table[2]/tbody/tr[td]")
Email Id XPathOnUrl(linkedinURL,"//div[2]/div/div[2]/div[1]/table[1]/tbody/tr[td]")

Kindly guide how to get contact Number and Email Id. I am trying only with my connections at Linkedin.

#7

Can you provide URL samples?

#8

I'm also having issues getting data from any LinkedIn profiles after they made the Gui change, some time ago I was able to get name, location, title, summary but not anymore.

#9

I was able to get this to work, as an example:

=Dump(XPathOnUrl("https://www.google.com/search?num=100&q=privia+health+site%3Alinkedin.com/in", "//h3[@class='r']/a", "href"))

however, what is odd is that using this technique and creating several columns such as this:

="https://www.google.com/search?num=100&q=privia+health+site%3Alinkedin.com/in&start=200"

it never goes above 500 found.

is this a limitation of SEO Tools or?

#10

Do you mean changing the pagination numbers to 300, 400 etc? SeoTools scrapes whatever is found on the page so I don't see a limitation. Perhaps something has changed in the DOM for search results above 500?

#11

seems like you can't scrape from linkedin anymore. if not, can someone show me how to scrape JS enabled sites with PhantomJs? i tried it on linkedin but it's not working on any profile page. any help?