CODEWITHSUNDEEP
pythonweb-scrapinglinkedin-api
Abiy
Abiy

Reputation: 21

How can we avoid linkedin security verification page when trying to scrape data using Python?

I have been trying to scrape list of attendees of an event with their names, where they work and located plus their linkedin contact information; I am using Selenium & bs4 libraries of Python, on top of that Chrome as a web browser and the code works fine, however, sometimes linkedin sends me a security verification page and subsequently, my code breaks. Is there a way to avoid linkedin from sending me the security verification page?

Upvotes: 2

Views: 3974

Answers (2)

Rishabh Sharma
Rishabh Sharma

Reputation: 101

Here are the Steps which I took to bypass Security Check By Linkedin.

  1. Change your IP address.

The simplest way to change the IP address of your device is to switch to a different network. For example, if you're browsing on your home Wi-Fi connection on your smartphone, you can turn the Wi-Fi setting off and use mobile data.

  1. If you can use AI to select the correct image of the cat, it would be great, but good luck with that.

  2. Another tedious task would be if you can change linkedin ID's after a specific time, this also surpasses the security check.

I still suggest the first one.

Hope it helps.

And Even if you can't change network everytime, you can do following steps to change your ip everytime.

Go to Command Prompt and run it as Administrator

Type "ipconfig /release"

Now,Type "ipconfig /renew"

For more help check: https://kb.salisbury.edu/display/TSC/Release+and+renew+an+IP+address

Upvotes: 1

M B
M B

Reputation: 3430

You should probably use the official LinkedIn API, or if you want a premade wrapper around this API, you could use this. From there on, you only have to call the api:

profile = api.get_profile('billy-g')

But this may not be practical for you, since you already spent time building a working web scraper.

Upvotes: 1

Related Questions