CODEWITHSUNDEEP
pythonweb-scrapingbeautifulsoupmasking
V Manikandan
V Manikandan

Reputation: 370

IP masking with Python

I am using Python Beautiful Soup for website Scrapping. My program hits different urls of a website more than thousand times. I don not wish to get banned. As a first step, I would like to introduce IPmasking in my project. Is there any possible way to hit different urls of a website from a pool of rotating IPs with the help of Python modules like ipaddress, socket etc?

Upvotes: 0

Views: 3085

Answers (1)

rmarques
rmarques

Reputation: 91

The problem is your public IP address. What you can do is use a list of proxy's and rotate through them.

Upvotes: 1

Related Questions