CODEWITHSUNDEEP
pythonweb-scrapingaws-lambda
sheenu85
sheenu85

Reputation: 168

Python AWS Lambda Web scraper

I need to scrape a URL to send content to my Lambda function. I am trying to achieve it by packaging BeautifulSoup with my Lambda function, but I am getting import errors like: cannot import name 'CharsetMetaAttributeValue' etc. I am not sure if bs4 should be used in AWS environment or not.

Any suggestions would be helpful.

Upvotes: 0

Views: 1608

Answers (1)

sheenu85
sheenu85

Reputation: 168

I am able to use compiled lxml package with Lambda function for web scraper. Compiled package is available at github this link: https://github.com/JFox/aws-lambda-lxml/tree/master/3.6.4

Upvotes: 2

Related Questions