CODEWITHSUNDEEP
pythonweb-scrapingpython-multithreadingurllib3
Extect
Extect

Reputation: 15

Should num_pools in urllib3.PoolManager be bigger than max_workers in ThreadPoolExecutor?

I am using ThreadPoolExecutor from concurrent.futures to run multiple HTTP requests concurrently. I’m wondering if the number of threads specified in max_workers affects the optimal number of connection pools in urllib3.PoolManager. Specifically, should the number of connection pools ideally be greater than the number of threads to optimize request caching?

Upvotes: 0

Views: 28

Answers (0)

Related Questions