CODEWITHSUNDEEP
pythonmysqlmultithreadingprocesspooling
user987263
user987263

Reputation: 21

Python MySQL connection pooling

I've looked through stackoverflow and can see some oldish posts on this and wondered what the current thinking is about pooling connections in Python for MySQL.

We have a set of python processes that are threading with each thread creating a connection to MySQL. This all works fine, but we can have over 150 connections to MySQL.

When I look at the process state in MySQL I can see that most of the connections are asleep most of the time. The application is connecting to a Twitter streaming API so its busy but this only accounts for a few connections.

Is there a good way of adding connection pooling to Python MySQL and can this be done simply without re-writing all of the existing code?

Many thanks.

PT

Upvotes: 2

Views: 2138

Answers (1)

ukessi
ukessi

Reputation: 1391

See DBUtils

Maybe you have an abstract layer for MySQL, you can modify this layer to avoid rewriting all the code.

If not, you have to hack your Python-MySQL driver.

Upvotes: 1

Related Questions