CODEWITHSUNDEEP
phpasynchronous
Ryall
Ryall

Reputation: 12281

How can I efficiently run simultaneous network requests?

I have a web-app, written in PHP, and I am using Symfony2 as the core framework.

I need to regularly run thousands of small network requests every 10 minutes or so and I am trying to find the best solution for asynchronously running these jobs, without conflicting or doubling up.

Currently I have a very basic and inelegant solution where a cron job executes a PHP command script. The command synchronously works through each entry in the database and sends a network request. When that request completes (or fails), it moves on to the next one. When it has iterated over all entries, it exists, to be executed again from the cron job.

For the rewrite, I have looked at php-resque and pcntl_fork as solutions for running jobs in parallel, thereby speeding up the execution significantly. I have also looked at running multiple non-blocking socket requests from PHP but, so far, have preferred the simplicity of isolated jobs.

Upvotes: 1

Views: 165

Answers (2)

Joe Watkins
Joe Watkins

Reputation: 17158

http://php.net/pthreads

http://github.com/krakjoe/pthreads

Examples on github... and included in distribution, use code in github, it contains fixes not yet released.

Upvotes: 1

Madbreaks
Madbreaks

Reputation: 19539

PHP can't do threading in the traditional sense, so what you're trying to do isn't really possible in the way that you're thinking. You've looked at the best solution (probably) in pcntl_fork, but that still won't be truly asynchronous. Have you considered using cron to accomplish this instead?

Upvotes: 1

Related Questions