CODEWITHSUNDEEP
ruby-on-railsdelayed-jobresque
user1769426
user1769426

Reputation: 117

Run a background job every few seconds

Say I have an application that needs to pull data from an API, but that there is a limit to how often I can send a query (i.e., caps at X requests / minute). In order to ensure I don't hit this limit, I want to add requests to a queue, and have a background job that will pull X requests and execute it every minute. I'm not sure what's the best method for this in Rails, however. From what I gather, DelayedJob is the better library for my needs, but I don't see any support for only running X jobs a minute. Does anyone know if there is a preferred way of implementing functionality like this?

Upvotes: 4

Views: 6804

Answers (3)

Abdo
Abdo

Reputation: 14061

I'm a little late but I would like to warn against using the whenever gem in your situation: Since you're using Ruby on Rails, using the whenever gem will be loading the environment each time it gets called in cron.

Give rufus-scheduler a try.

Place the code below, for example, in config/initializers/cron_stuff.rb

require 'rufus/scheduler'

scheduler = Rufus::Scheduler.start_new

scheduler.every '20m' do
  puts 'hello'
end

Upvotes: 7

Chuanpin Zhu
Chuanpin Zhu

Reputation: 2256

Maybe you can try [whenever]: https://github.com/javan/whenever

Then you can add your tasks as bellow:

every 3.hours do
  runner "MyModel.some_process"
  rake "my:rake:task"
  command "/usr/bin/my_great_command"
end

in a schedule.rb file

Upvotes: 1

tomdepplito
tomdepplito

Reputation: 102

First, I would recommend using Sidekiq for processing background jobs. It's well supported and very simple to use. If you do use Sidekiq, then there is another gem, called Sidetiq, that will allow you to run recurring jobs.

Upvotes: 2

Related Questions