makesites/bodacious

Job manager with multiple store support, based on Bull #multistore #jobmanager #queue #node #js

bodacious's Issues

Concurrency integer

When the option serial is false the jobs are executed with no limit.

Applying a limit may be preferable in some cases, when we don't want the running queue to take up too many resources of the machine.

Look into using async.queue that has a concurrency option...

Replace bluebird with async

Instead of promisifying all the Queue methods which creates another layer of complexity look into async to simplify the logic.

Cancel a job

You should be able to abort a running job by using job.cancel()

Main call to addAsync not calling then.

Looks like internally Queue calls Store.createAsync anyway, so replacing addAsync in main with add does the trick. Not sure why the callback is called, something internal to Bluebird.promisifyAll maybe.

Retry option

For failed tasks there should be an integer (in the options) that defines how many times a task will be run before removing from the queue.

Look into using async.retry with this syntax:

async.retry({times: [int], interval: [milliseconds] }, task, callback);

Prioritize not executed

Currently, every time the queue runs it will order the tasks chronologically. That means older jobs will always be at the top, even if they have already been executed and failed.

If we want to give new jobs a chance before re-running old jobs an option would be appropriate that sets a filter when the tasks are ordered.