Commit Graph

13 Commits

Author SHA1 Message Date
Vincent Driessen 06ce9622ea Add compact() method on Queues, to remove dead messages. 2012-02-14 22:55:51 +01:00
Vincent Driessen 80a615a61c Flake8 style fixes. 2012-02-14 22:55:39 +01:00
Vincent Driessen e4055ca42f Allow queues to be emptied. 2012-02-14 17:53:09 +01:00
Vincent Driessen e05acfedce Fix putting jobs on the failure queue when they fail. 2012-02-10 17:19:30 +01:00
Vincent Driessen 370399f8f7 CHECKPOINT: dequeue_any now returns the queue that was popped from. 2012-02-08 17:55:38 +01:00
Vincent Driessen f516f8df2e CHECKPOINT: Handle failing and unreadable jobs.
Failing (or unreadable) jobs are correctly put on the failure queue by
the worker now.
2012-02-08 15:18:27 +01:00
Vincent Driessen b1650cb9b9 CHECKPOINT: Second part of the big refactoring.
Jobs are now stored in separate keys, and only job IDs are put on Redis
queues.  Much of the code has been hit by this change, but it is for the
good.

No really.
2012-02-08 14:18:17 +01:00
Vincent Driessen 65105b44c3 CHECKPOINT: Initial part of the big refactor. 2012-02-08 00:40:43 +01:00
Vincent Driessen 7fff52d99c Get rid of ugly custom assertion. 2012-02-07 20:59:29 +01:00
Vincent Driessen fcca48a9d7 Rename empty property -> is_empty() method. 2012-02-07 20:53:06 +01:00
Vincent Driessen 7eb8d92605 Put unreadable tasks on the failure queue. 2012-01-30 19:41:13 +01:00
Vincent Driessen 0be1cb6ac0 Change the way jobs are pickled.
There is no job tuple anymore, but instead Jobs are picklable by
themselves natively.  Furthermore, I've added a way to annotate Jobs
with created_at and enqueued_at timestamps, to drive any future Job
performance stats.  (And to enable requeueing, while keeping hold of the
queue that the Job originated from.)

This fixes #17.
2012-01-30 16:52:28 +01:00
Vincent Driessen 1f64157c38 Broke down tests into multiple files. 2012-01-28 07:58:40 +01:00