[Pulp-list] Celery and the death of pulp tasking and gofer

[Pradeep Kilambi]

+1 This is awesome. Nice find! Seems to provide key areas that pulp relies on and if we can get rid of maintaining and developing another package ourselves(gofer/tasking library) I think its a win for us. If this can do everything it claims to do and do it well, I think we should seriously consider investigating this in a sprint.

~ Prad

 

----- Original Message -----
From: "Jason L Connor" <jconnor at redhat.com>
To: "pulp-list" <pulp-list at redhat.com>
Sent: Tuesday, January 18, 2011 4:56:12 PM
Subject: [Pulp-list] Celery and the death of pulp tasking and gofer

Hi All,

I've been watching this project grow for the last 6 months or so, and I
think it's time to seriously consider it.

Celery is a distributed task queue framework for python. It can use an
number of back ends, including mongodb and rabbitmq. It allows tasks to
be run synchronously and asynchronously, locally and remotely. It has
task persistence already implemented, as well as scheduling, including
retries.

It now runs on python 2.4+ (which it didn't used to), making it meet our
need to be rhel 5 compatible.

It's home page is here:
http://celeryproject.org/

I propose we take a very serious look at celery to replace both the pulp
tasking libraries and gofer project for our asynchronous and remote
execution needs.

It's feature set is well beyond what we've achieved, and I believe in a
single sprint we could replace the existing libraries and lend our
creative talents to a project already implementing the hard bits instead
of rolling our own here.

-- 
Jason L Connor
Software Engineer
Red Hat, Inc.
RHCE: 805010912355231
Freenode: linear
GPG Fingerprint: 2048R/CC4ED7C1

_______________________________________________
Pulp-list mailing list
Pulp-list at redhat.com
https://www.redhat.com/mailman/listinfo/pulp-list

-- 
 
-- 
Pradeep Kilambi
Red Hat Systems Management
pkilambi at redhat.com
Phone: +1 919 754 4285
RHCE/RHCDS # 805008680430554