Celery

From RHS Wiki
Revision as of 09:28, 13 January 2020 by Rafahsolis (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Install[edit]

pip install Celery

Create Virtual Host and User[edit]

sudo rabbitmqctl add_user <username> <password>
sudo rabbitmqctl add_vhost <vhostname>
sudo rabbitmqctl set_permissions -p <vhostname> <username> ".*" ".*" ".*"

With RabbitMQ[edit]

sudo apt-get install rabbitmq-server
# Create rabbitmq user
sudo rabbitmqctl add_user myuser mypassword
# Create rabbitmq vhost
sudo rabbitmqctl add_vhost myvhost
sudo rabbitmqctl set_user_tags myuser mytag
sudo rabbitmqctl set_permissions -p myvhost myuser ".*" ".*" ".*"
Starting/Stopping the RabbitMQ server
To start the server:
$ sudo rabbitmq-server
you can also run it in the background by adding the -detached option (note: only one dash):
$ sudo rabbitmq-server -detached
Never use kill to stop the RabbitMQ server, but rather use the rabbitmqctl command:
$ sudo rabbitmqctl stop

Workers[edit]

Launch[edit]

celery -A {ProjectName} worker -l info --queues=queuename1,queuename2

SystemD[edit]

Service File[edit]

[Unit]
Description=CIA Celery Scheduler
After=network.target

[Service]
User=tenkaichi
Group=tenkaichi
EnvironmentFile=/etc/default/celerybeat
WorkingDirectory=/home/tenkaichi/CIA
ExecStart=/bin/sh -c '${CELERY_BIN} -A ${CELERY_APP} beat --loglevel=${CELERYBEAT_LOGLEVEL} --scheduler=${CELERYBEAT_SCHEDULER} --logfile=${CELERYBEAT_LOG_FILE}'
Restart=always
RestartSec=3

[Install]
WantedBy=multi-user.target

/etc/default/celerybeat[edit]

CELERY_BIN="/home/tenkaichi/.virtualenvs/cia/bin/celery"
CELERY_APP="CIA"
CELERYBEAT_CHDIR="/home/tenkaichi/CIA"
CELERYBEAT_SCHEDULER="django_celery_beat.schedulers:DatabaseScheduler"
CELERYBEAT_OPTS=""
CELERYBEAT_LOGLEVEL=debug
CELERYBEAT_LOG_FILE="/home/tenkaichi/CIA/logs/celery_beat.log"
DJANGO_SETTINGS_MODULE="CIA.settings"

Run task at specific time[edit]

import datetime

import celery

@celery.shared_task(bind=True)
def add_tag(task, user_id, tag):
    User.objects.filter(id=user_id, tags__ne=tag).update(push__tags=tag)
    return True

user_id = '582ee32a5b9c861c87dc297e'
tag = 'new_tag'
started_at = datetime.datetime(2018, 3, 12, tzinfo=datetime.timezone.utc)
add_tag.apply_async((user_id, tag), eta=started_at)

https://vinta.ws/code/run-a-celery-task-at-a-specific-time.html