question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Broadcast does not work with Redis broker

See original GitHub issue

Checklist

  • I have included the output of celery -A proj report in the issue. (if you are not able to do this, then at least specify the Celery version affected).
  • I have verified that the issue exists against the master branch of Celery. - tested against latest Celery v4.2.1

Steps to reproduce

I have prepared minimal reproduce sampes and their output here: https://gist.github.com/andreyst/2ae51dcb568ce789e080fb8259b5bbc7

Expected behavior

I expect that task sent to broadcast queue will be executed by every launched worker.

I expect broadcast to work in Redis broker because it is mentioned on Redis broker page here: http://docs.celeryproject.org/en/latest/getting-started/brokers/redis.html#caveats

Actual behavior

Task sent to broadcast queue is not received and not executed by any launched worker using Redis broker. Changing broker to RabbitMQ and not touching anything else works as expected.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:15 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
deepchatterjeeligocommented, Nov 15, 2019

@auvipy I tried installing celery from master (https://github.com/celery/celery.git) and kombu from #1122 (https://github.com/LeetCode-OpenSource/kombu.git) and can confirm that a minimal check like that mentioned here does not throw an exception.

0reactions
auvipycommented, Nov 15, 2019

Yay! It works with celery==4.4.0rc4!

could you try https://github.com/celery/kombu/pull/1122

Read more comments on GitHub >

github_iconTop Results From Across the Web

Broadcasting with Redis broker · Issue #2638 · celery ... - GitHub
Hi, I am looking into possibility to broadcast with Redis and wonder if anything has changed since Ask's answer two years ago: On...
Read more >
Broadcast task to all workers with redis and celery
I'd like to broadcast task to all workers with redis (broker and backend) and celery, but I didn't achieve, can you help me...
Read more >
[celery-users] Celery-Redis broadcast not working
hi, I am trying to develop a system that broadcasts a task to all celery workers after which tasks will be posted and...
Read more >
Frequently Asked Questions — Celery 2.1.4 documentation
Redis or a database won't perform as well as an AMQP broker. If you have strict reliability requirements you are encouraged to use...
Read more >
Using Redis — Celery 3.1.11 documentation
If a task is not acknowledged within the Visibility Timeout the task will be redelivered to another worker and executed. This causes problems...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found