Broadcast does not work with Redis broker
See original GitHub issueChecklist
- I have included the output of
celery -A proj report
in the issue. (if you are not able to do this, then at least specify the Celery version affected). - I have verified that the issue exists against the
master
branch of Celery. - tested against latest Celery v4.2.1
Steps to reproduce
I have prepared minimal reproduce sampes and their output here: https://gist.github.com/andreyst/2ae51dcb568ce789e080fb8259b5bbc7
Expected behavior
I expect that task sent to broadcast queue will be executed by every launched worker.
I expect broadcast to work in Redis broker because it is mentioned on Redis broker page here: http://docs.celeryproject.org/en/latest/getting-started/brokers/redis.html#caveats
Actual behavior
Task sent to broadcast queue is not received and not executed by any launched worker using Redis broker. Changing broker to RabbitMQ and not touching anything else works as expected.
Issue Analytics
- State:
- Created 5 years ago
- Comments:15 (7 by maintainers)
Top Results From Across the Web
Broadcasting with Redis broker · Issue #2638 · celery ... - GitHub
Hi, I am looking into possibility to broadcast with Redis and wonder if anything has changed since Ask's answer two years ago: On...
Read more >Broadcast task to all workers with redis and celery
I'd like to broadcast task to all workers with redis (broker and backend) and celery, but I didn't achieve, can you help me...
Read more >[celery-users] Celery-Redis broadcast not working
hi, I am trying to develop a system that broadcasts a task to all celery workers after which tasks will be posted and...
Read more >Frequently Asked Questions — Celery 2.1.4 documentation
Redis or a database won't perform as well as an AMQP broker. If you have strict reliability requirements you are encouraged to use...
Read more >Using Redis — Celery 3.1.11 documentation
If a task is not acknowledged within the Visibility Timeout the task will be redelivered to another worker and executed. This causes problems...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@auvipy I tried installing
celery
from master (https://github.com/celery/celery.git) andkombu
from #1122 (https://github.com/LeetCode-OpenSource/kombu.git) and can confirm that a minimal check like that mentioned here does not throw an exception.could you try https://github.com/celery/kombu/pull/1122