MTurk Agent cannot observe distinct messages
See original GitHub issueHi @JackUrb, I have modified the mturk model evaluator task example according to my need. I wanted to show multiple messages after each round of dialog.
The Problem
When I try to show two messages on the chat interface one after other, then only second message is being shown twice. For example:
msg1 = "Message 1"
msg2 = "Message 2"
Ideally it should print Message 1
and then Message 2
on the interface but that doesn’t seem to happen. It only prints Message 2
both the times. Please see the modified code of model evaluator task here: https://github.com/deshraj/ParlAI/blob/eval/parlai/mturk/tasks/model_evaluator/worlds.py#L35
Here is the screenshot of the error:
Terminal log: https://pastebin.com/ci2ZHX7t
Let me know if I am missing something here.
Issue Analytics
- State:
- Created 6 years ago
- Comments:6 (6 by maintainers)
Top Results From Across the Web
Tutorial: Reconciling Worker Responses - Happenings at MTurk
One powerful method for ensuring quality is to assign each task to two, three, or more Workers. Because even the most diligent Worker...
Read more >FAQs - Amazon Mechanical Turk
No. As a public crowd marketplace, MTurk is not designed for sharing or publishing HITs containing personal or sensitive data. It is your...
Read more >Tutorial: Best practices for managing Workers in follow-up ...
Requesters use this capability to identify and exclude Workers that have consistently produced poor quality results on their tasks.
Read more >FAQs - Amazon Mechanical Turk
Can I work on HITs if I don't provide my tax information? I'm a U.S. citizen living outside the U.S. and I am...
Read more >The shape of and solutions to the MTurk quality crisis
Amazon's Mechanical Turk is widely used for data collection; however, data quality may be declining due to the use of virtual private ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
No worries - others were becoming dependent on it and I had a free moment
Thanks @JackUrb for fixing it. Sorry, I could not get time to work on it due to other things going on otherwise I would have loved to send a pull request for the same.