question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

MTurk Agent cannot observe distinct messages

See original GitHub issue

Hi @JackUrb, I have modified the mturk model evaluator task example according to my need. I wanted to show multiple messages after each round of dialog.

The Problem

When I try to show two messages on the chat interface one after other, then only second message is being shown twice. For example:

msg1 = "Message 1"
msg2 = "Message 2"

Ideally it should print Message 1 and then Message 2 on the interface but that doesn’t seem to happen. It only prints Message 2 both the times. Please see the modified code of model evaluator task here: https://github.com/deshraj/ParlAI/blob/eval/parlai/mturk/tasks/model_evaluator/worlds.py#L35

Here is the screenshot of the error:

screen shot 2018-01-26 at 4 03 03 pm

Terminal log: https://pastebin.com/ci2ZHX7t

Let me know if I am missing something here.

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:6 (6 by maintainers)

github_iconTop GitHub Comments

1reaction
JackUrbcommented, Feb 6, 2018

No worries - others were becoming dependent on it and I had a free moment

0reactions
deshrajcommented, Feb 6, 2018

Thanks @JackUrb for fixing it. Sorry, I could not get time to work on it due to other things going on otherwise I would have loved to send a pull request for the same.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Tutorial: Reconciling Worker Responses - Happenings at MTurk
One powerful method for ensuring quality is to assign each task to two, three, or more Workers. Because even the most diligent Worker...
Read more >
FAQs - Amazon Mechanical Turk
No. As a public crowd marketplace, MTurk is not designed for sharing or publishing HITs containing personal or sensitive data. It is your...
Read more >
Tutorial: Best practices for managing Workers in follow-up ...
Requesters use this capability to identify and exclude Workers that have consistently produced poor quality results on their tasks.
Read more >
FAQs - Amazon Mechanical Turk
Can I work on HITs if I don't provide my tax information? I'm a U.S. citizen living outside the U.S. and I am...
Read more >
The shape of and solutions to the MTurk quality crisis
Amazon's Mechanical Turk is widely used for data collection; however, data quality may be declining due to the use of virtual private ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found