question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

More crowdworker feedback

See original GitHub issue

@yeganehkordi @Palipoor wondering if you can help with these?

 - [ ] task1356_xlsum_title_generation.json
    - regarding instructions: `Maybe on the negative examples say how you would change the title.`
 - [ ] task393_plausible_result_generation.json
    - regarding instructions: `Maybe including examples where each answer the "who, what, when, where and why"?`
 - [ ] task442_com_qa_paraphrase_question_generation.json
    - regarding instructions: `Maybe "hitler" and "louisiana" with a capital "H" as it's a proper noun`

Issue Analytics

  • State:closed
  • Created a year ago
  • Reactions:1
  • Comments:10 (4 by maintainers)

github_iconTop GitHub Comments

2reactions
danyaljjcommented, Apr 14, 2022

While doing this, could you also check the human predictions (the last tab): https://docs.google.com/spreadsheets/d/1wXStPurP6AamxvglOw0aOJ7V1DiSKczJNyFcyfDnk4w/edit?usp=sharing

See if there is anything that can be improved in the instructions in order to improve human annotators’ understanding of each task.

0reactions
yeganehkordicommented, May 9, 2022

Yes, we can close this issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Power of Many: The Rise of Crowdsourcing Feedback and ...
The process is virtually identical, and both sites have 100% customer satisfaction ratings. The biggest difference is in how you pay, with ...
Read more >
Fostering Creative Performance of Platform Crowdworkers
The current reality for most crowdworking setups is that information about the objectives and outcomes of specific task assignments is limited ( ...
Read more >
Crowdsourcing Feedback: It May Be the Answer to ... - TLNT
How do you feel about performance reviews? Personally, I think the annual performance review (as most commonly implemented) is broken.
Read more >
Crowdsource Your Performance Reviews
Crowdsourcing, by leveraging social recognition data, is a better way for managers to collect, evaluate and share information on employee ...
Read more >
Crowdsourcing: A Better Way to Give Employees Feedback
Use these 5 crowdsourcing techniques to improve your employee reviews--and your workers' happiness with their jobs.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found