Board Thread:Bug/Issues/Suggestions/@comment-151.26.24.97-20150521094912/@comment-26352717-20150521151158

Hi Mario,

That's amazing! Thank you for your contributions! Because this campaign will be 10,000 docs long (we're still working on loading more docs) and no one has actually read 10,000 docs, we're relying on community consensus to help us determine what's 'the most correct' marking. That is, we won't be looking for any individual's marking to be the 'the most correct'; rather, the correct markings will pop out of the aggregate of the markings from the 15 different users.

This is why individually, you don't have to be perfect, and it's fine to make mistakes! Other Mark2Curators will also mark some items correctly and make some mistakes. After enough people (15 in our previous studies) do the same doc, the items most people marked will likely be correct, while the items only a few people marked here or there will likely be incorrect. Items which half the people marked and half didn't may give us clues about what the ambiguous cases are.

This works only if people are doing their best to mark what they think is the correct answer. If people go back to correct their answers, it's possible that people will end up marking incorrect items that they frequently saw marked by their partners. Hence, we currently do not allow users to go back and change their markings.

With regards to the partner. In the practice docs, you will always be paired with a partner who has done the docs well. In the quests, you will be paired with anyone who has completed the quests before you. At this time, it's more or less randomized to ensure that community consensus isn't guided by just one user.

I know that users, like you, are fast learners and want to give the best answers possible in order to help us; hence I understand your strong desire to go back and correct your work now that you know more than when you started. However, it's important for you to know that YOU ARE AND HAVE BEEN HELPING US A LOT!

You've completed all the quests! You've asked a lot of great questions which helped to clarify ambiguous situations! You've posted your questions/suggestions here, where others can also learn and improve from them! In other words, you've been awesome all along! Correcting your markings on a some of your docs from early on won't increase the level of awesome you've already shown.

Sorry for the long-winded answer. There were a lot of questions.

best wishes,

ginger