Stack Exchange recently started a collaboration project with the University of Melbourne, in an attempt to improve the automatic detection of duplicate questions.

More information on the project and a call for help from the community can be found here: Project Reduplication of Deduplication Has Begun!

In it, Tim Post mentions that Doris Hoogeveen (me) will post a message on the different meta sites to let you know that we're ready for help. This is it!

As a brief summary, the project is about finding ways to automatically determine if two questions are duplicates, and also to detect the opposite: falsely tagged duplicates. To validate our methods, we need manual judgements from people who really know the data. This is where we need your help. It is impossible to manually annotate all the data from Stack Exchange, and so we have applied several filters to make sure we only show you questions pairs with a high likelihood of being duplicates.

Participation is completely optional, and there's no minimum time requirement. If you are interested in participating in the project, please head over to the annotation interface, which can be found here: http://hum.csse.unimelb.edu.au/se-annotate/

You can log in with your Stack Exchange account, so no sign up is required. The site also contains some more information on the project, which might answer some questions you may have. And I'm also happy to answer them here.

Thank you!

  • Cool, I'll make sure to participate. – Matt07211 Oct 29 '16 at 7:40
  • 1
    Thanks Matt07211! – Monozygotic Oct 30 '16 at 22:14
  • 1
    Hi everyone, thanks to everyone who has helped me in this project so far. I have improved the interface based on feedback from you. You can now see tags, the voting has directionality, and you can optionally see the comments and answers to questions. Your previous work has all been saved, so you will not have to start from scratch. – Monozygotic Nov 10 '16 at 21:57

The project is drawing to a close, and I am planning to take down the annotation interface this weekend.

Thank you very much to everyone who helped out, and thank you for all the valuable feedback and suggestions. Hopefully the collected annotations will lead to the development of better duplicate question detection systems, especially for StackExchange.

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .