Crowdsourcing Adverse Test Sets to Help Surface AI Blindspots
You must be logged in to submit a test set.
Your remaining quota is 0. Participants will submit sets of image-label pairs in this format - example submission file.      

Check Participate to learn how to start contributing.

  • A submitted set can contain 1 or more image-label pairs not exceeding participants' submission quota;
  • Each submission set should contain only image-ID and target-label pairs from the target images (subset of OID) and the target labels set;
  • Additionally participants will include a brief free text explanation of their discovery rationale and motivation for every image-label pair;
  • Participants can submit multiple times within their submission quota;

Submit a new submission:      

Below you can find the list of your submissions.