To start participating, sign up and accept
the terms and conditions.
To participate you need to submit a sample set of images from the
target images for the
Each submission should be a CSV file;
Each submission should contain in every row of the CSV file only imageIDs,
corresponding target label, and a brief text explaining the discovery rationale;
Each submission should contain only image IDs from the
and labels from the
target label set; Check the
example submission file.
Synthetically-manipulated images are not accepted;
Each submission should not exceed participants submission quota
(see Submission for quota explanation);
Participants earn points by submitting
adverse examples, which are image-label pairs
for which the human verification is in disagreement with a machine prediction, e.g.
human verification = Y, machine prediction = N (false negative);
human verification = N, machine prediction = Y (false positive).
If multiple participants submit the same image-label pair, a point is
awarded to the first participant who submits it
(based on the timestamp in the submitted images queue)
The image-label pairs submitted by all participants will be
published on the challenge website and will be visible in
the Queue page;
Participants earn bonus submission quota with every
image-label pair which earned them a point;
The Leaderboard is
updated continuously as the image-label pairs are verified.
Participants are free to use any creative form of sampling methods for discovering
images from the OID dataset (including generating synthetic manipulations of the original
OID images to identify both false positives and false negatives).
Check Overview to learn about types of adverse examples.
Check Rules to learn about the rules for this challenge.