Crowdsourcing Adverse Test Sets Challenge Consent Form

ENTRY IN THE CROWDSOURCING ADVERSE TEST SETS CHALLENGE CONSTITUTES YOUR ACCEPTANCE OF THESE POINTS.

The Crowdsourcing Adverse Test Sets Challenge (the “CATS4ML Challenge”) is a crowdsourcing event where individual participants or teams must submit a test set (“Test Set”). A Test Set is a sample of image-ID and target-label pairs from the Open Images dataset (OID, v6 train set) that will serve as blindspot examples for the given label from the target labels (“Target Labels”) set. This Test Set can contain 1 or more imageID-label pairs where the maximum number of imageID-label pairs per participant is determined by their submission quota. Each submitted Test Set will be scored based on the amount of adverse items in it. See below for the complete details.

1. BINDING AGREEMENT: In order to enter the CATS4ML Challenge, you must agree to the points in this consent form (“Conditions”). Therefore, please read these Conditions prior to entry to ensure you understand and agree. You agree that submission of an entry in the CATS4ML Challenge constitutes agreement to these Conditions. If you are entering as part of a company or on behalf of your employer, these Conditions are binding on you, individually, and/or your employer.

2. ELIGIBILITY: To be eligible to enter the CATS4ML Challenge, you must be: (1) above the age of majority in the country, state, province or jurisdiction of residence (or at least twenty years old in Taiwan) at the time of entry; (2) not a resident of Crimea, Cuba, Iran, Syria, North Korea, or Sudan; and (3) not a person or entity under U.S. export controls or sanctions. Competition is void in Crimea, Cuba, Iran, Syria, North Korea, Sudan, and where prohibited by law. You must enter as a team or as an individual.

3. SPONSOR: The CATS4ML Challenge is supported by the CrowdCamp event at the HCOMP2020 Conference and is organized by Google LLC (“Google”), a Delaware corporation with principal place of business at 1600 Amphitheatre Parkway, Mountain View, CA, 94043, USA.

4. CATS4ML CHALLENGE PERIOD: The CATS4ML Challenge will begin on Oct 19, 2020, and is scheduled to end on Nov 19, 2020 (“CATS4ML Challenge Period”).

5. HOW TO ENTER: NO PURCHASE NECESSARY TO ENTER OR WIN. To enter the CATS4ML Challenge, please create an account on the challenge website. All entries need to comply with the rules of the challenge published on the challenge website to be eligible. The CATS4ML Challenge organization team will evaluate each entry to ensure that it meets the criteria listed below. The CATS4ML Challenge organization team reserves the right, in its sole discretion, to disqualify any entrant who submits a Test Set that does not meet the criteria.

6. RATING: Each entry will be judged by a panel of human annotators who are contractors for Google (“Raters”).

TEST SET SCORING CRITERIA

The main task that the CATS4ML Challenge must facilitate is to enable participants to submit Test Sets of image-label pairs along with a brief sampling rationale (in English). We encourage creativity in the approach to sampling from contributors.

The CATS4ML Challenge will run for 2 months. Each registered participant receives an initial submission quota of 1000 imageID-label pairs. This means that each participant at the start of the challenge can submit a maximum 1000 imageID-target label pairs. After every imageID-label pair is scored an additional bonus quota can be awarded based on the success score of each participant. Submitted Test Sets will be scored continuously within 24 hours of submission and scores will be published on the CATS4ML Challenge website; See further scoring and submission details in the Challenge description.

DATA EVALUATION AWARD CRITERIA

At the end of the CATS4ML Challenge the leaderboard will be finalized and three top winners announced:

• In January 2020 an online event will be held to promote the winners and to discuss the learnings from the challenge;
• In October 2020 the CATS4ML Challenge will be promoted as part of the CrowdCamp event at the HCOMP2020 Conference.

Award winners will be notified by email. Determinations of Raters are final and binding.

7. AWARDS: No monetary awards will be granted for this challenge.

8. GENERAL CONDITIONS: All federal, state, provincial and local laws and regulations apply. Google reserves the right to disqualify any entrant from the CATS4ML Challenge if, in Google’s sole discretion, it reasonably believes that the entrant has attempted to undermine the legitimate operation of the CATS4ML Challenge by cheating, deception, or other unfair playing practices or annoys, abuses, threatens, or harasses any other entrants, Google, or the Raters.

9. INTELLECTUAL PROPERTY RIGHTS: As between Google and the entrant, the entrant retains ownership of all intellectual and industrial property rights (including moral rights) in and to any of the Testsets submitted as part of the CATS4ML Challenge. As a condition of entry, entrant grants Google, its subsidiaries, agents and partner companies, a perpetual, irrevocable, worldwide, royalty-free, and non-exclusive license to use, reproduce, adapt, modify, publish, distribute, publicly perform, create a derivative work from, and publicly display the data submitted for CATS4ML by entrant. Entrant acknowledges that Google may be developing substantially similar to the Testsets submitted by entrant.

10. PRIVACY: Entrants agree that personal data entered during the registration, including name, mailing address, phone number, and email address may be processed, stored, shared and otherwise used for the purposes and within the context of the CATS4ML Challenge. This data will also be transferred into the United States of America. By entering, entrants agree to the transmission, processing, sharing and storage of this personal data in the United States of America.

Entrants also understand that this data may be used by Google in order to verify an entrant’s identity, postal address and telephone number in the event an entry qualifies for an award. Entrants have the right to access, review, rectify or cancel any personal data held by Google in connection with the CATS4ML Challenge by writing to Google at the address listed above. If an entrant does not provide the data required at registration, that entrant’s entry will be ineligible. Otherwise, all personal information that is collected from the entrant is subject to Google’s Privacy Policy, located at http://www.google.com/policies/privacy/.

11. PUBLICITY: By winning the Challenge, entrant agrees and consents to Google and its agencies’ use of entrant’s Testset and name and/or likeness for a reasonable time after completion of the CATS4ML Challenge in promotional and advertising material of Google (or its agents) as an award recipient of the CATS4ML Challenge without additional compensation, unless prohibited by law.

12. WARRANTY AND INDEMNITY: Entrants warrant that their Testset is their own original work and, as such, they are the sole and exclusive owner and rights holder of the submitted Testset and that they have the right to submit the Testset in the CATS4ML Challenge and grant all required licenses. Each entrant agrees not to submit any Testset that (1) infringes any third party proprietary rights, intellectual property rights, industrial property rights, personal or moral rights or any other rights, including without limitation, copyright, trademark, patent, trade secret, privacy, publicity or confidentiality obligations; or (2) otherwise violates the applicable law.

Entrant warrants that entrant (i) will comply with applicable law in their Data Collection, (ii) will obtain user consent to the Data Collection and to the Data being shared with Google.

To the maximum extent permitted by law, each entrant indemnifies and agrees to keep indemnified Google at all times from and against any liability, claims, demands, losses, damages, costs and expenses resulting from any act, default or omission of the entrant and/or a breach of any warranty set forth herein.

13. ELIMINATION: Any false information provided within the context of the CATS4ML Challenge by any entrant concerning identity, email address, IP ownership or non-compliance with these Rules or the like may result in the immediate elimination of the entrant from the CATS4ML Challenge.

14. RIGHT TO CANCEL, MODIFY OR DISQUALIFY: If for any reason the CATS4ML Challenge is not capable of running as planned, Google reserves the right at its sole discretion to cancel, terminate, modify or suspend the CATS4ML Challenge.

15. NOT AN OFFER OR CONTRACT OF EMPLOYMENT: Under no circumstances shall the submission of an App or Data Evaluation to the CATS4ML Challenge, receipt of an award, or anything in these Rules be construed as an offer or contract of employment with Google.

16. FORUM AND RECOURSE TO JUDICIAL PROCEDURES: These Rules shall be governed by, subject to, and construed in accordance with the laws of the State of California, United States of America, excluding all conflict of law rules. If any provision(s) of these Rules are held to be invalid or unenforceable, all remaining provisions hereof will remain in full force and effect.

17. ARBITRATION: By entering the CATS4ML Challenge, you agree that exclusive jurisdiction for any dispute, claim, or demand related in any way to the CATS4ML Challenge will be decided by binding arbitration. All disputes between you and Google of whatsoever kind or nature arising out of these Rules shall be submitted to Judicial Arbitration and Mediation Services, Inc. (“JAMS”) for binding arbitration under its rules then in effect in the San Jose, California, USA area, before one arbitrator to be mutually agreed upon by both parties. The parties agree to share equally in the arbitration costs incurred.