News - Document UnderstanDing of Everything 😎
02/28/2023DUDE - Updated submission schedule
Dear participants,
Following inquiries regarding the submission schedule, we have opted to better align the submissions for evaluation phase 1 (test set for Task 1) and for evaluation phase 2 (domain shift and selective question-answering).
We hope that this renewed schedule gives participants more clarity and time to work on their submissions (3 weeks, 1 week for method description) for either evaluation phase. We would urge participants to submit method descriptions (just a couple of paragraphs to understand the overall idea) together with their submissions as the competition report deadline is strict. We would not want to disqualify any team for not providing their method description in time.
When giving participants access to questions from the test set, we will provide a mixture of the questions from evaluation phase 1 and phase 2.
Submissions for phase 1 would need to only provide the answers key and preferably answers_confidence for calibration evaluation.
Submissions for phase 2 would need to as well provide both the keys answers_confidence and answers_abstain for all question-answer pairs.
Cheers,
The DUDEs
Challenge News
- 03/27/2023
DUDE - Extended Submission Deadline - 03/20/2023
DUDE - submission instructions - 03/09/2023
DUDE - Test Set Available - 02/28/2023
DUDE - Updated submission schedule - 02/19/2023
DUDE - GitHub Repository for discussions - 02/17/2023
Updated training/validation set - 01/31/2023
DUDE: RRC submission system being upgraded - 01/30/2023
Training/validation dataset available
Important Dates
Registration open: Christmas 2022
Competition Q&A period: 20 December - 10 January
Sample dataset available: 6 January 2023
Training/validation dataset available: 30 January 2023
Test set submissions open (Task 1 & evaluation phase2): 9 March 2023
General submission deadline: 20 April 2023
Method description submissions deadline: 20 April 2023
Notification to authors: 1 May 2023
All dates are 23:59 AoE and subject to change.
Note on the registration for the DUDE challenge:
There is no need to register explicitly for the DUDE challenge. As long as you are registered to the RRC portal you will be able to submit your results when the submission is open.
Any questions, contact the DUDEs at duchallenge.icdar2023@gmail.com