n/a scores on leaderboard if Submission Rule is Force Last

[ktgiahieu]

Hi,

I noticed that if the competition has 2 tasks, and the Submission Rule is Force Last:

• If you submit a solution to both tasks and wait for it to finish: everything works fine
• If you submit a solution to both tasks but then submit another one before the first submission finish: there will be a n/a score for the task that finish after (although the submission's ingestion and scoring program run successfully).

Here is our competition: https://www.codabench.org/competitions/1145/

An example of the error is submission ID: 15757, which is submitted only 10min after submission ID: 15736. (so the first submission is not finished when the second submission is submitted).

An example of a successful submission is submission ID 15796, which is submitted 2 hrs after submission ID 15793 (so the first submission is finished already).

[ihsaan-ullah]

Possibly connected with

• Only last task's score is visible #1022

[ktgiahieu]

Hi guys,

Thank you for your latest update of the competition's UI and submission count. It looks great.

May I ask if we have any plans for this "n/a scores" bug?

[Didayolo]

I close this issue to merge and keep track of it here: #1540.