Skip to content

Task & Dataset Management

ObadaS edited this page Sep 4, 2024 · 8 revisions

Overview

This page is where you will create, edit, and manage tasks, datasets, programs and submissions. Datasets that have been created by bundle upload can be show here as well.

You can access this interface by clicking on "Resources" in the top right corner:

Capture d’écran 2023-09-03 à 18 30 38

For a general breakdown of the roles of different types of datasets, see this link: Competition Bundle Structure: Data types and their role.

Here is an overview of the interface:

Capture d’écran 2023-09-03 à 18 32 36

Note that there are three tabs: "submissions", "datasets and programs" and "tasks".

Show Auto Created

When checked, this checkbox enables displaying datasets that were made through processing competition bundles, and other methods besides using the site's form interfaces.

Show Public

This will enable showing all objects marked as public.

Add Dataset/Program

image

Clicking the "Add Dataset/Program" button will bring up the above modal/form used to create (or edit) datasets. The following fields are available:

  • Name: The name for your dataset
  • Description: The description for your dataset
  • Type: The type of the dataset
  • File: A zip archive containing your dataset

Add Task

image image

Clicking the "Add Task" button will bring up the above modal/form used to create (or edit) datasets. The following fields are available under the first tab "Details":

  • Name: The name for your task
  • Description: The description for your task

More fields are available under the dataset section:

  • Scoring Program: A text input field to search for a scoring program by name
  • Ingestion Program: A text input field to search for an ingestion program by name
  • Reference Data: A text input field to search for a reference data by name
  • Input Data: A text input field to search for an input data by name

Edit Task

Capture d’écran 2024-04-20 à 15 28 03

If you wish to change the scoring program, ingestion program, input data, reference data or starting kit of a task, you can edit it. Use the edit button, select a previously uploaded program or data, and save the changes. The change will be reflected instantly on competitions/benchmarks using the task.

Delete Button

Capture d’écran 2024-04-20 à 15 27 57

Used to delete a task or a dataset. There is a confirmation dialogue.

Pagination

Used to move between different pages of the table.

Clone this wiki locally