Skip to content

Commit

Permalink
Download fewer datasets for C/C++ unit tests (#4624)
Browse files Browse the repository at this point in the history
C++ unit tests don't currently require all of the test data that is currently downloaded.

Added a new file in s3 that contains the files used for C++ unit tests.

Authors:
  - Chuck Hastings (https://github.com/ChuckHastings)

Approvers:
  - Rick Ratzel (https://github.com/rlratzel)
  - Bradley Dice (https://github.com/bdice)

URL: #4624
  • Loading branch information
ChuckHastings authored Sep 3, 2024
1 parent 338e5e0 commit 52c4457
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 1 deletion.
2 changes: 1 addition & 1 deletion ci/test_cpp.sh
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ nvidia-smi
# RAPIDS_DATASET_ROOT_DIR is used by test scripts
export RAPIDS_DATASET_ROOT_DIR="$(realpath datasets)"
pushd "${RAPIDS_DATASET_ROOT_DIR}"
./get_test_data.sh --subset
./get_test_data.sh --cpp_ci_subset
popd

export GTEST_OUTPUT=xml:${RAPIDS_TESTS_DIR}/
Expand Down
8 changes: 8 additions & 0 deletions datasets/get_test_data.sh
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,12 @@ cd "$( cd "$( dirname "$(realpath -m "${BASH_SOURCE[0]}")" )" && pwd )";
#
# FIXME: some test data needs to be extracted to "benchmarks", which is
# confusing now that there's dedicated datasets for benchmarks.
CPP_CI_DATASET_DATA="
# ~10s download
https://data.rapids.ai/cugraph/test/cpp_ci_datasets.tgz
test
"

BASE_DATASET_DATA="
# ~22s download
https://data.rapids.ai/cugraph/test/datasets.tgz
Expand Down Expand Up @@ -89,6 +95,8 @@ if hasArg "--benchmark"; then
DATASET_DATA="${BENCHMARK_DATASET_DATA}"
elif hasArg "--subset"; then
DATASET_DATA="${BASE_DATASET_DATA}"
elif hasArg "--cpp_ci_subset"; then
DATASET_DATA="${CPP_CI_DATASET_DATA}"
elif hasArg "--self_loops"; then
DATASET_DATA="${SELF_LOOPS_DATASET_DATA}"
# Do not include benchmark datasets by default - too big
Expand Down

0 comments on commit 52c4457

Please sign in to comment.