You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In our courses (and thus assignments) we use the popular tidyverse metapackage quite heavily, and have done so quite successfully with otter-grader for the past two years. This fall however, our tests largely fail in the autograder on Gradescope (but not our our laptops when we create the assignments) when we load packages via the tidyverse metapackage. If we instead however, load the packages directly (so instead of library(tidyverse), we write library(readr); library(dplyr); library(tidyr), then the tests all pass in the autograder on Gradescope. Interestingly this seems to be important just for the students submission - not the source assignment itself.
Example Rmd snippet of source Rmds and needed data for tests that work (direct pacakage loading) with the autograder on Gradescope and fail (indirect package loading through the tidyverse):
I am working on an M2 Mac, running otter-grader version 5.1.3 (installed via pip) and ottr version 1.1.3. To create the assignments I run otter assign <SOURCE-RMD> <FOLDER-DESTINSTION>.
The text was updated successfully, but these errors were encountered:
Interestingly it doesn't seem to be all the packages loaded by tidyverse. For example, I think ggplot2 loads fine via tidyverse? It's one (or more) of the three listed above that seem to be the issue...
Can you use Gradescope's debug via SSH feature to SSH into a container that is experiencing this issue and run Otter in debug mode and send the output? To run in debug mode, you add "debug": true to /autograder/source/otter_config.json and then run the /autograder/run_autograder executable.
I tried this with an instructor submission (via the "test autograder" button) and it works for me with ipynb files at least. I don't know if actual student submissions (but the "instructor as student" submission is usually the same for me) or Rmd files behave differently
In our courses (and thus assignments) we use the popular
tidyverse
metapackage quite heavily, and have done so quite successfully with otter-grader for the past two years. This fall however, our tests largely fail in the autograder on Gradescope (but not our our laptops when we create the assignments) when we load packages via thetidyverse
metapackage. If we instead however, load the packages directly (so instead oflibrary(tidyverse)
, we writelibrary(readr); library(dplyr); library(tidyr)
, then the tests all pass in the autograder on Gradescope. Interestingly this seems to be important just for the students submission - not the source assignment itself.Example Rmd snippet of source Rmds and needed data for tests that work (direct pacakage loading) with the autograder on Gradescope and fail (indirect package loading through the tidyverse):
worksheet1works-snippet.zip
worksheet1fails-snippet.zip
I am working on an M2 Mac, running otter-grader version 5.1.3 (installed via
pip
) andottr
version 1.1.3. To create the assignments I runotter assign <SOURCE-RMD> <FOLDER-DESTINSTION>
.The text was updated successfully, but these errors were encountered: