Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ML correction on CPU and GPU #2909

Closed
wants to merge 46 commits into from
Closed

ML correction on CPU and GPU #2909

wants to merge 46 commits into from

Commits on Feb 26, 2024

  1. Working cupy w/ CUDA, no device handoff

    @frodre
    frodre committed Feb 26, 2024
    Configuration menu
    Copy the full SHA
    436db6a View commit details
    Browse the repository at this point in the history

Commits on Feb 29, 2024

  1. Leaving off investigation of checking on-device array values

    @frodre
    frodre committed Feb 29, 2024
    Configuration menu
    Copy the full SHA
    0061d50 View commit details
    Browse the repository at this point in the history

Commits on Mar 12, 2024

  1. Working GPU handoff with unit test

    @frodre
    frodre committed Mar 12, 2024
    Configuration menu
    Copy the full SHA
    7e87de6 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Update to 3 distinct tests

    @frodre
    frodre committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    6c81f11 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into test-master

    @frodre
    frodre committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    6b98cc2 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Working GPU SCREAM run

    @frodre
    frodre committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    f543529 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Add python timer

    @frodre
    frodre committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    950d508 View commit details
    Browse the repository at this point in the history

  2. Remove extra field views from old CPU code

    @frodre
    frodre committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    d15506a View commit details
    Browse the repository at this point in the history

  3. Fix missing dev variables

    @frodre
    frodre committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    dc9f31a View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. Add manual timing

    @frodre
    frodre committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    e4740c6 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. Merge branch 'master' into test-cupy-merge

    @frodre
    frodre committed May 13, 2024
    Configuration menu
    Copy the full SHA
    ec13906 View commit details
    Browse the repository at this point in the history

  2. Fixing standalone tests after updates WIP

    @frodre
    frodre committed May 13, 2024
    Configuration menu
    Copy the full SHA
    3a7efd6 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Working build without surface precip correction

    @frodre
    frodre committed May 14, 2024
    Configuration menu
    Copy the full SHA
    0678bca View commit details
    Browse the repository at this point in the history

Commits on Jun 3, 2024

  1. Merge branch 'master' into feature/scream-ml-gpu-only

    @frodre
    frodre committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    205ee37 View commit details
    Browse the repository at this point in the history

  2. Fix conflict

    @frodre
    frodre committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    f03d35f View commit details
    Browse the repository at this point in the history

  3. Update radiation for basic all radiation prediction

    @frodre
    frodre committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    32197da View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/scream-ml-gpu-only' into cupy-testing

    @frodre
    frodre committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    f0fa825 View commit details
    Browse the repository at this point in the history

  5. Switch python to local 3.8

    @frodre
    frodre committed Jun 3, 2024
    Configuration menu
    Copy the full SHA
    b4d7445 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. Add cudnn to modules for GPU prediction tensorflow

    @frodre
    frodre committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    e9dd96b View commit details
    Browse the repository at this point in the history

  2. Fix radiation field addition to interface and remove precip adjustment

    @frodre
    frodre committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    189f0f3 View commit details
    Browse the repository at this point in the history

  3. Revert "Switch python to local 3.8" 

    This reverts commit b4d7445.
    @frodre
    frodre committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    fcb5ee3 View commit details
    Browse the repository at this point in the history

  4. ASD - Fix bug w/ precip adjustment on gpu 

    This commit fixes issues with the implementation of precipitation
adjustment in ML when running on GPU's.

Additionally this commit turns on property checks
to ensure that ML cannot produce an unrealistic state.
    @AaronDonahue
    AaronDonahue committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    2c14deb View commit details
    Browse the repository at this point in the history

  5. Revert "Revert "Switch python to local 3.8"" 

    This reverts commit fcb5ee3.
    @frodre
    frodre committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    0f66076 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. fix bug in precip adj in ML

    @AaronDonahue
    AaronDonahue committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    38312be View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. Merge branch 'feature/scream-ml-gpu-only' into cupy-testing

    @frodre
    frodre committed Jun 6, 2024
    Configuration menu
    Copy the full SHA
    473dc19 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. option to do ML correction on T alone

    @elynnwu
    elynnwu committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    991b58b View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. move model checks to python

    @elynnwu
    elynnwu committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    f7e5763 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #2870 from E3SM-Project/scream-ml-t-only-option 

    Option to do ML correction on temperature only
    @elynnwu
    elynnwu authored Jun 20, 2024
    Configuration menu
    Copy the full SHA
    9644741 View commit details
    Browse the repository at this point in the history

  3. fix minor bug in unit test

    @elynnwu
    elynnwu committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    26a5d6b View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. WARNING: test-all-scream backup commit

    @elynnwu
    elynnwu committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    68a84d6 View commit details
    Browse the repository at this point in the history

  2. Automatic merge of origin/master

    @elynnwu
    elynnwu committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    99ecd61 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. SW down and NIR/VIS fractions

    @frodre
    frodre committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    1b134f1 View commit details
    Browse the repository at this point in the history

  2. Add test file

    @frodre
    frodre committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    5b4eac2 View commit details
    Browse the repository at this point in the history

  3. Switch to transmissivity use

    @frodre
    frodre committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    80ce6b3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'feature/scream-ml-gpu-only' of https://github.com/E3SM-… 

    …Project/scream into feature/scream-ml-gpu-only
    @frodre
    frodre committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    d1a949c View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. ml cpu and gpu unit test working

    @elynnwu
    elynnwu committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    1a291f3 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. Updates to include surface flux radiation components

    @frodre
    frodre committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    9c097a2 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2024

  1. Merge branch 'feature/scream-ml-gpu-only' of https://github.com/E3SM-… 

    …Project/scream into feature/scream-ml-gpu-only
    @frodre
    frodre committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    1784c2d View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2024

  1. ML correction full run works on gpu and cpu

    @elynnwu
    elynnwu committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    f08548f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'feature/scream-ml-gpu-only' of github.com:E3SM-Project/… 

    …scream into feature/scream-ml-gpu-only
    @elynnwu
    elynnwu committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    5fb8efd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into feature/scream-ml-gpu-only

    @elynnwu
    elynnwu committed Jul 18, 2024
    Configuration menu
    Copy the full SHA
    d65ee59 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2024

  1. add ML specific flags for running on pm-gpu

    @elynnwu
    elynnwu committed Jul 23, 2024
    Configuration menu
    Copy the full SHA
    68fb14a View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2024

  1. remove ML speciifc setting and add doc

    @elynnwu
    elynnwu committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    7d05c3a View commit details
    Browse the repository at this point in the history

  2. lint

    @elynnwu
    elynnwu committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    1842bb0 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. cmake cleanup

    @elynnwu
    elynnwu committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    9119ad9 View commit details
    Browse the repository at this point in the history

  2. more cmake cleanup

    @elynnwu
    elynnwu committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    40e0fd5 View commit details
    Browse the repository at this point in the history