Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/558 transfer logging #590

Merged
merged 108 commits into from
Feb 3, 2024
Merged

Conversation

sashakames
Copy link
Collaborator

Description

Fixes # (issue)

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • Local Pre-commit Checks
  • CI/CD Build

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • My changes generate no new warnings
  • If applicable - I have commented my code, particularly in hard-to-understand areas
  • If applicable - I have made corresponding changes to the documentation
  • If applicable - I have added tests that prove my fix is effective or that my feature works
  • If applicable - New and existing unit tests pass locally with my changes
  • Any dependent changes have been merged and published in downstream modules

downiec and others added 30 commits September 22, 2022 18:22
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
* enable settings on the backend for urls

* add the settings for workflow

* add missing import

* add newline
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
…environment variables. Otherwise local build of backend will fail.
…ests. Removed unneccessary type checking in the import headers of the test models. Updated coverage for some files that didn't have 100% coverage. Updated some django dependencies after testing to make sure nothing broke. Updated some deprecated imports to remove warnings. Updated pytest and coverage libraries.
…h the application from users perspective was working fine)
…nges that came with react-router-dom v6. Tests are passing now.
* Refactored the joyrideTutorials in order to reduce the chances for errors with misspelling target names. Created unique target calssnames to simplify the process of adding and using targets. Removed the chance of duplicate target names causing errors etc. Added a test startup component that should show when first opening metagrid. Startup window still needs some work to improve visuals.

* Added a welcome and changelog template component to use with thh startup display. Made the startup display change based on existing version so that a new changelog will appear when version is changed. Modified the startup component behavior to hadle a welcome and changelog template based on whether its first-time startup or not.

* Updated django-all-auth to 0.54.0

* Upgraded the antd library to latest version. Updated components to work with the latests antd library and added some styling to correct some undesired changes. Added a temporary drawer component which can be opened by clicking a new message button in the top-right navbar. Fixed some styling issues with window resizing to make the top navbar work better with smaller windows and improve visual behavior. Removed redundant components that are no longer needed with the new antd library (which is now working with typescript well). Created a popup window that shows at the start for new users. Created a startup template system that allows different templates to be used for displaying popup messages. More fixed needed for tests and the welcome popup tutorials need work.

* Worked to correct issues with tests hanging by reverting back the antd library. Also updated to node version 18. Restored previously deleted files and will remove them later when all tests are passing. Still need to correct tests to pass. Still need to complete messaging feature and update tutorial.

* Updated tests so that they pass, coverage will still be needed.

* Updated the Startup template functionality and added actions that can be triggered by the templates. Updated the welcome message buttons to work properly and select between pages to start tutorials.

* Removed redundant and unneccessary components as they are now directly taken from antd library. Removed commented out import statements.

* Refactored some names and added messages for the right drawer. Added ability to create messages for the message bar and provide content from markdown files. Updated the changelog to have useful information on latest changes. Need to troubleshoot tests and complete coverage.

* Added markdown file support for the messages. Did refactoring so messages on the right drawer and popups will show the markdown. Created new markdown files with version info and example message. Added flexibility to popup so that styles can be modified on a per message basis. Modified the changelog template and types.

* Created a new welcome tour which will show users the help buttons to encourage them to use them if they have issues. Updated the navbar tour to include the new news button. Created new test files and updated tests to bring back 100% text coverage. Removed obsolete tour target related files, as they've been updated with target object class. Troubleshooted and ran tests to fix some bugs and added more functionality for jest tests. Deleted test markdown files and updated message markdown slightly.

* modify the messages for release (#522)

---------

Co-authored-by: Sasha Ames <sashakames@users.noreply.github.com>
* Refactored the joyrideTutorials in order to reduce the chances for errors with misspelling target names. Created unique target calssnames to simplify the process of adding and using targets. Removed the chance of duplicate target names causing errors etc. Added a test startup component that should show when first opening metagrid. Startup window still needs some work to improve visuals.

* Added a welcome and changelog template component to use with thh startup display. Made the startup display change based on existing version so that a new changelog will appear when version is changed. Modified the startup component behavior to hadle a welcome and changelog template based on whether its first-time startup or not.

* Updated django-all-auth to 0.54.0

* Upgraded the antd library to latest version. Updated components to work with the latests antd library and added some styling to correct some undesired changes. Added a temporary drawer component which can be opened by clicking a new message button in the top-right navbar. Fixed some styling issues with window resizing to make the top navbar work better with smaller windows and improve visual behavior. Removed redundant components that are no longer needed with the new antd library (which is now working with typescript well). Created a popup window that shows at the start for new users. Created a startup template system that allows different templates to be used for displaying popup messages. More fixed needed for tests and the welcome popup tutorials need work.

* Worked to correct issues with tests hanging by reverting back the antd library. Also updated to node version 18. Restored previously deleted files and will remove them later when all tests are passing. Still need to correct tests to pass. Still need to complete messaging feature and update tutorial.

* Updated tests so that they pass, coverage will still be needed.

* Updated the Startup template functionality and added actions that can be triggered by the templates. Updated the welcome message buttons to work properly and select between pages to start tutorials.

* Removed redundant and unneccessary components as they are now directly taken from antd library. Removed commented out import statements.

* Refactored some names and added messages for the right drawer. Added ability to create messages for the message bar and provide content from markdown files. Updated the changelog to have useful information on latest changes. Need to troubleshoot tests and complete coverage.

* Added markdown file support for the messages. Did refactoring so messages on the right drawer and popups will show the markdown. Created new markdown files with version info and example message. Added flexibility to popup so that styles can be modified on a per message basis. Modified the changelog template and types.

* Created a new welcome tour which will show users the help buttons to encourage them to use them if they have issues. Updated the navbar tour to include the new news button. Created new test files and updated tests to bring back 100% text coverage. Removed obsolete tour target related files, as they've been updated with target object class. Troubleshooted and ran tests to fix some bugs and added more functionality for jest tests. Deleted test markdown files and updated message markdown slightly.

* modify the messages for release (#522)

* Updated the node status information alert so that text displays if there is an api error.

* Updated Django to 4.1.9

* Fixed a test regarding the changes to the error message.

---------

Co-authored-by: Sasha Ames <sashakames@users.noreply.github.com>
…null items don't cause an error and prevent the site from displaying.
downiec and others added 10 commits September 29, 2023 17:10
…improved coverage by ignoring test functions and other unnecessary pieces of code from coverage calculations. Increased coverage threshold to 95%. Updated server handlers and created handlers for the load and save session storage functions (to improve testing and simulate backend storage using a mock local storage object). Updated some configuration and resolved issues related to server handlers not being used by some tests. Got more tests to pass, and increased overall coverage. Wrote some new tests so that api coverage is now at 100% and all api tests are passing. Still need to write tests for globus download functionality to bring coverage back to passing threshold.
…ated the test settings, removed unused server handler, modified the auth context for keycloak cverage (temporarily for tests are failing there). Added a new test file for the Tabs.tsx component, and provided full coverage. Created a new file and started test coverage for DatasetDownload.tsx (still needs more tests). Fixed 3 more App.tsx tests which were failing, so that they now pass. Coverage increased to nearly 80% overall.
…reated new tests for the datasetdownload component and more tests for other components to improve coverage. Did a refactoring of the datasetdownload component to make it easier to test and improve reliability.
…ts, created new fixtures for the tests as well as mock values for the tests. Coverage for the datasetDownload components has increased to nearly 60% overall
* First commit for keycloak and globus auth

* Updated keycloak-js to 19.0.3 and using login.esgf.io for localhost

* Updating yarn lock file with new version of keycloak

* Feature: add a choice for auth type at time of deployment

* Fixing up env files

* Moved Globus key and secret to env file

* Removed commented code

* Removed local keycloak container

* Updated wget URL

* Revert realm json file

* Updated and ran pre-commit

* Minor settings update

* Removed key and secret

* Black formatting

* Removing key/secret and updating keycloak URL

* Updating messaging and test setup

* Formatting
… as the auth provider. Created some tests and updated server-handlers etc. to acknowledge the new keycloak/globus auth options.
…e, whether it will pass or fail, and also added test for successful transfer scenario
@sashakames sashakames changed the base branch from master to v1.1.0 January 17, 2024 19:42
@codecov-commenter
Copy link

codecov-commenter commented Jan 17, 2024

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (644bbb1) 98.50% compared to head (12e997f) 98.54%.

Files Patch % Lines
frontend/src/components/Globus/DatasetDownload.tsx 33.33% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##           v1.1.0     #590      +/-   ##
==========================================
+ Coverage   98.50%   98.54%   +0.03%     
==========================================
  Files          76       76              
  Lines        2738     2744       +6     
  Branches      415      416       +1     
==========================================
+ Hits         2697     2704       +7     
+ Misses         41       40       -1     
Flag Coverage Δ
backend 100.00% <100.00%> (ø)
frontend 97.81% <75.00%> (+0.06%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@sashakames sashakames self-assigned this Jan 17, 2024
@sashakames sashakames marked this pull request as ready for review January 27, 2024 20:43
@sashakames
Copy link
Collaborator Author

The codecov/patch looks like a false-positive and the diff is out of whack, I wonder if against master not v1.1.0? So maybe we can merge if the changes look ok @downiec ?

@sashakames
Copy link
Collaborator Author

We reached a conclusion that the coverage issue was ok and should not prevent a merge, IIRC.

@sashakames sashakames merged commit ec78791 into v1.1.0 Feb 3, 2024
3 of 4 checks passed
@sashakames sashakames deleted the feature/558-transfer-logging branch February 5, 2024 17:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants