-
Notifications
You must be signed in to change notification settings - Fork 64
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Change dbname declaration in spark.catalog.exists #861
base: 0720_release
Are you sure you want to change the base?
Conversation
* initial commit * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Change Scala Sources Name * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Added Initializerv2.scala * Added Initializerv2.scala * Changed as per Sriram comment * Changed as per Sriram comment * dropped Initializer Deprecated --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com> Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com> Co-authored-by: Daniel Tomes <10840635+GeekSheikh@users.noreply.github.com>
* initial commit * Refractor Initializer (#683) * initial commit * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Change Scala Sources Name * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Added Initializerv2.scala * Added Initializerv2.scala * Changed as per Sriram comment * Changed as per Sriram comment * dropped Initializer Deprecated --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com> Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com> Co-authored-by: Daniel Tomes <10840635+GeekSheikh@users.noreply.github.com> * Change Job Trigger type to Triggered * Change Job Trigger type to Triggered * Change Job Trigger type to Triggered --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com> Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com> Co-authored-by: Daniel Tomes <10840635+GeekSheikh@users.noreply.github.com>
* initial commit * Refractor Initializer (#683) * initial commit * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Change Scala Sources Name * Refractor InitializerFunctions.scala * Refractor InitializerFunctions.scala * Added Initializerv2.scala * Added Initializerv2.scala * Changed as per Sriram comment * Changed as per Sriram comment * dropped Initializer Deprecated --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com> Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com> Co-authored-by: Daniel Tomes <10840635+GeekSheikh@users.noreply.github.com> * gcp integration added * gcp integration added * minor updates from daniel * review comment implemented --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com> Co-authored-by: Sourav Banerjee <109206082+souravbaner-da@users.noreply.github.com> Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com> Co-authored-by: Daniel Tomes <10840635+GeekSheikh@users.noreply.github.com>
* conde changes completed * column name changed from etl_storage_prefix to storage prefix --------- Co-authored-by: geeksheikh <geeksheikh@users.noreply.github.com>
…er. (#679) Co-authored-by: Carson Wilkins <carson.wilkins@databricks.com>
* code changes completed * code changes completed * code changes completed * code changes completed
* initial 0713 commit * handled null AccumUpates
Co-authored-by: Sourav Banerjee <30810740+Sourav692@users.noreply.github.com>
You have successfully added a new SonarCloud configuration ``. As part of the setup process, we have scanned this repository and found no existing alerts. In the future, you will see all code scanning alerts on the repository Security tab. |
@souravbaner-da -- test is failing overwatch/src/test/scala/com/databricks/labs/overwatch/pipeline/InitializeTest.scala Lines 39 to 53 in 5337cad
overwatch/src/test/scala/com/databricks/labs/overwatch/pipeline/InitializeTest.scala Lines 239 to 247 in 5337cad
|
Kudos, SonarCloud Quality Gate passed! 0 Bugs No Coverage information |
Currently this issue will be on hold. As the suggested solution depend on spark version. Specifically from spark version 3.3.0 the solution is working fine and for all other version the solution is failing. For now in overwatch public doc we will mention that database name in config should not contain any special character. Corresponding PR for the documentation is |
8c9721c
to
f744073
Compare
Currently this PR is on hold. Will start working on this after we are done with below issue #858 |
Close #858