Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Connect to S3 with AWS access key and secret for duckdb #919

Merged

Conversation

wcchang1115
Copy link
Contributor

@wcchang1115 wcchang1115 commented Oct 27, 2023

PR checklist

  • Ensure you have added or ran the appropriate tests for your PR.
  • DCO signed

What type of PR is this?
feature

What this PR does / why we need it:

  • feed s3 configuration to duckdb engine and connect to S3 to read Parquet files using an AWS access key and secret

Which issue(s) this PR fixes:
sc-32497

Special notes for your reviewer:

Does this PR introduce a user-facing change?:

NONE

Signed-off-by: Wei-Chun, Chang <wcchang@infuseai.io>
@codecov
Copy link

codecov bot commented Oct 27, 2023

Codecov Report

Merging #919 (1622038) into main (a53e770) will increase coverage by 0.00%.
The diff coverage is 33.33%.

@@           Coverage Diff           @@
##             main     #919   +/-   ##
=======================================
  Coverage   47.99%   47.99%           
=======================================
  Files          78       78           
  Lines       10756    10759    +3     
=======================================
+ Hits         5162     5164    +2     
- Misses       5594     5595    +1     
Files Coverage Δ
piperider_cli/datasource/duckdb.py 27.94% <33.33%> (+0.08%) ⬆️

... and 1 file with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@wcchang1115 wcchang1115 marked this pull request as ready for review October 27, 2023 07:36
@popcornylu popcornylu merged commit c5574a0 into main Oct 30, 2023
30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants