Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NASA is working on a similar extension (S3A+) #85

Open
rabernat opened this issue Jul 21, 2022 · 4 comments
Open

NASA is working on a similar extension (S3A+) #85

rabernat opened this issue Jul 21, 2022 · 4 comments
Assignees
Labels
bug Something isn't working

Comments

@rabernat
Copy link
Contributor

At the ESIP2022 meeting, I learned that NASA is developing a new S3 Jupyterlab Extension with the following features

S3A+ or S3 Actions Plus is a Jupyterlab extension that allow you to use a ui on your Notebook to:

  • Show a list of available datasets in your notebook )for now we only support datasets in AWS buckets)
  • Connect to any S3 bucket or key that you have access to (By connect I mean adding them to the list of buckets that you can browse and do S3A+ actions)
  • Browse and connect to Public DataSets (We support AWS Public Datasets currently)
  • Right click on buckets or dataset and mount them to your file-system on the notebook with Goofy's
  • Right click on a dataset and add an event driven action (event likes new file upload to the dataset, file deleted, etc. For instance turn a zarr dataset into a COG whenever a new zarr is uploaded)
    We are are realizing the first version of this Jlab extension soon and are hoping to make it Open Source ASAP

Tagging @rezuma for potential collaboration points with this project.

@rabernat rabernat added the bug Something isn't working label Jul 21, 2022
@rabernat rabernat changed the title NASA is working on NASA is working on a similar extension Jul 21, 2022
@rabernat rabernat changed the title NASA is working on a similar extension NASA is working on a similar extension (S3A+) Jul 21, 2022
@rezuma
Copy link

rezuma commented Dec 13, 2022

@rabernat We built a complete new extension that fits better with our requirements
The goal is to make it open source, soon, hopefully before the end of January 23
The first version would allow you to:

  • Browse and upload/download files and "folders" from buckets that are accessible from the server where the Notebook is running. For example. Buckets on the same AWS account where the notebook is, buckets from other AWS accounts (Cross account access)
  • It would also be possible to access public datasets from the different cloud providers AWS, GCP and Azure
  • There would be a favourites tab where you can add most frequently access datasets
    ....
    You can see a video example here
    https://www.youtube.com/watch?v=Lo7P5wvcOeg

We welcome feedback and are willing to demo this jlab extensions and others that are part of the Open Science Studio platform (API Baker, AI PLatform Support, NLP for each notebooks, etc)
Open Science Studio platform and all its extensions will be open source too.
You can reach me at rlinan@navteca.com

@octavd
Copy link

octavd commented Jan 13, 2023

hello @rabernat @rezuma looking forward for this release. Good luck with it. :)

@octavd
Copy link

octavd commented Feb 2, 2023

Hello @rezuma , any news regarding this new extension?

@rezuma
Copy link

rezuma commented Feb 24, 2023

@octavd @rabernat We made the extension open source
bexplorer (to interact with AWS S3 buckets, public datasets and cross account buckets, in the future we hope to add support for Azure Blob and Google bucket)
https://github.com/Navteca/jupyterlab-bxplorer

We also made open source Pasarela, a server side extension that allow to launch a notebook from any external web app.
It creates an API on the Jhub server, and you can pass a full notebook to be opened or just some specific code that will get opened in the first cell.
https://github.com/Navteca/oss-pasarela

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants