Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Requesting processes very slow #62

Closed
m-mohr opened this issue Apr 8, 2021 · 9 comments
Closed

Requesting processes very slow #62

m-mohr opened this issue Apr 8, 2021 · 9 comments

Comments

@m-mohr
Copy link
Member

m-mohr commented Apr 8, 2021

Connecting to the VITO back-end is very slow right now.
For me, it takes around 1,5 minutes until the /processes endpoint has fully returned the data.
This is rather annoying, especially in the Web Editor where the processes are requested upfront.

I guess this is due to the mask_scl_dilation being so large? Maybe it would be a good idea to not return the "process_graph" property for pre-defined processes, where this is not very useful anyway.

@jdries
Copy link
Contributor

jdries commented Apr 8, 2021

Right now it's very fast for me, loads in seconds.
Could also have been server load. Can you try again?

@m-mohr
Copy link
Member Author

m-mohr commented Apr 8, 2021

This is a recurring issue I have for a couple of days (could also been weeks) already, so I'm not having the issue for the first time. It's also still slow right now. Could be that it's a load issue, but then you seem to struggle load issues pretty often?

I've tried only Web. Not sure, maybe it's also not an issue with Python? But at least it also seems slow in the QGIS plugin (but there I have no chance to check what is slow.)

@m-mohr
Copy link
Member Author

m-mohr commented Apr 8, 2021

@jdries How quick is getting to the Model Builder with this URL https://editor.openeo.org/?server=https://openeo.vito.be&discover=1 for you?

@soxofaan
Copy link
Member

soxofaan commented Apr 8, 2021

For me it's also pretty fast. /processes requests are typically between 0.5 and 1 second

loading that openeo editor page was also pretty fast, the /processes endpoint is indeed the slowest, but not problematic:

Screenshot from 2021-04-08 17-27-01

@m-mohr
Copy link
Member Author

m-mohr commented Apr 8, 2021

Hmm, is it then that my connection is too slow? I've tested it on DSL and my mobile connection and both are slow. Strange...

Anyway, maybe it's still a good idea to remove process graphs from pre-defined processes to make initial requests faster? 1 MB for initial discovery seems not ideal.

@m-mohr
Copy link
Member Author

m-mohr commented Apr 8, 2021

But then the 1.1 MB GEE collections transfer in under a second. Something strange is going on for sure... Are you somehow directly connected to VITO? VPN? Maybe it's just an issue for externals?

@soxofaan
Copy link
Member

soxofaan commented Apr 8, 2021

With or without our VITO VPN doesn't make a difference.

I also tried with https://www.webpagetest.org to test speed from other locations, and it's bit slower (e.g. 2 or 3 seconds from the US), but it's still order of seconds

@soxofaan soxofaan transferred this issue from Open-EO/openeo-python-client Apr 8, 2021
@soxofaan
Copy link
Member

soxofaan commented Apr 8, 2021

Anyway, maybe it's still a good idea to remove process graphs from pre-defined processes to make initial requests faster?

that's certainly possible (e.g. by default), but there is not standardized way to get the process graph if you want it.
For example with collections you have the "basic metadata" (all collections listing) and "full metadata" (single collection) views, but for pre-defined processes there is only one view: the "all processes" listing.

@m-mohr
Copy link
Member Author

m-mohr commented Apr 13, 2021

While that is true, for pre-defined processes the use cases where you'd need the process graph seem very limited. With Open-EO/openeo-api#348 you'd get such an endpoint to get the full process description.

Anyway, I've tested connecting to VITO via the university VPN and there it's much faster (like 2 secs). That's not fast, but okay.
I'm really puzzled what makes the request so slow through my internet provider (Telekom) while it works with the same connection just tunneled through a VPN. So speed can't be the issue. Strange...

@m-mohr m-mohr closed this as completed Apr 13, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants