-
-
Notifications
You must be signed in to change notification settings - Fork 145
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dask Auto scaler failing to create #774
Comments
I've found out the issue is that the Dask Kubernetes Operator cannot find the scheduler on other namespaces, I had its pod working on the namespace |
Ah that makes sense, thanks for following up. We should handle these errors better and give the user some more useful guidance. In this situation we should probably put the |
@jacobtomlinson I am facing similar issue. I have installed dask-operator in different namespace and cluster, autoscaler in another namespace. Does this mean operator can not find the scheduler in different namespace to auto scale? How to resolve this issue? |
@chetankumar-patel-aera The cluster and autoscaler need to be in the same namespace. The operator can be installed anywhere as it watches all namespaces by default. |
@jacobtomlinson Thanks for your response. My dask cluster and autoscaler are in same namespace. While dask operator is in different. But I am still facing same issue. I tried with simple dask cluster mentioned in the documentation. But still getting same problem.
dask version: latest Error:
Can you please help with what could be issue? |
Can you try the latest release of dask-kubernetes? |
Ok. Will try with ghcr.io/dask/dask-kubernetes-operator:2023.8.0 version of dask-operator. Was there any fix related to this in this version? |
@jacobtomlinson It is working after updating to 2023.8.0. Thanks for your help |
I'm trying to setup a simple DaskAutoscaler on Kubernetes using YAML files, but somehow the auto scaler failes to be created with the following error
The autoscaler.yaml file that I am using is this one
the cluster YAML definition is as follow
Environment:
The text was updated successfully, but these errors were encountered: