Skip to content
This repository has been archived by the owner on Sep 2, 2022. It is now read-only.

Support batch scheduling for JobManager and TaskManager #257

Closed
hzxuzhonghu opened this issue Jun 1, 2020 · 4 comments · Fixed by #271
Closed

Support batch scheduling for JobManager and TaskManager #257

hzxuzhonghu opened this issue Jun 1, 2020 · 4 comments · Fixed by #271
Labels
feature #a2eeef

Comments

@hzxuzhonghu
Copy link
Contributor

hzxuzhonghu commented Jun 1, 2020 •
edited
Loading

In k8s, we may meet kinds of resource-limited scenarios. In this case, it's better not to run any components, because it is likely to be useless occupying cluster resources.

So I propose making use of Volcano to support gang-scheduling of all necessary managers. And currently, spark operator has already done this.
@hzxuzhonghu
Copy link
Contributor Author

@functicons

@functicons
Copy link
Collaborator

Sounds like a good feature request. I welcome your PR if you'd like to contribute.

@functicons functicons added the feature #a2eeef label Jun 1, 2020
@hzxuzhonghu
Copy link
Contributor Author

Yeah, thanks. I will file a pr ASAP.

@hzxuzhonghu
Copy link
Contributor Author

Just to update status, i meet a blocker as volcano depends on k8s 1.16. which has a conflict with 1.18.
Need to upgrade it there. And i filed an issue to track volcano-sh/volcano#849

@hzxuzhonghu hzxuzhonghu mentioned this issue Jun 18, 2020
Merged
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
feature #a2eeef
Projects
None yet
Milestone
No milestone
2 participants
@hzxuzhonghu @functicons