-
Notifications
You must be signed in to change notification settings - Fork 10
Pull requests: AlibabaPAI/llumnix
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[Core] Use ray queue to put request output tokens back to the api server
#41
opened Sep 20, 2024 by
KuilongCui
Loading…
[Misc] Ensure Llumlet Main Thread Exits on Engine.Step Errors
#38
opened Sep 13, 2024 by
KuilongCui
Loading…
[Core][Migration] Support waiting request and multiple requests migration
#36
opened Sep 13, 2024 by
s5u13b
Loading…
[Core] Support for Scheduling-defined Prefill-Decode Disaggregation feature
#15
opened Aug 23, 2024 by
Xinyi-ECNU
Loading…
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.