Skip to content

Extensible Task Queue + Workers implementation for zerorpc

License

Notifications You must be signed in to change notification settings

vrnmthr/zerorpc-taskq

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

zerorpc-taskq

A zerorpc task queue + workers implementation:

Use this if you would like to:

  • run a zerorpc server with multiple workers for CPU-based parallelism
  • easily change the number of workers used
  • be able to throttle/prioritize/assign tasks with a queue
  • cancel any tasks easily (even those that have already started)

Quickstart

pip3 install -r requirements.txt
python3 server.py

# start a long process with pid 1
python3 client.py 1 --long
# start a short process with pid 2
python3 client.py 2
# cancel the long process
python3 client.py 1 --cancel

The server automatically starts and maintains its workers. See client.py for details on how to use the client.

This project is not yet fully threadsafe; work is ongoing in order to ensure this.

About

Extensible Task Queue + Workers implementation for zerorpc

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages