About dpdispatcher

generate HPC scheduler systems jobs input scripts and submit these scripts to HPC systems and poke until they finish

d

Published by

README.md

DPDispatcher

DPDispatcher is a Python package used to generate HPC (High-Performance Computing) scheduler systems (Slurm/PBS/LSF/Bohrium) jobs input scripts, submit them to HPC systems, and poke until they finish.

DPDispatcher will monitor (poke) until these jobs finish and download the results files (if these jobs are running on remote systems connected by SSH).

For more information, check the documentation.

Credits

Please cite the following paper if you use this project in your work:

Fengbo Yuan, Zhaohan Ding, Yun-Pei Liu, Kai Cao, Jiahao Fan, Cao Thang Nguyen, Yuzhi Zhang, Haidi Wang, Yixiao Chen, Jiameng Huang, Tongqi Wen, Mingkang Liu, Yifan Li, Yong-Bin Zhuang, Hao Yu, Ping Tuo, Yaotang Zhang, Yibo Wang, Linfeng Zhang, Han Wang, Jinzhe Zeng, DPDispatcher: Scalable HPC Task Scheduling for AI-Driven Science, J. Chem. Inf. Model., 2025, DOI: 10.1021/acs.jcim.5c02081.

This project was separated out from the DP-GEN project (Section 3.3 in its paper) to be used by more workflow software.

Installation

DPDispatcher can be installed by pip:

pip install dpdispatcher

To add Bohrium support, execute

pip install dpdispatcher[bohrium]

Usage

See Getting Started for usage.

Contributing

DPDispatcher is maintained by DeepModeling's developers and welcomes other people. See Contributing Guide to become a contributor! 🤓

dpdispatcher