Traditional flexible job shop scheduling problems mainly center on machine flexibility. In real manufacturing systems, workers operate machines with multiple skill levels, resulting in different processing times for jobs. Rationalizing worker scheduling is crucial to improving workshop productivity. Additionally, unexpected dynamic events will disrupt the continuity of production and raise costs. To address these challenges, the focus of the paper is a dynamic flexible job shop scheduling problem considering multi-skilled worker constraints (DFJSPW) with new job insertions. We propose an end-to-end deep reinforcement learning (DRL) approach that learns a combination of scheduling policies, including job sequencing, machine selection, and worker assignment, which can directly and sequentially output the scheduling results of each scheduling object at each decision point. States covering all scheduling resources are extracted, and a graph neural network (GNN) is utilized to encode the graph features of job processing. Furthermore, we construct a three-stage decision model, updating the network parameters via proximal policy optimization (PPO). Experiments are conducted on 27 diverse scenarios with randomly generated instances. The outcomes reveal that our approach notably surpasses existing scheduling methods in both solution runtime and quality. Moreover, the trained decision model maintains superior solution performance and strong generalization on the modified benchmark and dynamic instances.
Yi, Zenghui, Deng, Kaidan, Lei, Yong et al. An end-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problem considering multi-skilled worker constraints. // Journal of Intelligent Manufacturing. – 2026. – DOI: 10.1007/s10845-025-02784-1. – URL: http://link.springer.com/openurl/fulltext?id=doi:10.1007/s10845-025-02784-1
Yi, Zenghui, Deng, Kaidan, Lei, Yong, Zhang, Jingxing, Lu, Liuran, Deng, & Qianwang (2026). An end-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problem considering multi-skilled worker constraints. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-025-02784-1
Yi, et al. “An end-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problem considering multi-skilled worker constraints.” Journal of Intelligent Manufacturing, 2026. doi:10.1007/s10845-025-02784-1.
@article{Yi2026,
title = {An end-to-end deep reinforcement learning method for dynamic flexible job shop scheduling problem considering multi-skilled worker constraints},
author = {Yi and Zenghui and Deng and Kaidan and Lei and Yong and Zhang and Jingxing and Lu and Liuran and Deng and Qianwang},
journal = {Journal of Intelligent Manufacturing},
year = {2026},
doi = {10.1007/s10845-025-02784-1},
url = {http://link.springer.com/openurl/fulltext?id=doi:10.1007/s10845-025-02784-1}
}
Despite their widespread adoption in manufacturing, industrial robots remain constrained by the ‘Six Losses’, leading to significant inefficiencies throughout production processes. To address this challenge, this study proposes and...
This paper reviews the current applications of artificial intelligence (AI) and machine learning (ML) techniques in industrial manufacturing processes. It provides a comprehensive overview of the three main learning paradigms,...
Abstract This study proposes a novel framework that integrates causal regularization into hybrid Graph Attention Network and Long Short-Term Memory models for supply chain demand forecasting. We incorporate causal structures discovered...
Industrial defect detection in complex environments faces difficulties due to background clutter and varied defect morphologies, which complicate precise segmentation. To address this, we propose the Curvature Pyramid Vision Graph...
The dynamic variation of spindle thermal error has a significant impact on the overall machining accuracy of machine tools. Therefore, effective compensation and control of thermal error are essential. However, existing systems still...