2022年强化学习求解调度问题文章大汇总

2023年开工的第一篇文章，给大家带来2022年基于强化学习求解调度的文章汇总。在读博期间研究的也是这个方向，所以平时也一直在关注着相关动态，今天分享出来供大家参考，文章原文关注公众号（智能制造与智能调度）后回复“DRL调度”获取。

从1995年最早将强化学习用于车间调度问题后，在随后的几年里，强化学习一直不温不火，最主要的原因是一般的强化学习无法解决状态空间爆炸的问题，直到2018年深度强化学习开始进军调度领域，并在随后的几年里爆发式增长。尤其是在2022年，更是惊人地出现了至少68篇相关文章，可见这个方向的火热。一方面深度强化学习确实利用深度学习领域技术实现了未知状态下行为的预测，另一方面车间调度一直是悬而未决的经典问题，也是检验包括深度强化学习在内的各种算法的测试床。

清单

[1] Bai Y, Lv Y. Reinforcement Learning-based Job Shop Scheduling for Remanufacturing Production[C]. 2022 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 2022: 0246-0251.
[2] Cai J C, Lei D M, Wang J, et al. A novel shuffled frog-leaping algorithm with reinforcement learning for distributed assembly hybrid flow shop scheduling[J]. International Journal of Production Research, 2022.
[3] Cao Y L, Xu Z W, Mei M, et al. Train rescheduling method based on multi-agent reinforcement learning[C]. 6th IEEE Advanced Information Technology, Electronic and Automation Control Conference (IEEE IAEAC), 2022: 301-305.
[4] Chang J, Yu D, Hu Y, et al. Deep Reinforcement Learning for Dynamic Flexible Job Shop Scheduling with Random Job Arrival[J]. Processes, 2022, 10(4): 760.
[5] Chang J R, Yu D, Zhou Z, et al. Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor[J]. Machines, 2022, 10(12).
[6] Chang X, Jia X L, Fu S F, et al. Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor[J]. Proceedings of the Institution of Mechanical Engineers Part B-Journal of Engineering Manufacture, 2022.
[7] Chen S F, Huang Z Y, Guo H F. An End-to-End Deep Learning Method for Dynamic Job Shop Scheduling Problem[J]. Machines, 2022, 10(7).
[8] Dong Z, Ren T, Weng J, et al. Minimizing the Late Work of the Flow Shop Scheduling Problem with a Deep Reinforcement Learning Based Approach[J]. Applied Sciences, 2022, 12(5): 2366.
[9] Du Y, Li J Q, Chen X L, et al. Knowledge-Based Reinforcement Learning and Estimation of Distribution Algorithm for Flexible Job Shop Scheduling Problem[J]. Ieee Transactions on Emerging Topics in Computational Intelligence, 2022.
[10] Du Y, Li J Q, Li C D, et al. A Reinforcement Learning Approach for Flexible Job Shop Scheduling Problem With Crane Transportation and Setup Times[J]. Ieee Transactions on Neural Networks and Learning Systems, 2022.
[11] Elsayed E K, Elsayed A K, Eldahshan K A. Deep Reinforcement Learning-Based Job Shop Scheduling of Smart Manufacturing[J]. Cmc-Computers Materials & Continua, 2022, 73(3): 5103-5120.
[12] Esteso A, Peidro D, Mula J, et al. Reinforcement learning applied to production planning and control[J]. International Journal of Production Research, 2022.
[13] Gil C B, Lee J H. Deep Reinforcement Learning Approach for Material Scheduling Considering High-Dimensional Environment of Hybrid Flow-Shop Problem[J]. Applied Sciences-Basel, 2022, 12(18).
[14] Grumbach F, Muller A, Reusch P, et al. Robust-stable scheduling in dynamic flow shops based on deep reinforcement learning[J]. Journal of Intelligent Manufacturing, 2022.
[15] Gu W B, Li Y X, Tang D B, et al. Using real-time manufacturing data to schedule a smart factory via reinforcement learning[J]. Computers & Industrial Engineering, 2022, 171.
[16] Hammami N E H, Lardeux B, Hadj-Alouane A B, et al. Job Shop Scheduling: A Novel DRL approach for continuous schedule-generation facing real-time job arrivals[J]. IFAC-PapersOnLine, 2022, 55(10): 2493-2498.
[17] Hayes C F, Rădulescu R, Bargiacchi E, et al. A practical guide to multi-objective reinforcement learning and planning[J]. Autonomous Agents and Multi-Agent Systems, 2022, 36(1): 26.
[18] He Z, Tran K P, Thomassey S, et al. Multi-objective optimization of the textile manufacturing process using deep-Q-network based multi-agent reinforcement learning[J]. Journal of Manufacturing Systems, 2022, 62: 939-949.
[19] Jeon S W, Lee D G, Oh S C, et al. Design and Implementation of Simulation-Based Scheduling System with Reinforcement Learning for Re-Entrant Production Lines[J]. Machines, 2022, 10(12).
[20] Jing X, Yao X F, Liu M, et al. Multi-agent reinforcement learning based on graph convolutional network for flexible job shop scheduling[J]. Journal of Intelligent Manufacturing, 2022.
[21] Johnson D, Chen G, Lu Y Q. Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell[J]. IEEE Robotics and Automation Letters, 2022, 7(3): 7684-7691.
[22] Jungbluth S, Gafur N, Popper J, et al. Reinforcement Learning-based Scheduling of a Job-Shop Process with Distributedly Controlled Robotic Manipulators for Transport Operations[C]. 14th IFAC Workshop on Intelligent Manufacturing Systems (IMS), 2022: 156-162.
[23] Lee Y H, Lee S. Deep reinforcement learning based scheduling within production plan in semiconductor fabrication[J]. Expert Systems with Applications, 2022, 191: 116222.
[24] Lei K, Guo P, Wang Y, et al. An End-to-end Hierarchical Reinforcement Learning Framework for Large-scale Dynamic Flexible Job-shop Scheduling Problem[C]. IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) / IEEE World Congress on Computational Intelligence (IEEE WCCI) / International Joint Conference on Neural Networks (IJCNN) / IEEE Congress on Evolutionary Computation (IEEE CEC), 2022.
[25] Lei K, Guo P, Zhao W, et al. A multi-action deep reinforcement learning framework for flexible Job-shop scheduling problem[J]. Expert Systems with Applications, 2022, 205: 117796.
[26] Leng J L, Wang X Y, Wu S P, et al. A multi-objective reinforcement learning approach for resequencing scheduling problems in automotive manufacturing systems[J]. International Journal of Production Research, 2022.
[27] Li H X, Gao K Z, Duan P Y, et al. An Improved Artificial Bee Colony Algorithm With Q-Learning for Solving Permutation Flow-Shop Scheduling Problems[J]. Ieee Transactions on Systems Man Cybernetics-Systems, 2022.
[28] Li R, Gong W Y, Lu C. A reinforcement learning based RMOEA/D for bi-objective fuzzy flexible job shop scheduling[J]. Expert Systems with Applications, 2022, 203.
[29] Li R F, Zhang X Y, Jiang L L, et al. An adaptive heuristic algorithm based on reinforcement learning for ship scheduling optimization problem[J]. Ocean & Coastal Management, 2022, 230.
[30] Li Y, Gu W, Yuan M, et al. Real-time data-driven dynamic scheduling for flexible job shop with insufficient transportation resources using hybrid deep Q network[J]. Robotics and Computer-Integrated Manufacturing, 2022, 74: 102283.
[31] Liao J L, Wu G L, Chen H, et al. ACDRL: An actor-critic deep reinforcement learning approach for solving the energy-aimed train timetable rescheduling problem under random disturbances[J]. Energy Reports, 2022, 8: 1350-1357.
[32] Liu R, Piplani R, Toro C. Deep reinforcement learning for dynamic scheduling of a flexible job shop[J]. International Journal of Production Research, 2022: 1-21.
[33] Liu Z Y, Wang Y, Liang X X, et al. A graph neural networks-based deep Q-learning approach for job shop scheduling problems in traffic management[J]. Information Sciences, 2022, 607: 1211-1223.
[34] Long X J, Zhang J T, Qi X, et al. A self-learning artificial bee colony algorithm based on reinforcement learning for a flexible job-shop scheduling problem[J]. Concurrency and Computation-Practice & Experience, 2022, 34(4).
[35] Luo S, Zhang L X, Fan Y S. Real-Time Scheduling for Dynamic Partial-No-Wait Multiobjective Flexible Job Shop by Deep Reinforcement Learning[J]. Ieee Transactions on Automation Science and Engineering, 2022, 19(4): 3020-3038.
[36] Marchesano M G, Guizzi G, Popolo V, et al. Dynamic scheduling of a due date constrained flow shop with Deep Reinforcement Learning[C]. 10th IFAC Triennial Conference on Manufacturing Modelling, Management and Control (MIM), 2022: 2932-2937.
[37] Neves M, Neto P. Deep reinforcement learning applied to an assembly sequence planning problem with user preferences[J]. International Journal of Advanced Manufacturing Technology, 2022.
[38] Oh S H, Cho Y I, Woo J H. Distributional reinforcement learning with the independent learners for flexible job shop scheduling problem with high variability[J]. Journal of Computational Design and Engineering, 2022, 9(4): 1157-1174.
[39] Samsonov V, Ben Hicham K, Meisen T. Reinforcement Learning in Manufacturing Control: Baselines, challenges and ways forward[J]. Engineering Applications of Artificial Intelligence, 2022, 112.
[40] Saqlain M, Ali S, Lee J Y. A Monte-Carlo tree search algorithm for the flexible job-shop scheduling in manufacturing systems[J]. Flexible Services and Manufacturing Journal, 2022.
[41] Schneckenreither M, Haeussler S, Peiro J. Average reward adjusted deep reinforcement learning for order release planning in manufacturing[J]. Knowledge-Based Systems, 2022, 247.
[42] Shao X, Kim C S. An Adaptive Job Shop Scheduler Using Multilevel Convolutional Neural Network and Iterative Local Search[J]. Ieee Access, 2022, 10: 88079-88092.
[43] Shimim F N, Whitaker B M. A Reinforcement Learning Approach to the Dynamic Job Scheduling Problem[C]. 2022 IEEE Green Energy and Smart System Systems (IGESSC), 2022: 1-6.
[44] Song W, Chen X, Li Q, et al. Flexible Job Shop Scheduling via Graph Neural Network and Deep Reinforcement Learning[J]. Ieee Transactions on Industrial Informatics, 2022: 1-11.
[45] Torres A D, Andreiana D S, Roldan A O, et al. A Review of Deep Reinforcement Learning Approaches for Smart Manufacturing in Industry 4.0 and 5.0 Framework[J]. Applied Sciences-Basel, 2022, 12(23).
[46] Valet A, Altenmuller T, Waschneck B, et al. Opportunistic maintenance scheduling with deep reinforcement learning[J]. Journal of Manufacturing Systems, 2022, 64: 518-534.
[47] Wang H, Cheng J, Liu C, et al. Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events[J]. Applied Soft Computing, 2022, 131: 109717.
[48] Wang J, Lei D M, Cai J C. An adaptive artificial bee colony with reinforcement learning for distributed three-stage assembly scheduling with maintenance[J]. Applied Soft Computing, 2022, 117.
[49] Wang S Y, Li J X, Tang H, et al. CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning[J]. Frontiers in Environmental Science, 2022, 10.
[50] Wang T, Cheng W, Zhang Y H, et al. Dynamic Selection of Priority Rules Based on Deep Reinforcement Learning for Rescheduling of RCPSP[C]. 10th IFAC Triennial Conference on Manufacturing Modelling, Management and Control (MIM), 2022: 2144-2149.
[51] Wang X L, Yao H P, Mai T L, et al. Deep Reinforcement Learning aided No-wait Flow Scheduling in Time-Sensitive Networks[C]. IEEE Wireless Communications and Networking Conference (IEEE WCNC), 2022: 812-817.
[52] Waubert De Puiseau C, Meyes R, Meisen T J J O I M. On reliability of reinforcement learning based production scheduling systems: a comparative survey[J]. Journal of Intelligent Manufacturing, 2022: 1-17.
[53] Wu G Q, Hua H J, Niu D X. Low-carbon economic dispatch optimization of a virtual power plant based on deep reinforcement learning in China’s carbon market environment[J]. Journal of Renewable and Sustainable Energy, 2022, 14(5).
[54] Xu Z Y, Chang D F, Luo T, et al. Intelligent scheduling of double-deck traversable cranes based on deep reinforcement learning[J]. Engineering Optimization, 2022.
[55] Yan Q, Wang H, Wu F. Digital twin-enabled dynamic scheduling with preventive maintenance using a double-layer Q-learning algorithm[J]. Computers & Operations Research, 2022, 144: 105823.
[56] Yan Q, Wu W, Wang H. Deep Reinforcement Learning for Distributed Flow Shop Scheduling with Flexible Maintenance[J]. Machines, 2022, 10(3): 210.
[57] Yang S L, Wang J Y, Xu Z G. Real-time scheduling for distributed permutation flowshops with dynamic job arrivals using deep reinforcement learning[J]. Advanced Engineering Informatics, 2022, 54.
[58] Yang Y Y, Qian B, Hu R, et al. Deep Reinforcement Learning Algorithm for Permutation Flow Shop Scheduling Problem[C]. 18th International Conference on Intelligent Computing (ICIC), 2022: 473-483.
[59] Yu H S. Research on Fresh Product Logistics Transportation Scheduling Based on Deep Reinforcement Learning[J]. Scientific Programming, 2022, 2022.
[60] Yun W J, Park S, Kim J, et al. Cooperative Multiagent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control[J]. Ieee Transactions on Industrial Informatics, 2022, 18(10): 7086-7096.
[61] Zhang M, Lu Y, Hu Y, et al. Dynamic Scheduling Method for Job-Shop Manufacturing Systems by Deep Reinforcement Learning with Proximal Policy Optimization[J]. Sustainability, 2022, 14(9): 5177.
[62] Zhang Y, Zhu H H, Tang D B, et al. Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems[J]. Robotics and Computer-Integrated Manufacturing, 2022, 78.
[63] Zhao Y J, Yoo J H, Lim C G. Real-Time Demand Response Management for Controlling Load Using Deep Reinforcement Learning[J]. Cmc-Computers Materials & Continua, 2022, 73(3): 5671-5686.
[64] Zheng X Y, Liang C J, Wang Y, et al. Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach[J]. Mathematics, 2022, 10(23).
[65] Zhu H H, Tao S, Gui Y, et al. Research on an Adaptive Real-Time Scheduling Method of Dynamic Job-Shop Based on Reinforcement Learning[J]. Machines, 2022, 10(11).
[66] Zhu H H, Zhang Y, Liu C C, et al. An Adaptive Reinforcement Learning-Based Scheduling Approach with Combination Rules for Mixed-Line Job Shop Production[J]. Mathematical Problems in Engineering, 2022, 2022.
[67] 刘锋 徐, 柯文博. 基于深度强化学习的服装缝制过程实时动态调度[J]. 纺织学报, 2022, 43(09): 41-48.
[68] 罗梓珲, 江呈羚, 刘亮, et al. 基于深度强化学习的智能车间调度方法研究[J]. 物联网学报, 2022, 6(1): 12.

综述

[1] Esteso A, Peidro D, Mula J, et al. Reinforcement learning applied to production planning and control（强化学习用于生产计划和控制）[J]. International Journal of Production Research, 2022.

[2] Samsonov V, Ben Hicham K, Meisen T. Reinforcement Learning in Manufacturing Control: Baselines, challenges and ways forward（制造控制中的强化学习:基线、挑战和展望）[J]. Engineering Applications of Artificial Intelligence, 2022, 112.

[3] Torres A D, Andreiana D S, Roldan A O, et al. A Review of Deep Reinforcement Learning Approaches for Smart Manufacturing in Industry 4.0 and 5.0 Framework（工业4.0和5.0框架下智能制造的深度强化学习方法综述）[J]. Applied Sciences-Basel, 2022, 12(23).

[4] Waubert De Puiseau C, Meyes R, Meisen T J J O I M. On reliability of reinforcement learning based production scheduling systems: a comparative survey（基于强化学习的生产调度系统可靠性研究：综述）[J]. Journal of Intelligent Manufacturing, 2022: 1-17.

作业车间调度

[5] Bai Y, Lv Y. Reinforcement Learning-based Job Shop Scheduling for Remanufacturing Production（基于强化学习的重入式生产作业车间调度）[C]. 2022 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), 2022: 0246-0251.

[6] Chen S F, Huang Z Y, Guo H F. An End-to-End Deep Learning Method for Dynamic Job Shop Scheduling Problem（基于端到端深度学习的动态作业车间调度问题方法研究）[J]. Machines, 2022, 10(7).

[7] Elsayed E K, Elsayed A K, Eldahshan K A. Deep Reinforcement Learning-Based Job Shop Scheduling of Smart Manufacturing（基于深度强化学习的智能制造作业车间调度）[J]. Cmc-Computers Materials & Continua, 2022, 73(3): 5103-5120.

[8] Hammami N E H, Lardeux B, Hadj-Alouane A B, et al. Job Shop Scheduling: A Novel DRL approach for continuous schedule-generation facing real-time job arrivals（作业车间调度：新深度强化学习方法用于求解考虑实时工件抵达的连续调度生成）[J]. IFAC-PapersOnLine, 2022, 55(10): 2493-2498.

[9] Jungbluth S, Gafur N, Popper J, et al. Reinforcement Learning-based Scheduling of a Job-Shop Process with Distributedly Controlled Robotic Manipulators for Transport Operations（基于强化学习的分布式控制机器人作业车间调度）[C]. 14th IFAC Workshop on Intelligent Manufacturing Systems (IMS), 2022: 156-162.

[10] Liu Z Y, Wang Y, Liang X X, et al. A graph neural networks-based deep Q-learning approach for job shop scheduling problems in traffic management（交通管理中作业车间调度问题的基于图神经网络的深度Q学习方法）[J]. Information Sciences, 2022, 607: 1211-1223.

[11] Shao X, Kim C S. An Adaptive Job Shop Scheduler Using Multilevel Convolutional Neural Network and Iterative Local Search（一种使用多层卷积神经网络和迭代局部搜索的自适应作业车间调度器）[J]. Ieee Access, 2022, 10: 88079-88092.

[12] Shimim F N, Whitaker B M. A Reinforcement Learning Approach to the Dynamic Job Scheduling Problem（动态作业调度问题的强化学习方法）[C]. 2022 IEEE Green Energy and Smart System Systems (IGESSC), 2022: 1-6.

[13] Zhang M, Lu Y, Hu Y, et al. Dynamic Scheduling Method for Job-Shop Manufacturing Systems by Deep Reinforcement Learning with Proximal Policy Optimization（基于深度强化学习和近端策略优化的作业车间制造系统动态调度方法）[J]. Sustainability, 2022, 14(9): 5177.

[14] Zhu H H, Tao S, Gui Y, et al. Research on an Adaptive Real-Time Scheduling Method of Dynamic Job-Shop Based on Reinforcement Learning（基于强化学习的动态作业车间自适应实时调度方法研究）[J]. Machines, 2022, 10(11).

[15] Zhu H H, Zhang Y, Liu C C, et al. An Adaptive Reinforcement Learning-Based Scheduling Approach with Combination Rules for Mixed-Line Job Shop Production（基于自适应强化学习的混线作业车间组合规则调度方法）[J]. Mathematical Problems in Engineering, 2022, 2022.

柔性作业车间调度

[16] Chang J, Yu D, Hu Y, et al. Deep Reinforcement Learning for Dynamic Flexible Job Shop Scheduling with Random Job Arrival（基于强化学习的考虑随机工件抵达的柔性作业车间调度）[J]. Processes, 2022, 10(4): 760.

[17] Chang J R, Yu D, Zhou Z, et al. Hierarchical Reinforcement Learning for Multi-Objective Real-Time Flexible Scheduling in a Smart Shop Floor（基于分层强化学习的智能车间多目标实时柔性调度）[J]. Machines, 2022, 10(12).

[18] Chang X, Jia X L, Fu S F, et al. Digital twin and deep reinforcement learning enabled real-time scheduling for complex product flexible shop-floor（数字孪生和深度强化学习驱动的复杂产品柔性作业车间实时调度）[J]. Proceedings of the Institution of Mechanical Engineers Part B-Journal of Engineering Manufacture, 2022.

[19] Du Y, Li J Q, Chen X L, et al. Knowledge-Based Reinforcement Learning and Estimation of Distribution Algorithm for Flexible Job Shop Scheduling Problem（基于知识型强化学习和分布算法估计的柔性作业车间调度问题）[J]. Ieee Transactions on Emerging Topics in Computational Intelligence, 2022.

[20] Du Y, Li J Q, Li C D, et al. A Reinforcement Learning Approach for Flexible Job Shop Scheduling Problem With Crane Transportation and Setup Times（带有吊车运输和准备时间的柔性作业车间调度问题强化学习方法）[J]. Ieee Transactions on Neural Networks and Learning Systems, 2022.

[21] Gu W B, Li Y X, Tang D B, et al. Using real-time manufacturing data to schedule a smart factory via reinforcement learning（基于强化学习和实时制造数据的智能工厂调度）[J]. Computers & Industrial Engineering, 2022, 171.

[22] Jing X, Yao X F, Liu M, et al. Multi-agent reinforcement learning based on graph convolutional network for flexible job shop scheduling（基于图卷积神经网络的多代理强化学习用于柔性作业车间调度）[J]. Journal of Intelligent Manufacturing, 2022.

[23] Johnson D, Chen G, Lu Y Q. Multi-Agent Reinforcement Learning for Real-Time Dynamic Production Scheduling in a Robot Assembly Cell（用于求解机器人装配单元实时动态生产调度的多代理强化学习）[J]. IEEE Robotics and Automation Letters, 2022, 7(3): 7684-7691.

[24] Lei K, Guo P, Wang Y, et al. An End-to-end Hierarchical Reinforcement Learning Framework for Large-scale Dynamic Flexible Job-shop Scheduling Problem（大规模动态柔性作业车间调度问题的端到端分层强化学习框架）[C]. IEEE International Conference on Fuzzy Systems (FUZZ-IEEE) / IEEE World Congress on Computational Intelligence (IEEE WCCI) / International Joint Conference on Neural Networks (IJCNN) / IEEE Congress on Evolutionary Computation (IEEE CEC), 2022.

[25] Lei K, Guo P, Zhao W, et al. A multi-action deep reinforcement learning framework for flexible Job-shop scheduling problem（柔性作业车间调度问题的多动作深度强化学习框架）[J]. Expert Systems with Applications, 2022, 205: 117796.

[26] Li R, Gong W Y, Lu C. A reinforcement learning based RMOEA/D for bi-objective fuzzy flexible job shop scheduling（基于强化学习的RMOEA/D的双目标模糊柔性作业车间调度）[J]. Expert Systems with Applications, 2022, 203.

[27] Li Y, Gu W, Yuan M, et al. Real-time data-driven dynamic scheduling for flexible job shop with insufficient transportation resources using hybrid deep Q network（基于混合深Q网络的运输资源不足的柔性作业车间实时数据驱动动态调度）[J]. Robotics and Computer-Integrated Manufacturing, 2022, 74: 102283.

[28] Liu R, Piplani R, Toro C. Deep reinforcement learning for dynamic scheduling of a flexible job shop（基于深度强化学习的柔性作业车间动态调度）[J]. International Journal of Production Research, 2022: 1-21.

[29] Long X J, Zhang J T, Qi X, et al. A self-learning artificial bee colony algorithm based on reinforcement learning for a flexible job-shop scheduling problem（基于强化学习的柔性作业车间调度自学习人工蜂群算法）[J]. Concurrency and Computation-Practice & Experience, 2022, 34(4).

[30] Luo S, Zhang L X, Fan Y S. Real-Time Scheduling for Dynamic Partial-No-Wait Multiobjective Flexible Job Shop by Deep Reinforcement Learning（基于深度强化学习的动态部分非等待多目标柔性作业车间实时调度）[J]. Ieee Transactions on Automation Science and Engineering, 2022, 19(4): 3020-3038.

[31] Oh S H, Cho Y I, Woo J H. Distributional reinforcement learning with the independent learners for flexible job shop scheduling problem with high variability（采用具有独立学习器的分布式强化学习方法求解高可变的柔性作业车间调度问题）[J]. Journal of Computational Design and Engineering, 2022, 9(4): 1157-1174.

[32] Saqlain M, Ali S, Lee J Y. A Monte-Carlo tree search algorithm for the flexible job-shop scheduling in manufacturing systems（制造系统柔性作业车间调度的蒙特卡罗树搜索算法）[J]. Flexible Services and Manufacturing Journal, 2022.

[33] Song W, Chen X, Li Q, et al. Flexible Job Shop Scheduling via Graph Neural Network and Deep Reinforcement Learning（基于图神经网络和深度强化学习的柔性作业车间调度）[J]. Ieee Transactions on Industrial Informatics, 2022: 1-11.

[34] Wang H, Cheng J, Liu C, et al. Multi-objective reinforcement learning framework for dynamic flexible job shop scheduling problem with uncertain events（不确定事件动态柔性作业车间调度问题的多目标强化学习框架）[J]. Applied Soft Computing, 2022, 131: 109717.

[35] Wang S Y, Li J X, Tang H, et al. CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning（CEA-FJSP：基于深度强化学习的碳排放感知柔性作业车间调度）[J]. Frontiers in Environmental Science, 2022, 10.

[36] Xu Z Y, Chang D F, Luo T, et al. Intelligent scheduling of double-deck traversable cranes based on deep reinforcement learning（基于深度强化学习的双层可穿越式起重机智能调度）[J]. Engineering Optimization, 2022.

[37] Yan Q, Wang H, Wu F. Digital twin-enabled dynamic scheduling with preventive maintenance using a double-layer Q-learning algorithm（使用双层Q学习算法实现考虑预测性维护的数字孪生使能的动态调度）[J]. Computers & Operations Research, 2022, 144: 105823.

[38] Zhang Y, Zhu H H, Tang D B, et al. Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems（基于深度强化学习的多智能体制造系统动态作业车间调度）[J]. Robotics and Computer-Integrated Manufacturing, 2022, 78.

流水车间调度

[39] Cai J C, Lei D M, Wang J, et al. A novel shuffled frog-leaping algorithm with reinforcement learning for distributed assembly hybrid flow shop scheduling（分布式装配混合流水车间调度的一种新的融合强化学习的蛙跳算法）[J]. International Journal of Production Research, 2022.

[40] Dong Z, Ren T, Weng J, et al. Minimizing the Late Work of the Flow Shop Scheduling Problem with a Deep Reinforcement Learning Based Approach（基于深度强化学习方法的流水车间问题延期最小化）[J]. Applied Sciences, 2022, 12(5): 2366.

[41] Gil C B, Lee J H. Deep Reinforcement Learning Approach for Material Scheduling Considering High-Dimensional Environment of Hybrid Flow-Shop Problem（基于深度强化学习的考虑高维环境的混合流水车间物料调度）[J]. Applied Sciences-Basel, 2022, 12(18).

[42] Grumbach F, Muller A, Reusch P, et al. Robust-stable scheduling in dynamic flow shops based on deep reinforcement learning（基于深度强化学习的动态流水车间鲁棒稳定调度）[J]. Journal of Intelligent Manufacturing, 2022.

[43] Li H X, Gao K Z, Duan P Y, et al. An Improved Artificial Bee Colony Algorithm With Q-Learning for Solving Permutation Flow-Shop Scheduling Problems（求解置换流水车间调度问题的改进Q-学习人工蜂群算法）[J]. Ieee Transactions on Systems Man Cybernetics-Systems, 2022.

[44] Marchesano M G, Guizzi G, Popolo V, et al. Dynamic scheduling of a due date constrained flow shop with Deep Reinforcement Learning（基于深度强化学习的考虑交货期约束的流水车间动态调度）[C]. 10th IFAC Triennial Conference on Manufacturing Modelling, Management and Control (MIM), 2022: 2932-2937.

[45] Yan Q, Wu W, Wang H. Deep Reinforcement Learning for Distributed Flow Shop Scheduling with Flexible Maintenance（具有灵活维护的分布式流水车间调度的深度强化学习）[J]. Machines, 2022, 10(3): 210.

[46] Yang S L, Wang J Y, Xu Z G. Real-time scheduling for distributed permutation flowshops with dynamic job arrivals using deep reinforcement learning（基于深度强化学习的动态作业到达的分布式置换流水车间实时调度）[J]. Advanced Engineering Informatics, 2022, 54.

[47] Yang Y Y, Qian B, Hu R, et al. Deep Reinforcement Learning Algorithm for Permutation Flow Shop Scheduling Problem（置换流水车间调度问题的深度强化学习算法）[C]. 18th International Conference on Intelligent Computing (ICIC), 2022: 473-483.

[48] 罗梓珲, 江呈羚, 刘亮, et al. 基于深度强化学习的智能车间调度方法研究[J]. 物联网学报, 2022, 6(1): 12.

其他调度问题

[49] Cao Y L, Xu Z W, Mei M, et al. Train rescheduling method based on multi-agent reinforcement learning（基于多代理强化学习的火车重调度方法）[C]. 6th IEEE Advanced Information Technology, Electronic and Automation Control Conference (IEEE IAEAC), 2022: 301-305.

[50] Hayes C F, Rădulescu R, Bargiacchi E, et al. A practical guide to multi-objective reinforcement learning and planning（多目标强化学习和规划实用指南）[J]. Autonomous Agents and Multi-Agent Systems, 2022, 36(1): 26.

[51] He Z, Tran K P, Thomassey S, et al. Multi-objective optimization of the textile manufacturing process using deep-Q-network based multi-agent reinforcement learning（使用基于多代理强化学习的深度Q网络多目标优化纺织制造）[J]. Journal of Manufacturing Systems, 2022, 62: 939-949.

[52] Jeon S W, Lee D G, Oh S C, et al. Design and Implementation of Simulation-Based Scheduling System with Reinforcement Learning for Re-Entrant Production Lines（基于仿真和强化学习的可重入生产线调度系统设计与实现）[J]. Machines, 2022, 10(12).

[53] Lee Y H, Lee S. Deep reinforcement learning based scheduling within production plan in semiconductor fabrication（基于深度强化学习的半导体制造生产计划调度）[J]. Expert Systems with Applications, 2022, 191: 116222.

[54] Leng J L, Wang X Y, Wu S P, et al. A multi-objective reinforcement learning approach for resequencing scheduling problems in automotive manufacturing systems（汽车制造系统重排序调度的多目标强化学习方法）[J]. International Journal of Production Research, 2022.

[55] Li R F, Zhang X Y, Jiang L L, et al. An adaptive heuristic algorithm based on reinforcement learning for ship scheduling optimization problem（船舶调度优化问题的基于强化学习的自适应启发式算法）[J]. Ocean & Coastal Management, 2022, 230.

[56] Liao J L, Wu G L, Chen H, et al. ACDRL: An actor-critic deep reinforcement learning approach for solving the energy-aimed train timetable rescheduling problem under random disturbances（ACDRL：一种演员-评论家深度强化学习方法用于解决随机干扰下能量目标列车时刻表重调度问题）[J]. Energy Reports, 2022, 8: 1350-1357.

[57] Neves M, Neto P. Deep reinforcement learning applied to an assembly sequence planning problem with user preferences（深度强化学习应用于具有用户偏好的装配序列规划问题）[J]. International Journal of Advanced Manufacturing Technology, 2022.

[58] Schneckenreither M, Haeussler S, Peiro J. Average reward adjusted deep reinforcement learning for order release planning in manufacturing（平均奖励调整深度强化学习在制造业订单释放计划中的应用）[J]. Knowledge-Based Systems, 2022, 247.

[59] Valet A, Altenmuller T, Waschneck B, et al. Opportunistic maintenance scheduling with deep reinforcement learning（基于深度强化学习的机会维护调度）[J]. Journal of Manufacturing Systems, 2022, 64: 518-534.

[60] Wang J, Lei D M, Cai J C. An adaptive artificial bee colony with reinforcement learning for distributed three-stage assembly scheduling with maintenance（带维护的分布式三阶段装配调度的强化学习自适应人工蜂群）[J]. Applied Soft Computing, 2022, 117.

[61] Wang T, Cheng W, Zhang Y H, et al. Dynamic Selection of Priority Rules Based on Deep Reinforcement Learning for Rescheduling of RCPSP（基于深度强化学习的资源约束项目重调度优先级规则动态选择）[C]. 10th IFAC Triennial Conference on Manufacturing Modelling, Management and Control (MIM), 2022: 2144-2149.

[62] Wang X L, Yao H P, Mai T L, et al. Deep Reinforcement Learning aided No-wait Flow Scheduling in Time-Sensitive Networks（深度强化学习辅助的时间敏感网络中的无等待流调度）[C]. IEEE Wireless Communications and Networking Conference (IEEE WCNC), 2022: 812-817.

[63] Wu G Q, Hua H J, Niu D X. Low-carbon economic dispatch optimization of a virtual power plant based on deep reinforcement learning in China’s carbon market environment（中国碳市场环境下基于深度强化学习的虚拟电厂低碳经济调度优化）[J]. Journal of Renewable and Sustainable Energy, 2022, 14(5).

[64] Yu H S. Research on Fresh Product Logistics Transportation Scheduling Based on Deep Reinforcement Learning（基于深度强化学习的生鲜产品物流运输调度研究）[J]. Scientific Programming, 2022, 2022.

[65] Yun W J, Park S, Kim J, et al. Cooperative Multiagent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control（协作多智能体深度强化学习在自主多无人机控制中的可靠监视）[J]. Ieee Transactions on Industrial Informatics, 2022, 18(10): 7086-7096.

[66] Zhao Y J, Yoo J H, Lim C G. Real-Time Demand Response Management for Controlling Load Using Deep Reinforcement Learning（使用深度强化学习控制负载的实时需求响应管理）[J]. Cmc-Computers Materials & Continua, 2022, 73(3): 5671-5686.

[67] Zheng X Y, Liang C J, Wang Y, et al. Multi-AGV Dynamic Scheduling in an Automated Container Terminal: A Deep Reinforcement Learning Approach（自动化集装箱码头多AGV动态调度:深度强化学习方法）[J]. Mathematics, 2022, 10(23).

[68] 刘锋 徐, 柯文博. 基于深度强化学习的服装缝制过程实时动态调度[J]. 纺织学报, 2022, 43(09): 41-48.