*Result*: Improving efficiency of steel converter facility: a digital twin and reinforcement learning approach.
*Further Information*
*The steel converter facility is an essential part of the steel manufacturing process and is responsible for converting molten iron into steel. The material movement within the facility depends on the effective overhead crane scheduling. However, the traditional approach of crane scheduling at these facilities leads to inefficiencies. To understand this need, we propose an integrated approach using Simulation modelling, Digital Twin (DT) and Reinforcement Learning (RL) to improve the crane scheduling operation of the steelmaking process. We developed a simulation model using discrete event and agent-based simulation and connected it with real-time data by applying the digital twin approach. Further, a Deep Reinforcement Learning (DRL) agent is trained in a stochastic environment with multiple feedback loops and complex interactions for crane scheduling. The DRL agent recommends the sequences of crane movement to reduce the wait time in bottleneck operation. The experimental results demonstrate that the proposed method gives results within 3.6% of the optimal on average. A case of the steel converter facility illustrates this approach, which is also applicable to other industries requiring complex scheduling, such as construction, automotive, and logistics, to improve operational efficiency. [ABSTRACT FROM AUTHOR]
Copyright of International Journal of Production Research is the property of Taylor & Francis Ltd and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)*