×

Optimal production ramp-up in the smartphone manufacturing industry. (English) Zbl 1523.90131

Summary: Motivated by challenges in the smartphone manufacturing industry, we develop a dynamic production ramp-up model that can be applied to economically satisfy nonstationary demand for short-life-cycle products by high-tech companies. Due to shorter life cycles and more rapid evolution of smartphones, production ramp-up has been increasingly critical to the success of a new smartphone. In the production ramp-up, the key challenge is to match the increasing capacity to nonstationary demand. The high-tech smartphone manufacturers are urged to jointly consider the effect of increasing capacity and decreasing demand. We study the production planning problem using a high-dimensional Markov decision process (MDP) model to characterize the production ramp-up. To address the curse of dimensionality, we refine Monte Carlo tree search (MCTS) algorithm and theoretically analyze its convergence and computational complexity. In a real case study, we find that the MDP model achieves revenue improvement by stopping producing the existing product earlier than the benchmark policy. In synthetic instances, we validate that the proposed MCTS algorithm saves computation time without loss of solution quality compared with traditional value iteration algorithm. As part of the Lenovo production solution, our MDP model enables high-tech smartphone manufacturers to better plan the production ramp-up.
{© 2020 Wiley Periodicals, Inc.}

MSC:

90B30 Production models
90C40 Markov and semi-Markov decision processes

Software:

AlphaZero
Full Text: DOI

References:

[1] Almgren, H. (2000). Pilot production and manufacturing start‐up: The case of Volvo S80. International Journal of Production Research, 38, 4577-4588.
[2] Aydin, M. E., & Öztemel, E. (2000). Dynamic job‐shop scheduling using reinforcement learning agents. Robotics and Autonomous Systems., 33, 169-178.
[3] Aytac, B., & Wu, S. D. (2013). Characterization of demand for short life‐cycle technology products. Annals of Operations Research., 203, 255-277. · Zbl 1269.91052
[4] Ball, P., Roberts, S., Natalicchio, A., & Scorzafave, C. (2011). Modelling production ramp‐up of engineering products. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 225, 959-971.
[5] Baud‐Lavigne, B., Bassetto, S., & Penz, B. (2010). A broader view of the economic design of the X‐bar chart in the semiconductor industry. International Journal of Production Research, 48, 5843-5857. · Zbl 1197.90118
[6] Bertsimas, D., Griffith, J. D., Gupta, V., Kochenderfer, M. J., & Mišić, V. V. (2017). A comparison of Monte Carlo tree search and rolling horizon optimization for large‐scale dynamic resource allocation problems. European Journal of Operational Research., 263, 664-678. · Zbl 1380.91089
[7] Bhatnagar, R., Saddikutti, V., & Rajgopalan, A. (2007). Contingent manpower planning in a high clock speed industry. International Journal of Production Research, 45, 2051-2072. · Zbl 1128.90347
[8] Breiman, L. (1992). Probability. Mathematical Gazette, 77, 128. · Zbl 0753.60001
[9] Browne, C., Powley, E., Whitehouse, D., Lucas, S., Cowling, P., Rohlfshagen, P., … Colton, S. (2012). A survey of Monte Carlo tree search methods. IEEE Transactions on Computational Intelligence and AI in Games, 4, 1-43.
[10] Chaslot, G. M. J. B., De Jong, S., Saito, J.‐T., & Uiterwijk, J. W. H. M. (2006). Monte‐Carlo tree search in production management problems. In Proceedings of the 18th BeNeLux Conference on Artificial Intelligence (pp. 91-98) Namur, Belgium: Springer.
[11] Digital Photography Review. (2018). Fujifilm plans to increase interchangeable lens production capacity as demand grows. Retrieved from https://www.dpreview.com/news/3840736084/fujifilm‐plans‐to‐increase‐interchangeable‐lens‐production‐capacity‐as‐demand‐grows
[12] Doltsinis, S., Ferreira, P., & Lohse, N. (2013). Reinforcement learning for production ramp‐up: A q‐batch learning approach. In International Conference on Machine Learning and Applications (pp. 610-615) Boca Raton, FL: IEEE.
[13] Doltsinis, S., Ferreira, P., & Lohse, N. (2014). An MDP model‐based reinforcement learning approach for production station ramp‐up optimization: Q‐learning analysis. IEEE Transactions on Systems Man & Cybernetics Systems., 44, 1125-1138.
[14] Doltsinis, S. C., & Lohse, N. (2012). A model‐free reinforcement learning approach using Monte Carlo method for production ramp‐up policy improvement—A copy exactly test case. IFAC Proceedings Volumes, 45, 1628-1634.
[15] Fjällström, S., Säfsten, K., Harlin, U., & Stahre, J. (2009). Information enabling production ramp‐up. Journal of Manufacturing Technology Management, 20, 178-196.
[16] Fortune. (2015). Chart: Demand for Apple’s iPhone 6/6+ stays. Author. Retrieved from http://fortune.com/2015/01/23/chart‐demand‐for‐apples‐iphone‐66‐stays‐strong/
[17] Glock, C. H., Jaber, M. Y., & Zolfaghari, S. (2012). Production planning for a ramp‐up process with learning in production and growth in demand. International Journal of Production Research, 50, 5707-5718.
[18] Hu, K., Acimovic, J., Erize, F., Thomas, D., & Van Mieghem, J. A. (2019). Forecasting product life cycle curves: Practical approach and empirical analysis. Manufacturing & Service Operations Management, 21, 66-85.
[19] Jiang Daniel, R., Alkanj, L., & Powell, W. B. (2017). Monte Carlo tree search with sampled information relaxation dual bounds. Technical Report, University of Pittsburgh, Pittsburgh, PA.
[20] Kartal, B., Koenig, J., & Guy, S. J. (2013). Generating believable stories in large domains. In Ninth Artificial Intelligence and Interactive Digital Entertainment Conference. Boston, Massachusetts.
[21] Kontio, J., & Haapasalo, H. (2005). A project model in managing production ramp‐up—A case study in wire harness industry. International Journal of Innovation & Technology Management, 2, 101-117.
[22] Kushner, H. J., & Yin, G. G. (2003). Stochastic approximation and recursive algorithms and applications. Berlin: Springer. · Zbl 1026.62084
[23] Lovejoy, B. (2017). Apple’s appetite for components reportedly limiting Nintendo’s production capacity for the switch. 9to5Mac. Retrieved from https://9to5mac.com/2017/05/30/nintendo‐switch‐components‐apple/
[24] Mao, C., & Shen, Z. (2018). A reinforcement learning framework for the adaptive routing problem in stochastic time‐dependent network. Transportation Research Part C: Emerging Technologies, 93, 179-197.
[25] Matta, A., Tomasella, M., & Valente, A. (2007). Impact of ramp‐up on the optimal capacity‐related reconfiguration policy. International Journal of Flexible Manufacturing Systems, 19, 173-194. · Zbl 1165.90531
[26] McKiernan, D.. (2015). 9 scenarios of common assembly line issues. eFlex Systems. Retrieved from https://www.eflexsystems.com/lean‐manufacturing‐blog/scenarios‐of‐common‐assembly‐line‐issues
[27] Meier, H., & Homuth, M. (2006). Holistic ramp‐up management in SME‐networks. In Proceedings of the 16th CIRP International Design Seminar. Kananaskis, Canada.
[28] Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., & Riedmiller, M. (2013). Playing Atari with deep reinforcement learning. Technical report. Deepmind Technologies, arXiv:1312.5602 [cs.LG].
[29] Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A. A., Veness, J., Bellemare, M. G., … Hassabis, D. (2015). Human‐level control through deep reinforcement learning. Nature, 518, 529.
[30] Nair, S. (2018). Gartner: 1.5 billion smartphones were sold in 2017. The Star Online. Retrieved from https://www.thestar.com.my/tech/tech‐news/2018/02/26/1point5‐billion‐smartphones‐were‐sold‐in‐2017/
[31] Peter, D., & Steve, U. (2007). Move ordering vs heavy playouts: Where should heuristics be applied in Monte Carlo Go. In Proceedings of the 3rd North American Game‐on Conference (pp. 273-280). Gainesville, Florida.
[32] Rasmussen, P. (2018). Electronics components shortage: What you need to know east west manufacturing. Retrieved from https://news.ewmfg.com/blog/electronics‐components‐shortage‐what‐you‐need‐to‐know
[33] Rdutnik.M. (2017). 2017 release calendar: All the major smartphones we’re expecting this year. Android Authority. Retrieved from https://www.androidauthority.com/major‐smartphone‐releases‐2017‐2‐746078/
[34] Shah, N. (2018). Apple’s revenue “super cycle” counterpoint. Retrieved from https://www.counterpointresearch.com/apples‐revenue‐super‐cycle/
[35] Shahrabi, J., Adibi Mohammad, A., & Mahootchi, M. (2017). A reinforcement learning approach to parameter estimation in dynamic job shop scheduling. Computers & Industrial Engineering, 110, 75-82.
[36] Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., van denDriessche, G., … Hassabis, D. (2016). Mastering the game of Go with deep neural networks and tree search. Nature, 529, 484.
[37] Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., … Hassabis, D. (2018). A general reinforcement learning algorithm that masters chess, shogi, and Go through self‐play. Science, 362, 1140-1144. · Zbl 1433.68320
[38] Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., … Hassabis, D. (2017). Mastering the game of Go without human knowledge. Nature, 550, 354.
[39] Smart. (2015). Life cycle of mobile phones. Author. Retrieved from https://www.smart.uio.no/research/life‐cycle‐of‐mobile‐phones/
[40] Statista. (2018). Global smartphone shipments from 2009 to 2018 (in million units). Author. Retrieved from https://www.statista.com/statistics/271491/worldwide‐shipments‐of‐smartphones‐since‐2009/
[41] Surbier, L., Alpan, G., & Blanco, E. (2014). A comparative study on production ramp‐up: State‐of‐the‐art and new challenges. Production Planning & Control., 25, 1264-1286.
[42] Sutton Richard, S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge, MA: MIT Press. · Zbl 1407.68009
[43] Terwiesch, C., Bohn, R., & Chea, K. (2001). International product transfer and production ramp‐up: A case study from the data storage industry. R&D Management, 31, 435-451.
[44] Terwiesch, C., & Bohn, R. E. (1998). Learning and process improvement during production ramp‐up. International Journal of Production Economics, 70, 1-19.
[45] Terwiesch, C., & Xu, Y. (2004). The copy‐exactly ramp‐up strategy: Trading‐off learning with process change. IEEE Transactions on Engineering Management., 51, 70-84.
[46] Wang, Y.‐C., & Usher, J. M. (2005). Application of reinforcement learning for agent‐based production scheduling. Engineering Applications of Artificial Intelligence, 18, 73-82.
[47] Wei, Z., & Dietterich, T. G. (1995). A reinforcement learning approach to job‐shop scheduling. In International Joint Conference on Artificial Intelligence (pp. 1114-1120). Montreal, Quebec: Morgan Kaufmann.
[48] Winkler, H., Heins, M., & Nyhuis, P. (2007). A controlling system based on cause‐effect relationships for the ramp‐up of production systems. Production Engineering, 1, 103-111.
This reference list is based on information provided by the publisher or from digital mathematics libraries. Its items are heuristically matched to zbMATH identifiers and may contain data conversion errors. In some cases that data have been complemented/enhanced by data from zbMATH Open. This attempts to reflect the references listed in the original paper as accurately as possible without claiming completeness or a perfect matching.