Q-learning-based hyper-heuristic framework for estimating the energy consumption of electric buses for public transport

Küçük Resim Yok

Tarih

2024

Dergi Başlığı

Dergi ISSN

Cilt Başlığı

Yayıncı

Springer International Publishing

Erişim Hakkı

info:eu-repo/semantics/closedAccess

Özet

This research study introduces a Q-learning enhanced hyper-heuristic framework for the accurate estimation of energy consumption rates of electric buses. Fundamentals of reinforcement learning concepts are hybridized with the integrated newly emerged metaheuristic methods of Aquila optimizer, Barnacles Mating Optimizer, Gradient-based Optimizer, Harris Hawks Optimization, and Poor and Rich Optimization algorithms to solve high-dimensional optimization problems with higher accuracy. In this context, the Q-learning algorithm is considered a high-level heuristic for administering the selection and move acceptance mechanisms, while search agents of those mentioned above low-level competitive metaheuristic algorithms meticulously explore the search space to find the optimum global point. Q-learning guides the operating hyper-heuristic in selecting the suitable low-level optimizer based on the Q-table score during iterations. An intelligent control mechanism is devised to get a reward or penalty for the actions of the low-level algorithms. The proposed method is evaluated on thirty-two optimization benchmark problems composed of unimodal and multimodal test functions. Then, each constituent algorithm and the hyper-heuristic model are applied to thirty-dimensional benchmark functions of CEC 2017 and twenty-eight test instances of CEC 2013. Four different challenging, complex real-world engineering design cases are also solved to assess the predictability of the proposed method on constrained problems. Finally, the proposed hyper-heuristic is employed to derive the fuel consumption estimates of electric buses. It is seen that the Multiple linear regression model, whose unknown parameters are extracted by the hyper-heuristic framework, gives the best predictions. © The Author(s), under exclusive licence to Springer Nature Switzerland AG 2024.

Açıklama

Anahtar Kelimeler

Aquila optimizer, Barnacles mating optimizer, Electric buses, Hyper-heuristics, Q-learning, Regression models

Künye