Novel unsupervised cluster reinforcement q-learning in minimizing energy consumption of federated edge cloud

Shidik, Guruh Fajar and Setiono, Oki and Kusuma, Edi Jaya and Handoko, L. Budi and Andono, Pulung Nurtantio and Abdollah, Mohd Faizal (2025) Novel unsupervised cluster reinforcement q-learning in minimizing energy consumption of federated edge cloud. IEEE Access, 13. pp. 92577-92595. ISSN 2169-3536

Text 0103625112025920262557.pdf Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (3MB)

Abstract

As global demand for cloud computing rises, green computing has become essential. Federated Edge Cloud (FEC) offers improved energy efficiency compared to traditional infrastructures, yet managing distributed energy consumption remains a challenge. This research introduces an Unsupervised Cluster Reinforcement Q-Learning method in FEC (UCRL-FEC), which integrates Fuzzy C-Means (FCM) or K-Means clustering to identify migratable Virtual Machines (VMs) from overloaded hosts. The method enhances energy efficiency and workload balance by incorporating a modified reward function in Q-Learning. Experimental evaluations demonstrate that UCRL-FEC reduces energy consumption (EC) up to 1.07%, supporting reductions in both operational costs and greenhouse gas emissions, which is critical for large-scale cloud environments. In terms of Service Level Agreement Time per Active Host (SLATAH), UCRL-FEC achieves an improvement up to 1.56% over the baseline method, demonstrating enhanced efficiency in managing active host resources. Additionally, system stability improves with a reduction of up to 9.68% in Performance Degradation due to Migration (SLA-PDM), effectively minimizing service disruptions and ensuring efficient workload management. Furthermore, the method reduces overall Service Level Agreement Violations (SLAV) up to 6.06%, indicating enhanced service reliability and optimized resource allocation. A Friedman test confirms statistically significant improvements in energy efficiency, workload distribution, and system stability over baseline methods. These advancements prevent resource overutilization, enhance workload management, and extend hardware lifespan, fostering sustainable cloud operations. UCRL-FEC balances energy efficiency, performance, and scalability through dynamic resource optimization, validating it as implementable strategy for intelligent VM management in modern cloud-edge infrastructures.

Item Type:	Article
Uncontrolled Keywords:	Clustering method, Energy efficiency, Federated edge cloud, Q-learning, Quality of service
Divisions:	Faculty of Information and Communication Technology
Depositing User:	Norfaradilla Idayu Ab. Ghafar
Date Deposited:	18 May 2026 00:54
Last Modified:	18 May 2026 00:54
URI:	http://eprints.utem.edu.my/id/eprint/29842
Statistic Details:	View Download Statistic

Actions (login required)

View Item