This study addresses the critical challenge of proactive anomaly detection and efficient resource man-agement in infrastructure observability. Introducing an innovative approach to infrastructure monitoring, this workintegrates machine learning models into observability platforms to enhance real-time monitoring precision. Employ-ing a microservices architecture, the proposed system facilitates swift and proactive anomaly detection, addressingthe limitations of traditional monitoring methods that often fail to predict potential issues before they escalate. Thecore of this system lies in its predictive models that utilize Random Forest, Gradient Boosting, and Support VectorMachine algorithms to forecast crucial metric behaviors, such as CPU usage and memory allocation. The empiri-cal results underscore the system’s efficacy, with the GradientBoostingRegressor model achieving an R² score of0.86 for predicting request rates, and the RandomForestRegressor model significantly reducing the Mean SquaredError by 2.06% for memory usage predictions compared to traditional monitoring methods. These findings not onlydemonstrate the potential of machine learning in enhancing observability but also pave the way for more resilientand adaptive infrastructure management.

A realização desta investigação foi parcialmente financiada por fundos nacionais através da FCT - Fundação para a Ciência e Tecnologia, I.P. no âmbito dos projetos UIDB/04466/2020 e UIDP/04466/2020.

Machine learning,Infrastructure monitoring,Anomaly detection,Proactive maintenance

• Computer and Information Sciences - Natural Sciences
• Electrical Engineering, Electronic Engineering, Information Engineering - Engineering and Technology

This publication is an output of the following project(s):

• Alternative Shaper
• Image and Video Data Analytics
• Impact of Blockchains and Decentralised Ledger Technologies