Ciência-IUL
Publications
Publication Detailed Description
A distributed Monte Carlo based linear algebra solver applied to the analysis of large complex networks
Journal Title
Future Generation Computer Systems
Year (definitive publication)
2022
Language
English
Country
Netherlands
More Information
Web of Science®
Scopus
Google Scholar
Abstract
Methods based on Monte Carlo for solving linear systems have some interesting properties which make them, in many instances, preferable to classic methods. Namely, these statistical methods allow the computation of individual entries of the output, hence being able to handle problems where the size of the resulting matrix would be too large. In this paper, we propose a distributed linear algebra solver based on Monte Carlo. The proposed method is based on an algorithm that uses random walks over the system’s matrix to calculate powers of this matrix, which can then be used to compute a given matrix function. Distributing the matrix over several nodes enables the handling of even larger problem instances, however it entails a communication penalty as walks may need to jump between computational nodes. We have studied different buffering strategies and provide a solution that minimizes this overhead and maximizes performance. We used our method to compute metrics of complex networks, such as node centrality and resolvent Estrada index. We present results that demonstrate the excellent scalability of our distributed implementation on very large networks, effectively providing a solution to previously unreachable problem instances.
Acknowledgements
--
Keywords
Matrix inverse,Monte Carlo,Distributed computation,Network metrics
Fields of Science and Technology Classification
- Computer and Information Sciences - Natural Sciences
Funding Records
Funding Reference | Funding Entity |
---|---|
UIDB/50021/2020 | Fundação para a Ciência e a Tecnologia |
PID2019-107255GB | Generalitat de Catalunya |
PID2019-107255GB | Spanish Ministry of Science and Technology |
Contributions to the Sustainable Development Goals of the United Nations
With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific publications with the Sustainable Development Goals is now available in Ciência-IUL. These are the Sustainable Development Goals identified by the author(s) for this publication. For more detailed information on the Sustainable Development Goals, click here.