Image and Video Data Analytics
Image and Video Data Analytics
Description

This project aims to explore new research problems that can be solved by using image and video data analysis. This project will be developed in collaboration with the Lisbon City Council (CML) and addresses challenges that CML launched for the scientific community. The area topic to be addressed is computer vision for knowledge extraction based on aerial and street-level city imagery. We propose a new multi-spatial scale urban fabric dataset and a novel convolutional neural network solution for urban fabric classification tasks. Considering the challenges launched by CML and the already established collaboration between Iscte and CML, this project proposes to explore solutions to a set of urban classification problems by using video and image analysis. In this topic the goal is to identify features of the city shape, namely: i) to estimate the existence of unregistered greenspaces, as green rooftops (since CML is not currently aware of most green rooftops existing in Lisbon) and green back yards (not registered in the city council); ii) to estimate the height and deployment shape and area of Lisbon’s buildings, which will enable to develop an automatic and constantly updated tri-dimensional urban fabric map for Lisbon; iii) to estimate and automatically classify the conservation state of buildings’ facades; iv) among others. Such a methodology will be initially based on the set of aerial and street-level images obtained from CML (during the period of the scholarship). We are also considering exploiting existing city plans freely available at OpenStreetMaps to boost the convolutional neural network's training process, as well as to improve its inference performance. In a second phase, we will explore the use of other types of images such as from google street viewer and the ones directly collected by cameras in drones or city council vehicles (e.g., garbage trucks). For this second phase, we envision submitting a proposal to competitive funding and propose this topic as a master dissertation. The proposed project is multidisciplinary, inter-group (SSE and DLS), and aligns with ISTAR core lines of Smart Cities and Digital Transformation.

Internal Partners
Research Centre Research Group Role in Project Begin Date End Date
ISTAR-Iscte Software Systems Engineering Partner 2021-09-01 2022-02-28
External Partners

No records found.

Project Team
Name Affiliation Role in Project Begin Date End Date
Joao C Ferreira or Joao Ferreira Professor Auxiliar (com Agregação) (DTDA); Integrated Researcher (ISTAR-Iscte); Global Coordinator 2021-09-01 2022-02-28
Sara Eloy Associate Researcher (ISTAR-Iscte); Researcher 2021-09-01 2022-02-28
Tiago Fonseca -- Researcher 2021-09-01 2022-02-28
Tomás Gomes Silva Serpa Brandão Professor Auxiliar (DCTI); Integrated Researcher (ISTAR-Iscte); Researcher 2021-09-01 2022-02-28
Project Fundings
Reference/Code Funding DOI Funding Type Funding Program Funding Amount (Global) Funding Amount (Local) Begin Date End Date
UIDP/04466/2020 -- Contract FCT - Financiamento Plurianual de Unidades de ID - Portugal 5900 5900 2021-09-01 2022-02-28
Publication Outputs
Year Publication Type Full Reference
N/A Scientific journal paper Raposo, M., Eloy, S. & Dias, M. S. (N/A). Housing customization: envisioning an interface to support co-design processes. Archnet-IJAR International Journal of Architectural Research. N/A
N/A Scientific journal paper Marques, L., Moro, S. & Ramos, P. (N/A). Data-driven insights to reduce uncertainty from disruptive events in passenger railways. Public Transport. N/A
N/A Scientific journal paper Pinto, F., Ferreira da Silva, C., Moro, S. & Aquino, P. (N/A). Consumer-controlled digital twin architecture: How blockchain technology gives consumers control over their smart devices’ digital twins and data. Blockchain: Research and Applications. N/A
N/A Scientific journal paper Costa, M., Machado Alexandre, I., Boaventura, D. & Santana, P. (N/A). Transforming children’s knowledge and perception of sharks through a serious game. Journal of Computers in Education. N/A
2025 Scientific journal paper Talafidaryani, M., Jalali, S. M. J. & Moro, S. (2025). Tracing the evolution of digitalisation research in business and management fields: Bibliometric analysis, topic modelling and deep learning trend forecasting. Journal of Information Science. 51 (4), 852-880
2025 Scientific journal paper Relvas, T., Mariano, P., Almeida, S. M. & Santana, P. (2025). A serious game for raising air pollution perception in children. Journal of Computers in Education. 12 (1), 133-163
2025 Scientific journal paper Vong, A. P. I. & Trigueiros, D. (2025). Improved methods for identifying the operational determinants of a bank’s capital ratio. Applied Economics. 57 (33), 5001-5014
2025 Scientific journal paper Noetzold, D., Rossetto, A. G. de M., Barbosa, J. L. V. & Leithardt, V. R. Q. (2025). Investigation and optimization of StringDeduplication with custom heuristic in different versions of the JVM. IEEE Latin America Transactions. 23 (1), 43-49
2025 Scientific journal paper Duarte, M., Ferreira da Silva, C. & Moro, S. (2025). Machine learning models to predict the COVID-19 reproduction rate: Combining non-pharmaceutical interventions with sociodemographic and cultural characteristics. Informatics for Health and Social Care. 50 (2), 81-99
2025 Scientific journal paper Parece, S., Resende, R. & Rato, V. (2025). BIM-based life cycle assessment: A systematic review on automation and decision-making during design. Building and Environment. 282
2025 Scientific journal paper Neto, E. G. V., Peixoto Jr., S. A., Leithardt, V. R. Q., Santana, J. F. P. & Anjos, J. C. S. dos. (2025). Adding data quality to federated learning performance improvement. IEEE Access. 13, 126623-126648
2025 Scientific journal paper Parece, S., Resende, R. & Rato, V. (2025). Stakeholder perspectives on BIM-LCA integration in building design: Adoption, challenges, and future directions. Building and Environment. 284
2025 Scientific journal paper Figueiredo, M., Eloy, S. & Marques, S. (2025). Age-friendly cities and active mobility: A thematic analysis based on immersive 360-degree video elicitation. Cities. 166
2025 Scientific journal paper Pascoal, R., Almeida, A. M. de. & Sofia, R. C. (2025). Reducing information overload with machine learning in mobile pervasive augmented reality systems. IEEE Access. 13, 155155-155166
2025 Scientific journal paper Guerra, R., Carvalho, P., Marques, C., Carmona, M., Sarroeira, R., Batista, F....Silva, C. (2025). Unpacking online hate speech in Portuguese social media: A social-psychological and linguistic-discursive approach. Humanities and Social Sciences Communications. 12
2024 Scientific journal paper Ribeiro, P., Ramos, R. F. & Moro, S. (2024). Restaurant containment measures and perceived service quality: Implications for future pandemics. Consumer Behavior in Tourism and Hospitality. 19 (1), 116-130
2024 Scientific journal paper Zhao, T., Gasiba, T., Pinto-Albuquerque, M. & Lechner, U. (2024). Thriving in the era of hybrid work: Raising cybersecurity awareness using serious games in industry trainings. Journal of Systems and Software. 210
2024 Scientific journal paper Fernandes, E., Moro, S. & Cortez, P. (2024). A data-driven approach to improve online consumer subscriptions by combining data visualization and machine learning methods. International Journal of Consumer Studies. 48 (2)
2024 Scientific journal paper Correia, R. M., Guerreiro, R. & Brandão, F. J. S. (2024). Quais são as zonas de Lisboa com altas densidades de anúncios Airbnb?. Rossio. Estudos de Lisboa. 10, 222-236
2024 Scientific journal paper Câmara, A., Almeida, A. de. & Oliveira, J. (2024). Transforming the CIDOC-CRM model into a megalithic monument property graph. Journal of Computer Applications in Archaeology. 7 (1), 213-224
2024 Scientific journal paper Curado, M. T., Resende, R. & Rato, V. M. (2024). Circular economy: Current view from the construction industry based on published definitions. Sustainability: Science, Practice and Policy. 20 (1)
2024 Scientific journal paper Parece, S., Resende, R. & Rato, V. (2024). A BIM-based tool for embodied carbon assessment using a construction classification system. Developments in the Built Environment. 19
2024 Scientific journal paper Gonçalves, A. M., Brandão, T. & Ferreira, J. C. (2024). Wildfire detection with deep learning—A case study for the CICLOPE project. IEEE Access. 12, 82095-82110
2024 Scientific journal paper Sampaio de Almeida, D., Brito e Abreu, F. & Boavida-Portugal, I. (2024). Agent-based simulation of non-urgent egress from mass events in open public spaces. Simulation Modelling Practice and Theory. 136
2024 Scientific journal paper Rio, A., Brito e Abreu, F. & Mendes, D. (2024). Causal inference of server- and client-side code smells in web apps evolution. Empirical Software Engineering. 29 (5)
2024 Scientific journal paper Biscaia, R., Ramos, R. F., Yoshida, M. & Kim, Y. (2024). Service quality in spectator sports: A review and research agenda. International Journal of Consumer Studies. 48 (6)
2024 Scientific journal paper Napoli, O. O., Almeida, A. M. de., Borin, E. & Breternitz Jr., M. (2024). Memory-efficient DRASiW models. Neurocomputing. 610
2024 Scientific journal paper Noetzold, D., Rossetto, A. G. de M., Silva, L. A., Crocker, P. & Leithardt, V. R. Q. (2024). JVM optimization: An empirical analysis of JVM configurations for enhanced web application performance. SoftwareX. 28
2024 Scientific journal paper Noetzold, D., Rossetto, A. G. D. M., Leithardt, V. R. Q. & Costa, H. J. de M. (2024). Enhancing infrastructure observability: Machine learning for proactive monitoring and anomaly detection . Journal of Internet Services and Applications. 15 (1), 508-522
2024 Scientific journal paper Raposo, M., Eloy, S. & Dias, M. S. (2024). Bridging the gap in customised housing design: Integrating a graphic user interface for user collaboration. PLoS One. 19 (12)
2024 Publication in conference proceedings Duwadi, S. & Coutinho, C. (2024). ChatGPT based recommendation system for retail shops. In Nuno Mateus-Coelho, Manuela Cruz-Cunha (Ed.), Procedia Computer Science. (pp. 253-260). Lisboa: Elsevier.
2024 Publication in conference proceedings Brito e Abreu, F., Marinheiro, R. N., Boavida-Portugal, I., Lopes, A., Santos, T., Sampaio de Almeida, D....Simões, R. (2024). A digital transformation approach to scaffold tourism crowding management: Pre-factum, on-factum, and post-factum. In Proceedings - 2024 Joint International Conference on Digital Arts, Media and Technology with ECTI Northern Section Conference on Electrical, Electronics, Computer and Telecommunications Engineering, ECTI DAMT and NCON 2024. (pp. 586-591). Chiang-mai, Thailand: IEEE.
2024 Publication in conference proceedings Parece, S., Silva Pedro, T., Gonçalves, T., Rodrigues, P. & Resende, R. (2024). Uma ferramenta baseada em BIM para a avaliação expedita do carbono incorporado utilizando o sistema de classificação SECClasS. In António Aguiar Costa, Miguel Azenha (Ed.), 5º Congresso Português de Building Information Modelling. (pp. 223-235). Lisboa: UMinho Editora.
2024 Publication in conference proceedings Narciso, J. & Sampayo, M. (2024). Traditional city, invaded city, and reconquered city: The experiences of re-functionalization of Praca da Figueira in Lisbon (1885-2023). In M. Drusa, M. Kadela, J. Rybak, A. Segalini and P. Krušinský (Ed.), MATEC Web of Conferences, Proceedings. Prague: EDP Sciences.
2024 Publication in conference proceedings Sampayo, M. & Rodrigues, D. (2024). Exploring isovist fields: A comparative study of churches in reconstruction plans for postearthquake Lisbon. In M. Drusa, M. Kadela, J. Rybak, A. Segalini, & P. Krušinský (Ed.), MATEC Web of Conferences, Proceedings. Prague: EDP Sciences.
2024 Publication in conference proceedings Murta, J., Amaral, V. & Brito e Abreu, F. (2024). Trusted evidences on the digital transformation of classic cars restoration. In Longo F., Shen W., Padovano A. (Ed.), Procedia Computer Science. (pp. 254-263). Lisboa: Elsevier.
2024 Publication in conference proceedings Silva, D., Coutinho, C. & Costa, C. J. (2024). Exploration of open source in low-income countries: Review and future research directions. In 2024 International Symposium on Sensing and Instrumentation in 5G and IoT Era (ISSI). Lagoa, Portugal: IEEE.
2024 Publication in conference proceedings Andrade, M. A. P. & Teodoro, M. F. (2024). Portuguese service electricity continuity indicators: Quality service evaluation. In Martin Golubitsky, Walter Lacarnobara, Carla M.A. Pinto, Lurdes Babo, Jorge Mendonça, Fernando Carvalho, Rui Rocha (Ed.), International Conference on Mathematical Analysis and Applications in Science and Engineering –ICMASC’24: Book of abstracts. (pp. 151-152).: ISEP - Instituto Superior de Engenharia do Porto.
2024 Publication in conference proceedings Teodoro, M. F., Andrade, M. A. P. & Oliveira, T. A. (2024). Crossover design on the bioequivalence of pharmaceuticals: A case of study. In Osvaldo Gervasi, Beniamino Murgante, Chiara Garau, David Taniar, Ana Maria A. C. Rocha, Maria Noelia Faginas Lago (Ed.), Computational Science and Its Applications – ICCSA 2024 Workshops. ICCSA 2024. Lecture Notes in Computer Science. (pp. 219-234). Hanoi: Springer.
2024 Publication in conference proceedings Figueira, J. & Coutinho, C. (2024). Developing self-adaptive microservices. In Francesco Longo , Weiming Shen, Antonio Padovano (Ed.), Procedia Computer Science. (pp. 264-273). Lisboa: Elsevier.
2024 Publication in conference proceedings Silva, D., Mataloto, B. & Coutinho, C. (2024). Smart IoT lightning system for energy consumption optimization. In 2024 International Symposium on Sensing and Instrumentation in 5G and IoT Era (ISSI). Lagoa, Portugal: IEEE.
2024 Publication in conference proceedings Freira, D. & Coutinho, C. (2024). Wildfire detection based on IoT technology. In ISMSIT 2024 - 8th International Symposium on Multidisciplinary Studies and Innovative Technologies, Proceedings. Ankara, Turkiye: IEEE.
2024 Publication in conference proceedings Silva, D. & Coutinho, C. (2024). Cloud-based documental management system: A bibliometric review analysis. In ISMSIT 2024 - 8th International Symposium on Multidisciplinary Studies and Innovative Technologies, Proceedings. Ankara, Turkiye: IEEE.
2024 Publication in conference proceedings Soares, J. & Coutinho, C. (2024). Urban issue reporting applications towards government 2.0. In ISMSIT 2024 - 8th International Symposium on Multidisciplinary Studies and Innovative Technologies, Proceedings. Ankara, Turkiye: IEEE.
2024 Publication in conference proceedings Fernandes, E., Moro, S. & Cortez, P. (2024). Towards a news recommendation system to increase reader engagement through newsletter content personalization. In Maria Manuela Cruz-Cunha, Dulce Domingos, Emanuel Peres, Rui Rijo (Ed.), Procedia Computer Science. (pp. 217-225). Porto: Elsevier BV.
2023 Scientific journal paper Sarroeira, R., Henriques, J., Sousa, A. M., Ferreira da Silva, C., Nunes, N., Moro, S....Botelho, M. do C. (2023). Monitoring sensors for urban air quality: The case of the municipality of Lisbon. Sensors. 23 (18)
2023 Book chapter Stellacci, S. & Eloy, S. (2023). Digital pathways for enriched communities and futures: Plantation heritage in São Tomé and Príncipe. In Danilo Giglitto, Luigina Ciolfi, Eleanor Lockley, Eirini Kaldeli (Ed.), Digital approaches to inclusion and participation in cultural heritage: Insights from research and practice in Europe. (pp. 27-51). Abingdon, NY: Routledge.
2023 Book chapter Botelho, M.do C., Nunes, N., Ferreira da Silva, C., Alexandre, I., Guerreiro, M. D. & Sousa, M. (2023). International mobility challenges in higher education in the digital era. In Maria José Sousa, Andreia de Bem Machado, Gertrudes Aparecida Dandolini (Ed.), Technologies for sustainable global higher education. (pp. 187-210). London: Routledge.
2023 Publication in conference proceedings Paes, A,, Stellacci, S. & Eloy, S. (2023). Na busca de identidade: Apropriações realizadas por moradores em quatros bairros municipais do concelho de Loures. In SIIU 2023: XV Seminario Internacional de Investigación en Urbanismo, Lisboa. Lisbon: Universitat Politècnica de Catalunya.
2023 Publication in conference proceedings Gonçalves, J. A. & Santos, A. L. (2023). Jinter: A hint generation system for Java exercises. In Laakso, M.-J., and Monga, M. (Ed.), ITiCSE 2023: Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education. (pp. 375-381). Turku Finland: Association for Computing Machinery.
2023 Publication in conference proceedings Castro, A. & Coutinho, C. (2023). Electronic voting through blockchain: A survey. In Y. I. Sokol (Ed.), HORA 2023 - 2023 5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications, Proceedings. Istanbul, Turkiye: IEEE.
2023 Publication in conference proceedings Lopes, J. F. & Santos, A. L. (2023). PescaJ: A projectional editor for Java featuring scattered code aggregation. In Tom Beckmann, Robert Hirschfeld, Juan Pablo Sáenz, Mauricio Verano Merino (Ed.), PAINT 2023: Proceedings of the 2nd ACM SIGPLAN International Workshop on Programming Abstractions and Interactive Notations, Tools, and Environments. (pp. 44-50). Cascais, Portugal: Association for Computing Machinery.
2023 Publication in conference proceedings Luz, R., Pereira, A., Corujeira, J., Krueger, T., Beck, J., Den Exter, E....Ventura, R. (2023). Feeling the slope?: Teleoperation of a mobile robot using a 7DOF haptic device with attitude feedback. In 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). (pp. 392-398). Busan, Republic of Korea: IEEE.
2022 Scientific journal paper Costa, J. M., Miranda, G. & Melo, M. (2022). The four-component instructional design model (4C/ID): A meta-analysis on use and effect. Learning Environments Research. 25 (2), 445-463
2022 Scientific journal paper del Rocío Roldán-Molina, G., Yevseyeva, I., Gómez-Meire, S., Basto-Fernandes, V. & Ramón Méndez, J. (2022). Automatic knowledge exchange between ontologies and semantic graphs. Journal of Information Science. 51 (2), 310-323
2022 Publication in conference proceedings Santos, A. L., Soares, T., Garrido, N. & Lehtinen, T. (2022). Jask: Generation of questions about learners’ code in Java. In Brett A. Becker, Keith Quille, Mikko-Jussi Laakso, (Ed.), ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education. (pp. 117-123). Dublin: Association for Computing Machinery.
2022 Publication in conference proceedings Susskind, Z., Arora, A., Miranda, I. D. S., Villon, L. A. Q., Katopodis, R. F., Araújo, L. S. de....John, L. K. (2022). Weightless neural networks for efficient edge inference. In Andreas Kloeckner, José Moreira (Ed.), PACT '22: Proceedings of the International Conference on Parallel Architectures and Compilation Techniques. (pp. 279-290). Chicago, Illinois: Association for Computing Machinery.
2022 Publication in conference proceedings Vieira, M. A. R., Sampayo, M. & Cunha, J. (2022). Um modelo visitado da arquitetura chã: as igrejas de São Miguel nos Açores. In ICEUBI2022 - International Congress on Engineering: Innovation and Sustainability Praxis. Covilhã: UBI.
2022 Review article Pereira dos Reis, J., Brito e Abreu, F., Carneiro, G. & Anslow, C. (2022). Code smells detection and visualization: A systematic literature review. Archives of Computational Methods in Engineering. 29, 47-94
2022 Review article Moro, S. & Rita, P. (2022). Data and text mining from online reviews: a literature analysis. Wiley Interdisciplinary Reviews-Data Mining and Knowledge Discovery. 12 (3)
2022 Review article Pinto, F., Ferreira da Silva, C. & Moro, S. (2022). People-centered Distributed Ledger Technology-IoT architectures: A systematic literature review. Telematics and Informatics. 70
Related Research Data Records

No records found.

Related References in the Media

No records found.

Other Outputs

No records found.

Project Files

No records found.

With the objective to increase the research activity directed towards the achievement of the United Nations 2030 Sustainable Development Goals, the possibility of associating scientific projects with the Sustainable Development Goals is now available in Ciência_Iscte. These are the Sustainable Development Goals identified for this project. For more detailed information on the Sustainable Development Goals, click here.

Image and Video Data Analytics
2021-09-01
2022-02-28