Export Publication

Fachada, N., Fernandes, D., Fernandes, C. M. & Matos-Carvalho, J. P. (2026). Can large language models implement agent-based models? An ODD-based replication study. Ecological Modelling. 517

N. Fachada et al.,  "Can large language models implement agent-based models? An ODD-based replication study", in Ecological Modelling, vol. 517, 2026

@article{fachada2026_1784169884419,
	author = "Fachada, N. and Fernandes, D. and Fernandes, C. M. and Matos-Carvalho, J. P.",
	title = "Can large language models implement agent-based models? An ODD-based replication study",
	journal = "Ecological Modelling",
	year = "2026",
	volume = "517",
	number = "",
	doi = "10.1016/j.ecolmodel.2026.111624",
	url = "https://www.sciencedirect.com/journal/ecological-modelling"
}

TY  - JOUR
TI  - Can large language models implement agent-based models? An ODD-based replication study
T2  - Ecological Modelling
VL  - 517
AU  - Fachada, N.
AU  - Fernandes, D.
AU  - Fernandes, C. M.
AU  - Matos-Carvalho, J. P.
PY  - 2026
SN  - 0304-3800
DO  - 10.1016/j.ecolmodel.2026.111624
UR  - https://www.sciencedirect.com/journal/ecological-modelling
AB  - Large language models (LLMs) can now synthesize non-trivial executable code from textual descriptions, raising an important question: can LLMs reliably implement agent-based models from standardized specifications in a way that supports replication, verification, and validation? We address this question by evaluating 17 contemporary LLMs on a controlled ODD-to-code translation task, using the PPHPC predator–prey model as a fully specified reference. Generated Python implementations are assessed through staged executability checks, model-independent statistical comparison against a validated NetLogo baseline, and quantitative measures of runtime efficiency and maintainability. Results show that behaviorally faithful implementations are achievable but not guaranteed, and that executability alone is insufficient for scientific use. GPT-4.1 consistently produces statistically valid and efficient implementations, with Claude 3.7 Sonnet performing well but less reliably. Overall, the findings clarify both the promise and current limitations of LLMs as model engineering tools, with implications for reproducible agent-based and ecological modeling.
ER  -