Study proposes AI-driven method to discover reusable simulation models via natural language queries
Experimental results show open-source embedding models and reranking improve retrieval performance for model-finding tasks, with implications for composability in modeling and simulation.
1 source · cross-referenced
- Researchers propose an AI-driven approach to discover reusable simulation models using natural language queries.
- Open-source embedding models and reranking methods significantly improve retrieval performance, especially for complex queries.
- The study evaluates performance using recall@5 and nDCG@5 metrics, establishing a baseline for AI-driven model discovery.
- Findings suggest data representation and retrieval strategies are critical for effective model-finding in large repositories.
A new arXiv preprint presents an experimental study on using AI to discover reusable simulation models from natural language queries. The work, titled 'How Can AI Find My Model? A Model-Finding Experimental Study Considering Data Formats, Embeddings, and Retrieval Strategies,' evaluates how data representation, transformer-based embeddings, and retrieval strategies affect the accuracy of model retrieval.
The authors report that data representation choices and reranking methods significantly influence performance, particularly as query complexity increases. They find that open-source embedding models can achieve high performance on standard information retrieval metrics, including recall@5 and nDCG@5.
The study positions its findings as a baseline for AI-driven model discovery, emphasizing the role of such systems in advancing toward AI-driven composability and interoperability in modeling and simulation. The paper has been accepted for publication in the Proceedings of the 2026 Winter Simulation Conference (WSC 2026).
The research team includes authors from Old Dominion University and other institutions, and the work is supported by major funders as acknowledged in the preprint. The authors propose that their approach could help practitioners more efficiently locate and reuse models, reducing duplication and improving workflow integration.
- Jul 1, 2026 · arXiv cs.AI
Study finds external feedback drives agent improvement more than self-feedback or unguided refinement
Trust79 - Jul 1, 2026 · arXiv cs.AI
Contrastive Reflection framework improves agentic IR prompt accuracy by 9 percentage points on HotpotQA
Trust79 - Jun 30, 2026 · Hugging Face
Hugging Face-affiliated team argues AI specialization is theoretically inevitable
Trust71