New benchmark and training method show real-time LLM agents struggle when environments evolve during inference
A new benchmark called RealtimeBench evaluates LLM agents in six game types with 180 tasks while environments continue running during inference.