DevicesWorld: Benchmarking Cross-Device Agents in Heterogeneous Environments
arXiv cs.CL2w4 min read
arXiv:2607.13465v1 Announce Type: new Abstract: LLM-based agents have rapidly improved at operating individual digital environments such as mobile applications, desktop systems, and smart homes. However, real-world user goals often span multiple devices: information may come from a phone, be processed on a desktop, and the result may need to appear on another device. Most existing benchmarks center on a single dominant execution environment, making it difficult to evaluate whether agents can acquire and integrate information across heterogeneous devices and complete end-to-end tasks with cross