VLM

When we talk about AI agents that can “use a computer like a human,” most of today’s leaders—Claude, GPT-4o, Seed 1.5—are locked in proprietary vaults. This means the critical details that make them competent in high-stakes desktop workflows—training data, error recovery strategies, evaluation methods—are inaccessible to the wider research and business community. OpenCUA aims to change that, not by chasing hype, but by releasing the entire stack: tools, datasets, models, and benchmarks. ...

When large language models (LLMs) learned to think step-by-step, the world took notice. Chain-of-Thought (CoT) reasoning breathed new life into multi-step arithmetic, logic, and even moral decision-making. But as multimodal AI evolved, researchers tried to bring this paradigm into the visual world — by editing images step-by-step instead of all at once. And it failed. In the recent benchmark study Complex-Edit: CoT-Like Instruction Generation for Complexity-Controllable Image Editing Benchmark1, the authors show that CoT-style image editing — what they call sequential editing — not only fails to improve results, but often worsens them. Compared to applying a single, complex instruction all at once, breaking it into sub-instructions causes notable drops in instruction-following, identity preservation, and perceptual quality. ...

A next-generation vision-language model by Google, combining Gemma LLM and SigLIP vision encoder for image captioning, VQA, and image-text reasoning tasks.