** Anthropic Unveils Claude Models with Enhanced Capabilities and Computer Interaction Feature. The company has released new models, Claude 3.5 Haiku and an improved version of Claude 3.5 Sonnet, which showcase significant performance improvements on coding benchmarks. Additionally, the upgraded Claude 3.5 Sonnet features a novel "computer use" ability that enables it to interact with computer interfaces like humans do.

This feature allows the model to interpret images on the screen, move the mouse pointer, click buttons, and enter text via a virtual keyboard. While users and experts see potential for automating business processes, Anthropic notes the current limitations of this feature, which remains slow and often error-prone.

The company is now in public beta with this new capability and encourages users to try it out while providing example code on GitHub. As researchers continue to explore the possibilities and challenges of AI development, the discussion around Claude's capabilities highlights the complexities involved.

**

Source: https://www.infoq.com/news/2024/11/anthropic-claude-computer-use/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=global