Part 3/11:
The standout addition in Claude 3.5 Sonet is what Anthropic calls computer use. Currently available in open beta for developers, this feature allows Claude to interact with desktop applications by analyzing screenshots, moving the cursor, clicking, scrolling, zooming, and typing.
According to Anthropic, the AI can perform these actions at speeds comparable to a human user—an impressive feat. However, it’s important to note that it’s not flawless: the system is sometimes slow, error-prone, or misses basic actions. For example, it may struggle with scrolling or zooming, and some tasks only succeed about half of the time during testing.