- The Intelligent Worker
- Posts
- LLMs can control your computer
LLMs can control your computer
📐 New Claude feature + 💻 Apple Intelligence getting rolled out
In partnership with
Hi everyone,
Anthropic just shipped an upgrade to Claude - the LLM can now control your computer. It’s still in early stages, but LLMs taking actions is really the next big leap of productivity tools.
Let’s get right into it.
In this issue:
🤝In Partnership: Learn more in less time with Shortform
🤿Deep Dive: Apple’s iOS 18.2 Beta 1
🖼️AI Art: Examples of great and trending AI art
🤿Deep Dive: Computer use capability on Claude’s upgrade
⚒️Tool Snapshots: Tools for AI, no-code, and productivity
📰Top News: News on AI, no-code, and productivity
🤝IN PARTNERSHIP WITH SHORTFORM
Get More from Books in Less Time!
Feeling overwhelmed by your reading list? Shortform makes it easier! Whether you’re focused on self-improvement, business, or psychology, Shortform offers in-depth book guides with summaries, actionable insights, and exercises to help you apply what you’ve learned right away. Master key lessons from Atomic Habits in just 2 hours, and start accelerating your career, skyrocketing your productivity, and achieving personal growth faster.
Stay ahead of trends with new book summaries every week. Plus, use the AI browser extension to quickly summarize internet articles and videos, freeing up time for what matters most.
🤿 DEEP DIVE
Apple's First iOS 18.2 Developer Beta Introduces More AI Features and ChatGPT Integration
Intelligence: Apple has released its first developer beta of iOS 18.2, which includes new AI features, such as Genmoji for emoji generation, Image Playground for image creation, and integration with ChatGPT.
The new beta offers 'Visual Intelligence', enabling users to search via their camera on iPhone 16.
iOS 18.2 is the second batch of Apple Intelligence features. The first batch, including smarter Siri and notification summaries, is set to launch with iOS 18.1.
Apple originally introduced the Apple Intelligence features at WWDC 2024, stating that the upgrades would be implemented in stages.
Although Siri's ability to understand and respond to on-screen activity was announced, it is not yet available in iOS 18.2.
The first macOS Sequoia 15.2 developer beta has also been released. It features new Apple Intelligence tools but excludes Genmoji.
🖼️ AI ART
Examples of great and trending AI art
“Food as Warriors”, created by Monsterulez using Midjourney. Will you eat them?
🤿 DEEP DIVE
Launch of Upgraded Claude 3.5 Sonnet and Claude 3.5 Haiku Models with New Computer Use Capability
Intelligence: A new upgrade to the Claude 3.5 Sonnet and the introduction of Claude 3.5 Haiku have been announced. These upgrades feature across-the-board improvements, particularly in coding. A groundbreaking public beta feature, computer use, allows Claude to operate computers as humans do.
The upgraded Claude 3.5 Sonnet has shown significant improvements in coding and tool use tasks. Companies like GitLab, Cognition, and The Browser Company have reported strong results using the model.
The new Claude 3.5 Haiku matches the performance of Claude 3 Opus, the company's previous largest model, excelling particularly in coding tasks.
The computer use feature, available on the API, allows developers to direct Claude to use computers like humans do, though it is still in an experimental phase.
Companies such as Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company are exploring the possibilities of this new capability.
The models were tested pre-deployment by the US AI Safety Institute and the UK Safety Institute and were evaluated for catastrophic risks.
⚒️ TOOL SNAPSHOTS
Futuristic tools within AI, no-code, and productivity
🤖 AI Desk - Real-time, multilingual customer service via live chat. Free to try.
📊 Glazed - Interactive funnels for prioritized business-driving UI design. Free to try.
🗂 Kommunicate with Spreadsheets - Chatbot training for real-time data insights. Free to try.
🐞 Replicate - Simplify bug reporting and speed up resolution with visuals. Free option available.
📲 OpenPhone API - Streamline communications & CRM updates across devices. Free to try.
📰 TOP NEWS
News on AI, no-code, automation, and productivity
Ideogram has launched Canvas, which offers unlimited creative space and features AI-powered tools, Magic Fill and Extend, enhancing edits, blending visuals, and molding designs all in one place. Perfect for both novice and experienced designers.
In response to News Corp's lawsuit, Perplexity retorts with a fiery blog post claiming media corporations wish AI tools didn't exist, conveniently sidesteps the lawsuit's core claim of mass content infringement, and engages in speculation about News Corp's potential case strategy.
Notion is teasing its upcoming email client, named 'Notion Mail', aimed at providing a flexible workflow-oriented inbox. Launching 'soon,' it comes with AI integrations for smart filtering and scheduling, a feature that allows prioritizing emails within filtered views, and a connection with the Notion Calendar for more straightforward scheduling. But there's a big question mark on the specifics and how well these cool features will work in practice.
Google’s proprietary text watermarking tool SynthID is now open-source, allowing developers to identify whether text outputs are generated from their models. The tool marks texts with barely noticeable changes in probability scores, an effective move against the misuse of AI in spreading false information or malicious content. However, Google acknowledges it's not foolproof and still struggles to watermark short, modified, or translated text.
ℹ️ ABOUT US
The Intelligent Worker helps you to be more productive at work with AI, automation, no-code, and other technologies.
We like real, practical, and tangible use-cases and hate hand-wavy, theoretical, and abstract concepts that don’t drive real-world outcomes.
Our mission is to empower individuals, boost their productivity, and future-proof their careers.
We read all your comments - please provide your feedback!
Did you like today's email?Your feedback is more valuable to us than coffee on a Monday morning! |
What more do you want to see in this newsletter?Please vote |