Schade, dass OpenAI Sky gekauft und als Mac App Codex veröffentlicht hat.
So ähnlich sollte Siri funktionieren, siehe Video. Sky versteht auf magische Weise ("der Laie staunt, der Fachmann wundert sich") den Inhalt des aktuellen Fensters und man sagt Sky was es tun soll in natürlicher Sprache. Beide command Tasten gleichzeitig tippen macht einen sogenannten Skyshot des aktiven Fensters; das ist viel mehr als ein Bildschirmfoto.
Sky erstellt Automatisierungen in natürlicher Sprache.
»There is virtually no learning curve to Sky; you can just start typing to get things done.«
»Sky is another turning point for how I get things done on my computer.«
»Sky comes with a collection of built-in “tools” for Calendar, Messages, Notes, web browsing, Finder, email, and screenshots, which allow anyone to get started and ask questions that perform actions with those apps. If you want to turn a webpage shown in Safari into an event in your calendar, or perhaps a document in Apple Notes, you can just ask in natural language out of the box.
At the same time, Sky allows power users to make their own tools that combine custom LLM prompts with actions powered by Shortcuts, shell scripts, AppleScript, custom instructions, and, down the road, even MCP. All of these custom tools become native features of Sky that can be invoked and mixed with natural language.«
Sky Video: https://www.youtube.com/watch?v=5eZa66g8uwY
Sky: https://www.macstories.net/stories/sky-for-mac-preview/
Codex: https://www.macstories.net/notes/openais-new-codex-app-has-the-best-computer-use-feature-ive-ever-tested/#Usability#AI#FutureOfUx