Metas’ smash-hit AI agent Muse is coming to Windows PCs as a native app!
6 14 3 195 16.2K 13
David Singleton
@dps
Meta Superintelligence Labs @meta
formerly CEO & cofounder at @dreamer, CTO @stripe.
❤️ @fjsingleton.
I like to make things.
26.7KFollowers
1.5KFollowing
2.1KPosts
358Media
5KLikes
@dps reposted
@dps reposted
🚨 MUSE ALERT 🚨
the muse ipad app is out now!!
check it out for all your tablet superintelligence needs :))
the muse ipad app is out now!!
check it out for all your tablet superintelligence needs :))
199 72 35 1.7K 177K 73
Today we’re previewing our work to build an open standard @Meta (@muse and Meta Business Agent) and Sierra are developing along with industry partners at Genesys, NiCE, Decagon, Rocket, Shopify, Stripe, and Walmart that defines how personal agents interact with businesses.
What motivates this work is making things even better. More frictionless for people using Muse, and better for the businesses serving our shared customers.
Excited to build this together.
What motivates this work is making things even better. More frictionless for people using Muse, and better for the businesses serving our shared customers.
Excited to build this together.
15 14 3 215 15.6K 23
My personal favorite Muse gadget hack so far - an ambient eInk display that sits above my keyboard where my @Muse pushes useful, fun or interesting content throughout the day.
34 17 17 748 85.1K 219
Excited to open source the Muse Gadgets SDK today! You can connect your DIY electronics like ESP32 boards and Raspberry Pi to Muse. Build an e-ink morning briefing, a push-to-talk pocket device, a sysadmin for your homelab, and much more. Details at gadgets.muse.ai
Nat Friedman@natfriedman · Oct 2🚨 side project alert 🚨
Announcing Muse Gadgets, an open source ESP32 firmware and Linux sdk so that you can make hardware devices that work with Muse.
Grab an API token from gadgets.muse.ai and point your favorite coding agent at the github repo to build your own peripherals for Muse.
Announcing Muse Gadgets, an open source ESP32 firmware and Linux sdk so that you can make hardware devices that work with Muse.
Grab an API token from gadgets.muse.ai and point your favorite coding agent at the github repo to build your own peripherals for Muse.
Open quoted post →
28 38 10 592 35K 283
David from the Muse team here. I responded to Matt on Threads and sent him a couple of DMs offering to help and look into what happened.
In the past, when we’ve worked with users to investigate similar reports, we’ve consistently learned that Muse was following direct instructions and correctly asked for permission. Would love to help and figure out what’s going on here!
In the past, when we’ve worked with users to investigate similar reports, we’ve consistently learned that Muse was following direct instructions and correctly asked for permission. Would love to help and figure out what’s going on here!
Ray Wong@raywongy · Sep 27Deleted Muse after seeing this post on Threads about how it told some Facebook Marketplace sellers the guy’s address and they showed up at his door
Dangerous and creepy
This would have been 1000x worse if the person was a woman
Dangerous and creepy
This would have been 1000x worse if the person was a woman
Open quoted post →
192 51 35 1.6K 418K 341
I’ve seen a couple of posts about this so wanted to demystify. Today, every Muse user gets a free computer in the cloud. It's a real computer, and we’ve designed the security architecture of the Muse Secure VM carefully so you and your Muse can do almost anything you could with a computer sitting under your desk while keeping you and the system safe from threats like prompt injection. We wrote about this at length in our security blog post – security.muse.ai. Activity in the “runtime cell”, which you share with your Muse is unfettered, but sensitive actions are all overseen by the Sentinel, which runs outside of that cell. Similarly, all sensitive secrets - like the passwords you enter into Muse’s secure credential storage - are also stored outside the runtime cell.
The runtime cell gets its own root filesystem (including a full Ubuntu linux image) separate from the host filesystem where your other more sensitive data lives. Because it is isolated from the sensitive stuff that runs on the same box, this means that we can, and do, offer users full visibility and control over the files in the runtime cell. Just as you can when you install Linux on your home computer, you can poke around and see all the files that make the system work - both debian system files and the binaries and data files that implement the parts of Muse which run in the runtime cell.
This was a very deliberate choice - your Muse Secure VM truly is your own computer in the cloud. You can install software in it, write and compile code, use the browser to surf the web: it is your own Linux box that you can operate as you choose with your Muse. Poking around in this computer doesn't give you any privileged access to Meta infrastructure, or to other people's data
If I may geek out a little here for a second… As a kid I loved to take things apart to see how they worked. As a teenager I got into computers and soon found myself drawn to C:\WINDOWS\SYSTEM and the system registry, later Slackware’s /dev/, /proc/ etc – I could see how the system was laid out and as I explored what DLL files and .so files actually did, I gradually became able to meld the computer to my own will.
We’re really proud to be able to put a real computer in millions of people’s hands with a similar level of transparency. We built a file explorer right into the Library tab of the UI. We want you to be able to see the markdown files Muse writes while it thinks about how to serve you better, and explore the internals of the system if you’d like to.
So, when you ask your Muse to show you its entire filesystem, and receive gigabytes of files you’re seeing the full contents of the runtime cell. It’s yours to explore and enjoy!
If you’re not a geek like me, or simply want to download the data that you personally have created directly with your Muse, we added a feature for that too in Settings > Data controls > Download your agent data.
The runtime cell gets its own root filesystem (including a full Ubuntu linux image) separate from the host filesystem where your other more sensitive data lives. Because it is isolated from the sensitive stuff that runs on the same box, this means that we can, and do, offer users full visibility and control over the files in the runtime cell. Just as you can when you install Linux on your home computer, you can poke around and see all the files that make the system work - both debian system files and the binaries and data files that implement the parts of Muse which run in the runtime cell.
This was a very deliberate choice - your Muse Secure VM truly is your own computer in the cloud. You can install software in it, write and compile code, use the browser to surf the web: it is your own Linux box that you can operate as you choose with your Muse. Poking around in this computer doesn't give you any privileged access to Meta infrastructure, or to other people's data
If I may geek out a little here for a second… As a kid I loved to take things apart to see how they worked. As a teenager I got into computers and soon found myself drawn to C:\WINDOWS\SYSTEM and the system registry, later Slackware’s /dev/, /proc/ etc – I could see how the system was laid out and as I explored what DLL files and .so files actually did, I gradually became able to meld the computer to my own will.
We’re really proud to be able to put a real computer in millions of people’s hands with a similar level of transparency. We built a file explorer right into the Library tab of the UI. We want you to be able to see the markdown files Muse writes while it thinks about how to serve you better, and explore the internals of the system if you’d like to.
So, when you ask your Muse to show you its entire filesystem, and receive gigabytes of files you’re seeing the full contents of the runtime cell. It’s yours to explore and enjoy!
If you’re not a geek like me, or simply want to download the data that you personally have created directly with your Muse, we added a feature for that too in Settings > Data controls > Download your agent data.
257 330 195 3.9K 843K 2.7K
I love cooking, so being able to talk to my Muse to go from recipe idea -> shopping list -> ingredients at my door has my mouth watering already!
Instacart@Instacart · Sep 22Instacart is coming to @Muse! Soon, you can connect Instacart, say “Taco Tuesday,” and turn the idea into a cart from your favorite store. Then check out and get groceries delivered to your door. Same Instacart grocery experience, new way to get started. tr.ee/6xWsKG
Open quoted post →
10 2 2 92 13.6K 10
👯
Tarek Sheasha
2 1 0 38 8.4K 1
We appreciate this report and have issued a hotfix to the Muse Mac app. This was a local privilege escalation attack, not a remote exploit. Using it to do harm therefore requires malicious code already running on the user’s machine under their user account and the practical risk to users of the Muse Mac app was therefore quite low. Nonetheless, we have issued a hotfix to the app to address the issue.
We take every report of a possible security problem very seriously, including those that arrive as published exploit code (like this one). We strive to be extremely transparent about privacy and security in Muse as we know this is important to maintain your trust. Therefore, here’s a little more detail on this issue:
- Muse's dictation is powered by a server-side speech model. The app shipped with an internal setting that allows the endpoint used by this feature to be redirected to a different URL, which is useful during debugging and development.
- The setting lives in the app's local preferences, which macOS allows any program running under your user account to modify. Changing this requires malicious code already running on your Mac. This is not remotely exploitable, and it does not involve Muse's servers or the Secure VM that isolates agent tasks.
- Overriding this setting would let an attacker proxy audio dictation requests and capture the access tokens the Muse app uses to drive the Muse agent – expanding malware already present on your computer into the Muse agent. Our hotfix removes the endpoint setting from production builds entirely, which closes this vulnerability.
- We are grateful for the work of the security research community and potential security issues can be responsibly disclosed via our bug bounty program, which pays up to $300,000 for exactly this class of finding. bugbounty.meta.com
We take every report of a possible security problem very seriously, including those that arrive as published exploit code (like this one). We strive to be extremely transparent about privacy and security in Muse as we know this is important to maintain your trust. Therefore, here’s a little more detail on this issue:
- Muse's dictation is powered by a server-side speech model. The app shipped with an internal setting that allows the endpoint used by this feature to be redirected to a different URL, which is useful during debugging and development.
- The setting lives in the app's local preferences, which macOS allows any program running under your user account to modify. Changing this requires malicious code already running on your Mac. This is not remotely exploitable, and it does not involve Muse's servers or the Secure VM that isolates agent tasks.
- Overriding this setting would let an attacker proxy audio dictation requests and capture the access tokens the Muse app uses to drive the Muse agent – expanding malware already present on your computer into the Muse agent. Our hotfix removes the endpoint setting from production builds entirely, which closes this vulnerability.
- We are grateful for the work of the security research community and potential security issues can be responsibly disclosed via our bug bounty program, which pays up to $300,000 for exactly this class of finding. bugbounty.meta.com
Patrick Wardle@patrickwardle · Sep 21Please don't install - it's trivial to turn Muse into the ultimate backdoor 💀👀
Ya, as an AI assistant built to manage your Mac, Muse needs broad access to your digital life.
But serious 0-day flaw(s) can let local malware/attackers invisibly hijack it.
Let me show you. 🧵
Open quoted post →Ya, as an AI assistant built to manage your Mac, Muse needs broad access to your digital life.
But serious 0-day flaw(s) can let local malware/attackers invisibly hijack it.
Let me show you. 🧵
18 15 14 366 79.8K 111
The action button integration is absolutely the fastest way to ask your @Muse to do stuff for you on iOS - including directly from the lock screen. It's sick!
Mike P@mikepat711 · Sep 18Oh shit. Muse has an iPhone action button shortcut that automatically opens voice transcription to your agent. You hold once, talk, hold again to send. You can get into a really good flow just using the action button to keep conversing with your Muse.
Seriously try this. Add it to your action button, and then try having a multi message convo with your Muse by just using the action button.
They nailed this.
Open quoted post →Seriously try this. Add it to your action button, and then try having a multi message convo with your Muse by just using the action button.
They nailed this.
12 12 9 263 197K 139
I've been using the @Muse app on my Mac all day, every day for a while. There are four things it does that I really love:
1/ Quick access to my Muse when I'm working in any other app: ⌥–Space and Octavian appears, ready to help.
2/ Fast SOTA dictation into any app on my computer by holding fn (these shortcuts are configurable, ofc).
3/ The Muse app works with the messaging apps on my computer and helps me keep up. Sorry if I ghosted you before; I can never keep on top of my messages. Muse is already making me a better texter.
4/ My Muse has a little bot status pill that hangs out in the corner and tells me what Octavian is up to on my behalf all day long.
What are you using the Mac app for?
1/ Quick access to my Muse when I'm working in any other app: ⌥–Space and Octavian appears, ready to help.
2/ Fast SOTA dictation into any app on my computer by holding fn (these shortcuts are configurable, ofc).
3/ The Muse app works with the messaging apps on my computer and helps me keep up. Sorry if I ghosted you before; I can never keep on top of my messages. Muse is already making me a better texter.
4/ My Muse has a little bot status pill that hangs out in the corner and tells me what Octavian is up to on my behalf all day long.
What are you using the Mac app for?
Alexandr Wang@alexandr_wang · Sep 17muse for mac is HERE!! your agent can now get stuff done right on your computer — files, messages, calendar, notes, all of it.
you're in control of what it can access, and it always asks before doing anything sensitive.
Add it to the dock - ai.meta.com/muse/download/
you're in control of what it can access, and it always asks before doing anything sensitive.
Add it to the dock - ai.meta.com/muse/download/
GIF 20 6 6 207 37.2K 94
Power user @Muse feature - custom connectors 🔧. Muse has tons of connectors for popular services built in. Even better, Muse can write its own software and run it in the VM you and your Muse share in the cloud. So you can connect Muse to any service with an API.
1:28 52 24 14 560 154K 267
Having a personal avatar in @Muse was the very very first feature I fell in love with. The animations while working or when something great happens are 😍. Making these so consistently Muse while so charmingly unique was worth it, I think!
Christine Awad@christinesed · Sep 11You can customize your @Muse avatar and share it! Try it now on muse.ai/join
0:22 9 0 1 72 11.4K 6
Hot off the presses: all @Muse users can ask their Muse to make an audio podcast episode on any topic.
28 25 14 304 88.5K 65
Muse is out today.
An agent like this is a different kind of system to design. It reads your mail, spends your money, runs your code. Getting that right took real care, and our technical post walks through exactly how. We designed security in.
An agent like this is a different kind of system to design. It reads your mail, spends your money, runs your code. Getting that right took real care, and our technical post walks through exactly how. We designed security in.
46 68 24 1.1K 326K 1.1K
More than half of the text I 'type' into my computer is now dictation via the Meta AI Mac app - has quickly become indispensible 🎤. Get it at meta.ai
Spencer Barnett@spencerbarnett · Aug 19We launched the Meta AI Mac OS app today! 🚀
I particularly love the dictation feature which allows me to dictate anywhere on my computer with ultra high accuracy. Just hold down 'fn' and yap!
I particularly love the dictation feature which allows me to dictate anywhere on my computer with ultra high accuracy. Just hold down 'fn' and yap!
0:25 8 3 0 89 25.5K 40
I love wttr.in - terminal readable weather. I wanted to check live scores in the big soccer tournament that's going on right now without opening a browser or an app, so inspired by wttr, I made a scoreboard you can curl:
$ curl sccr.live
sccr.live
Agents love plaintext you can curl too :-)
$ curl sccr.live
sccr.live
Agents love plaintext you can curl too :-)
8 1 0 19 2.7K 9
I heard so frequently when working at stripe how challenging it could be to figure out how to get your business off the ground + build and grow it. Excited to see how Locus can help!
Locus@PayWithLocus · Jun 15You shouldn't need to know how to build a business to start one.
Today, you don't.
Today, you don't.
1:17 5 0 0 18 4.8K 5
Paul once showed me a photo of the world crowding around TVs to watch Apollo 11 launch. Gave me chills.
Growing up, everyone talked about last Friday's "Friends". Everyone. That shared experience is rare now - and we miss it more than we realize.
That's what @paulscherer is building with @eigenhq. Not an AI friend. The world's mutual friend.
Proud to support Paul and team and be a little part of this one!
Growing up, everyone talked about last Friday's "Friends". Everyone. That shared experience is rare now - and we miss it more than we realize.
That's what @paulscherer is building with @eigenhq. Not an AI friend. The world's mutual friend.
Proud to support Paul and team and be a little part of this one!
paul@paulscherer · Apr 16I’m honored to share that @eigenhq has raised $15M from @benchmark to build a mutual friend that’ll help us belong and grow, together.
1:37 2 0 0 31 5.6K 7