Arbitrary code execution in QubesOS via copy-to-VM error reporting backchannel (qubes-os.org)
214 points by vntok 19 hours ago
msm_ 17 hours ago
Wow, this is serious. Makes you think, that even though QubesOS attack surface is so tiny (well-designed to be secure) there are still vulnerabilities to be found.
Worth noting that (as I understand) this vulnerability occurs only when doing copy-to-VM from Dom0:
>Note that the VM variant of `qvm-copy-to-vm` is not affected, as its version of the error reporting function does not use `system()`:
Since you should not use Dom0 for regular work, and definitely not for interacting with likely-to-be-infected VMs, the scope of this attack is smaller than it sounds. On the flip side, when it works, it elevates privileges straight to Dom0.
deathanatos 9 hours ago
> well-designed to be secure
While I suppose this doesn't say the design isn't secure, system() is one of those calls that has no place in modern code. It is insecure by its design.
> Any user input that is employed as part of `command` should be carefully sanitized, to ensure that unexpected shell commands or command options are not executed. Such risks are especially grave when using system() from a privileged program.
(—man 3 system)
zzo38computer 8 hours ago
The "system" function (and also "popen" function) are helpful, although they should be used carefully. You should only use it where the entire input (rather than merely a part of it) comes from a trusted source from the local user (and documented in a clear way that it does this), such as being entered interactively or from a user configuration file, or in some cases a entirely hard-coded string (although in such a case, often one of the exec functions works better), and to ensure that the security boundary is correct (e.g. you should probably avoid it if it is setuid). If it is necessary to pass additional data then you might use environment variables, pipes, temporary files, etc.
Strings passed to system or popen should not be constructed by combining other strings; they should be directly unchanged from whatever trusted source it comes from.
The specific use documented in the article is a situation where I should think that you should not call the shell (since the command includes untrusted input, and also because there might be a better way to display the error message).
There are additional possible security issues with such things though, whether you use the shell or execute directly, some of which are due to the use of text rather than binary data for communication (although changing that won't solve everything).
Topfi 15 hours ago
You are right, copying to dom0 is not best practices and warned against since anno dazumal, but given the user groups I remember not always being technically minded (journalists, dissidents, etc.) and ensuring qubeses isolation holds even when users do things they are discouraged from has always been part of the philosophy. Don’t trust users, don’t trust userland, don’t trust software and all that yazz.
nickzana 13 hours ago
I believe this is a vulnerability that occurs when copying data from dom0, which is a more common task. Generally the Qubes model recommends copying data from more trusted VMs to less trusted VMs, and dom0 still runs some system-wide processes in many default configurations.
For example when you take a screenshot with xfce4-screenshooter, the file is saved to dom0, and you have to use qvm-copy-to-vm to move it to a (less trusted) qube to do something with it. That's the most frequent use case, at least for me.
sdcfgy 16 hours ago
Reminds me of Theo DeRaadt again: https://marc.info/?l=openbsd-misc&m=119318909016582
Topfi 16 hours ago
I feel that, in fairness, one should at least read Adam’s response, though ideally all subsequent mails: https://marc.info/?l=openbsd-misc&m=119320496730314&w=2
Theos is a very opinionated and not necessarily wrong position, but I feel also a bit too reductive given we are eternally having to deal with compromises of some form. Also, lest we forget, it has been two decades in the interim and oh so much has changed. In any case, this originated from their code, not virtualization, so it doesn’t really apply either way…
chmod775 15 hours ago
That's an impressive amount of maturity and composure Adam demonstrates there after receiving a response like that.
sdcfgy 14 hours ago
I think it's pretty much spot on myself and applies to more than virtualization based on the last point. It really suggests that further complexity and abstraction is not a good security posture. And I agree with this from extensive experience (embedded, defence).
Regarding the two decades since and the numerous exploitable x86-64 and hypervisor bugs suggests he wasn't wrong and that the tone was appropriate for the severity of the problem.
dvdkon 9 hours ago
rpdillon 9 hours ago
Betelbuddy 14 hours ago
In all fairness also read this: https://taviso.decsystem.org/virtsec.pdf
koverstreet 12 hours ago
pornel 16 hours ago
The bug here is not related to virtualization, but a footgun as old as C stdlib: system() that doesn't take arguments separately, and instead relies on shell escaping by the application.
1718627440 14 hours ago
The only point of system(3) is to invoke the OS shell, if you do not want that use exec(3).
XMPPwocky 16 hours ago
Looks like this has nothing to do with the hypervisor, it's not a traditional VM escape
zvmaz 16 hours ago
All I see is rudeness, insults, and arrogance sparkled with inklings of technical arguments. Worthless.
iugtmkbdfil834 15 hours ago
But, and this is the important part, is he wrong?
matherial 15 hours ago
zvmaz 15 hours ago
negura 5 hours ago
Betelbuddy 14 hours ago
eli 15 hours ago
throwa356262 16 hours ago
Theo is a very insightful guy, but also very opinionated. I think the truth is somewhere in between.
Especially as more and more virtualization functions move into hardware, not using them as a second security barrier seems foolish.
fallat 16 hours ago
Brutal
I hope when people read this though they understand this is a communication style; they're clearly trying to strongly discourage people from thinking they are suddenly protected. Effective? Maybe at one time, where "macho dev energy" was a thing. Today, not so much. You can tell they mean well because the intro sentence is actually pretty cheeky!
edelbitter 16 hours ago
This is less of a virt/x86 bug and more of a "don't call system() on arbitrary user input" bug.
.. incidentally, OpenBSD also provides one of the clearest examples of how the excuse "calling system() is fine in my case, its totally not arbitrary user input" is deluded just the same, see CVE-2020-8794.
12995816 16 hours ago
Peak Theo! This refreshing truth telling has been eradicated in 2026.
Topfi 15 hours ago
It has? News to me. Go on any major thread on this page, you’ll witness similarly strong pushback visa-vi buying into corporate backed hype, akin to the overconfidence in virt security he pointed at back then.
nython 15 hours ago
zby 18 hours ago
I am still impressed by QubesOS track and I use it for my dedicated 'financials' laptop.
IMHO the thing that is holding back QubesOS is the lack of hardware acceleration for graphics - maybe now when dual monitor setups are getting popular this could be a workaround for the security considerations?
jwrallie 17 hours ago
I dropped QubesOS once exactly for that reason in the past but now I’m running it again on a separate computer.
Even with all its drawbacks, there is something really nice about being able to run different applications over Tor, VPN or plain internet simultaneously, the ability to isolate non-safe binaries and being able to backup your VMs easily.
I wish a similar distro would be made based on KVM so that the standard kernel could be used. It would be great for compatibility.
tom_alexander 14 hours ago
> being able to run different applications over Tor, VPN or plain internet simultaneously, the ability to isolate non-safe binaries and being able to backup your VMs easily.
These are all possible using light containers. For example, on FreeBSD I will spin up a jail which runs wireguard, and then I'll bridge that to another a jail. That 2nd jail is running entirely off wireguard without any other way to access the network. Since it is a jail, it is isolated. And backing up is as simple as a zfs snapshot and zfs send. I assume the same is possible on Linux.
fsflover 17 hours ago
> I wish a similar distro would be made based on KVM
There is an Issue for that: https://github.com/QubesOS/qubes-issues/issues/7051
madushan1000 6 hours ago
This is sort of a solved problem with virtio native context. You can just run mesa driver in the virtual machine and proxy it's ioctl calls to host kernel gpu driver.
I'm pretty sure all the major GPU drivers in mesa now supports this feature.
Wonder why QubesOS hasn't adopted this yet.
artyomsv 17 hours ago
Problem is not that nobody wants to do it, it is that GPU stack is exactly the kind of enormous driver surface Qubes exists to keep away from dom0. Second monitor does not really change that, somebody still has to trust the driver.
progval 10 hours ago
The driver could run in a VM and only display applications from that VM or a subset of VMs.
Joel_Mckay 8 hours ago
grommz 15 hours ago
The founder Joanna Rutkowska left QubesOS in 2018. All the code involved in this bug was committed by her successor Marek Marczykowski-Górecki.
Joanna seems to be a genuine good guy, she once wrote a paper titled "Intel x86 considered harmful". That's why Huawei and the Chinese government aren't even trying any more to make western CPU architectures secure, it's a hopeless cause.
woodruffw 7 hours ago
Is there some evidence that x86 is uniquely prone to exploitable memory corruption? I haven't seen it, if so.
> That's why Huawei and the Chinese government aren't even trying any more to make western CPU architectures secure, it's a hopeless cause.
I suspect there are much more boring reasons for this, ranging from licensing to geopolitics (i.e., it being useful/valuable to have a domestic base of engineers who can design an ISA).
upboundspiral 6 hours ago
The paper X86 considered harmful was about how the BIOS / Intel management Engine (now also AMD PSP), are completely opaque.
If the lowest layer is hidden, proprietary, there are infinite vectors for state actors to include their desired backdoors.
woodruffw 4 hours ago
jervant 11 hours ago
> good guy,
> she
tdb7893 3 hours ago
I feel like "guy" is weird in that I often hear people say "you guys" (and similar phrases) to groups of women but "guy" on its own is referring to a man at least 99% of the times I hear it. I'm curious if other people actually use it completely non-gendered (it's definitely gendered in the places I've lived in the US).
user_7832 13 hours ago
Mini tangent: Could someone explain to me why Qubes is used for security, when (from what I understand) Jails on BSD is significantly more robust/safe/has a much smaller exposed area? Is it just "everyone's using linux already; here's a safer linux"?
zvmaz 12 hours ago
Qubes can be viewed as a Xen distribution, rather than a Linux distribution [1]. You may find the Qubes FAQ a good starting point (I'm reading it now because of your question, so thanks).
[1] https://doc.qubes-os.org/en/latest/introduction/faq.html#is-...
polotics 18 hours ago
I'm still very impressed by qubes, and glad I'm not such a target that I feel I need the level of opsec it affords (on all my laptops).
Maybe someday AI-assisted killchains will be so widespread that Qubes is the minimal level for the (few?) still-local users of compute.
I would not have copied anything from dom0 to any another qube, the impact is low.
negura 4 hours ago
> I would not have copied anything from dom0 to any another qube, the impact is low.
You'd typically copy logs, to open issue tickets etc.
Allwinkt 16 hours ago
The worst part is that in 2020 they explicitly documented that the remote filename is attacker controlled,but still allowed it to reach system() That is C security 101: never pass untrusted input through a shell. This should have been caught in review!
ferrule 4 hours ago
Error reporting backchannels are often overlooked attack vectors. Pretty wild to see Qubes OS, of all systems, fall to such a subtle vector.
bawolff 12 hours ago
its kind of fascinating that all this paranoia falls to a shell escaping issue with system().
dhruvrrp 5 hours ago
Tangentially, their steps listed to verify PGP signature is the prime example of why PGP has such dismal adoption.
_pdp_ 16 hours ago
Most security bugs are due to improper string validation and use.
Naru41 12 hours ago
If it's `untrusted_filename`, it should at least accept the length of the string as an argument.
Topfi 16 hours ago
That is sphincter tightening to read. Have to point out how amazingly well their bulletins handle communication. Clearly describes the issues, how users are to act, etc. in, what I feel, is an easy to grasp language, even if one’s not in the weeds that much. In fairness though, I do still have some past memories concerning Qubes architecture from way back, so maybe my assessment is wrong and this is still not that straight forward to grasp for most.
TacticalCoder 17 hours ago
I do really like the following in the bulletin:
> Important: At this point, you still don’t know whether the key you just imported is the genuine QMSK or a forgery. In order for this entire procedure to provide meaningful security benefits, you must authenticate the QMSK out-of-band. Do not skip this step! The standard method is to obtain the QMSK fingerprint from multiple independent sources in several different ways and check to see whether they match the key you just imported. For more information, see How to import and authenticate the Qubes Master Signing Key.
It looks like Qubes is ran by people who take security seriously, which is refreshing.
inigyou 12 hours ago
I own a Qubes T-shirt which I bought in person at FOSDEM. The design on the T-shirt consists of many copies of the QMSK in hexadecimal. All of their merch is like this.
leonidasrup 16 hours ago
How well is QMSK protected from a serious attacker?
Allwinkt 16 hours ago
The worst part is that in 2020 they explicitly documented that the remote filename is attacker controlled,but still allowed it to reach system() This is C security 101: never pass untrusted input through a shell. This should have been caught in the review!
palata 16 hours ago
Isn't it the case for all bugs? If they appear in the production software, it means that they passed the review. And obviously bugs shouldn't pass the review, but that's easier said than done.
vlovich123 12 hours ago
This should be made structurally impossible through type safety rather relying on code review.
crest 10 hours ago
Really an attacker controlled system() call?!?
charcircuit 18 hours ago
Another example for why system() is so dangerous to use.
I also don't understand why it needs to show the dialog in dom0. If you have the option to handle attacker controlled input on the unprivileged side, you should do that instead of putting a lot of logic on the privileged side.
delamon 18 hours ago
The code is sloppy. They check existance of kdialog binary using full path; next step they rely on PATH search by shell. If would've been much safer to just do execve directly.
HackerThemAll 18 hours ago
> why it needs to show the dialog in dom0
I think it's the "secure screen" that cannot be manipulated by the malware in a VM. I'd expect a password entry dialog to also be handled like that.
danielheath 15 hours ago
If you're going to put the graphics and NIC into separate VMs, surely the secure screen can be another of those semi-privileged VMs rather than part of dom0
charcircuit 17 hours ago
It's for an the "File copy/move error" error dialog.
iberator 15 hours ago
This os is supposed to be run on bare metal AFIK for same reason
ka3ki 16 hours ago
it's kinda doomed at this point
anArbitraryOne 14 hours ago
My username checks out
12995816 16 hours ago
Peculiar stuff. I'm always skeptical of these security Linux distributions, but this bug is so bad that it seems like an infiltration of Qubes at best or Qubes being a honeypot at worst.