5x faster Edge Functions: V8 isolates to Firecracker MicroVMs (netlify.com)
67 points by jbott 3 hours ago
Normal_gaussian 20 minutes ago
I've been using SlicerVM extensively - which is Firecracker MicroVMs for the regular person (and for the irregular with their platform offering) - to run local 'edge' style workloads locally and securly. Agents, local dev CI, etc. It slotted in and replaced my proxmox vm orchestrator, and now I have secure and and fast vms on my laptop wherever I go. It also supports dockerfile style builds if you're wanting a security upgrade from containers (which, you should if you're using agents).
Honestly, while I see firecracker replacing docker on the horizon I don't see firecracker replacing v8 isolates for most edge function execution. Firstly, this article's scenario is a bit unusual in that they were using someone else's isolates - so adding on a few hops; secondly isolates running JS/TS can be statically analyzed quite well, and at scale looking historically for issues and exploits, in many edge compute scenarios this is quite desirable. MicroVMs can have an awful lot more flexibility so to get the same benefit you have to really lock down what is available - the trade-offs for mid-size companies seems to benefit isolates. Obviously netlify is more than big enough and relies heavily on this that it leans in their favour.
jst1fthsdys 5 minutes ago
25 USD/m to run a daemon on my own hardware. Yikes.
CodesInChaos 4 minutes ago
> When the MicroVM boots up and the JavaScript server begins to listen on a port, we take a snapshot of the MicroVM. [...] we start a new MicroVM from that snapshot.
That sounds pretty scary, since forked RNG states can lead to catastrophic failures in UUID generators or cryptography.
nderjung an hour ago
Alex from Unikraft here! Happy to answer any questions about the microVM part of the story from our side.
We also did a couple of technical write ups if you're interested:
- https://unikraft.com/blog/netlify-edge-functions
- https://unikraft.com/customer-stories/edge-functions-netlify
nchmy 2 hours ago
I'm having trouble understanding/believing this, given that Cloudflare Workers are also v8 isolates and run vastly faster than the 25-40ms that netlify says their isolates took...
irq-1 2 hours ago
> In the past, requests went out to a hosted execution service. Today, they run on MicroVMs inside our own edge network
The isolates were not being run at the edge.
bobfunk an hour ago
They were running on the edge, and in the same datacenters but by another provider.
phickey 2 hours ago
from the article: "With our old infrastructure it went out over the internet, ran the edge function, and came back to us to pass on. With the new compute platform, the request is forwarded to a compute node within our network."
As far as I know, Cloudflare Workers have always executed within Cloudflare's network, not gone out to the internet and executed elsewhere (which I read as being in a hyperscaler cloud).
jedberg 35 minutes ago
The next time you want to curse AWS, remember they gave us Firecracker, one of the best microvm technologies out there, and the basis of at least a few non-AWS products out there (this one being the newest entry to the list).
torginus an hour ago
This is highly interesting considering AWS invented the MicroVMs for lambda, yet node on lambda is dog slow (both in latency and throughput). I can traumadump on request. I bet they could use some of this tech especially since their use cases are often not too dissimilar (auth validation, rule checking etc)
aaronvg 2 hours ago
Wish it explained where the v8 isolate latency is coming from compared to microvms
wmf 2 hours ago
"In the past, requests went out to a hosted execution service."
They were outsourcing to another company so there's plenty of room for overhead to creep in.
vmg12 2 hours ago
v8 isolates aren't actually a great sandbox and I would not trust them implicitly in the AI era. This is probably why they wrap them in an additional sandbox.
torginus an hour ago
But I guess they are good enough to isolate multiple instances of the same code, ran by the same customer in parallel.
Normal_gaussian 16 minutes ago
dummydummy1234 2 hours ago
Why are v8 isolates bad, I see speculative execution hacks, but are there others?
phickey 2 hours ago
vmg12 an hour ago
binsquare 2 hours ago
secondcoming 2 hours ago
If you're counting milliseconds why use Javascript?
wmf 2 hours ago
V8 is extremely optimized for script startup time.
nkmnz an hour ago
V8 isn't written in JavaScript?