Shivansh Vij

@shivanshvij.com

CEO @loopholelabs.io

I may be a bit late to the “time to interactive” agent sandbox party, but I wanted to make sure our hypervisor absolutely MOGGED everyone else. 10x faster than Firecracker and 425x faster than Cloud Hypervisor. agx.so is the best agent infra platform, period.

Benchmarking the Substrate Hypervisor vs Firecracker and Cloud Hypervisor. 

For warm restores, Substrate is 10x faster than Firecracker and 425x faster than Cloud Hypervisor

Once the sandbox providers figure out performance and scale, the next hills to climb will be: - agent/harness integration (ie. Shelley from @exe.dev) - agent to agent communication (ie. side channels between your sandboxes) - agent tracing integrations (think raindrop AI)

I think that workload portability will be the next big AI sandbox unblocker. With the ridiculous wave of sandbox compute being deployed right now, having the ability to move long-running workloads between nodes (spot instances!) or even clouds is *the* silver bullet for both availability and cost.

In-kernel filesystem are going to destroy the FUSE ecosystem. Bringing your custom logic into the VFS directly is absolutely incredible for performance and latency.

Who’s going to FOSDEM in Brussels next week? DM me if you'd like to hang out, talk about high performance cloud infrastructure, live migration, eBPF, Spot Instances - or all of the above! Looking forward to meeting all the cool OSS folks!

People aren’t ready for the next blog post from @loopholelabs.io If you thought the XDP post was interesting (linked below) this next one is going to blow your mind. Here’s a hint: What do chess engines and NAT’s have in common?

We finally decided to write out how we use XDP in our network plane for live network migrations and more specifically to process outgoing packets! This is the first in a series of promised deep dives into how Loophole's live migration tech works!

Loophole Labs@loopholelabs.io · 9mo ago

An eBPF Loophole: Using XDP for Egress Traffic XDP is Linux's fastest packet processor but only handles incoming traffic. We found a loophole in how the kernel determines packet direction to make it work for outgoing traffic too! Blog post with details 👇 loopholelabs.io/blog/xdp-for...

Just got to Malta for the company getaway! It’s really convenient that these EU outlets have a whole THREE USB-C outlets! So great.

Bild

I think the most excited thing about this blog post is the one we get to publish next - a deep dive into how Architect works under the hood. There were so many “impossible” problems we had to solve to make Architect a reality - and now that we have I’m having a blast explaining how we did it.

Loophole Labs@loopholelabs.io · 2y ago

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

I think the most excited thing about this blog post is the one we get to publish next - a deep dive into how Architect works under the hood. There were so many “impossible” problems we had to solve to make Architect a reality - and now that we have I’m having a blast explaining how we did it.

Loophole Labs@loopholelabs.io · 2y ago

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

New blog post! Run any application on Spot Instances with zero downtime and 75%+ cost savings - and no code changes required. Architect eliminates the reliability concerns that previously made Spot Instances impractical for production workloads. ⬇️ Link in comments ⬇️

Bild

Hard won #eBPF lesson: bpf_redirect doesn’t work between interfaces where the sender has an xdp program loaded in native mode and the other has one loaded in generic mode (only with some cloud/os pairs)