Quantization can make an LLM 4x smaller and 2x faster, with barely any quality loss. But what *is* it? @samwho.dev crafted a beautiful interactive essay explaining it from first principles, aimed at coders, not mathematicians. ngrok.com/blog/quantiz...
Quantization from the ground up | ngrok blog
A complete guide to what quantization is, how it works, and how it's used to compress large language models
ngrok.com
Route between OpenAI and Anthropic with one API key without an account for either. ngrok's AI Gateway now has its own API keys and prepaid credits. One key covers both, and you can just set your model to "ngrok/auto" if you don't even want to pick. ngrok.com/blog/ai-gate...
AI Gateway: use Anthropic and OpenAI with one API key | ngrok blog
Create an AI Gateway API Key, add credits, and start making requests to OpenAI and Anthropic—ngrok handles the rest.
ngrok.com
ngrok's AI gateway now supports the Anthropic SDK natively. Change your base_url, keep your prompt caching, extended thinking, all of it. The diff is one line & there's no step two. ngrok.com/blog/native-...
Three ships coming soon we're excited about: ◆ region pinning for data residency ◆ similarly, dedicated IPs instead of our default range of multi-tenant IPs ◆ faster & more reliable certificate provisioning for ngrok/custom/wildcard domains ↓
ngrok is one gateway for all your traffic. So, time to introduce the new ngrok.com For years we've helped you secure, transform, and route to services running anywhere. localhost to prod, APIs to AI models, devices in the field to databases in customer networks.
ngrok - All your traffic. One gateway. | API Gateway, Secure Tunnels, Traffic Management
ngrok is an all-in-one cloud networking platform that secures, transforms, and routes your traffic to services running anywhere.
ngrok.com
New post! ✨ Prompt caching ✨ My first big project post for @ngrok.com. 5 weeks, 12217 lines of code, 195 commits. I poured a lot into this one, and learned a lot in the process. I really hope you enjoy it ❤️
ngrok@ngrok.com · 8mo agoYesterday we launched ngrok.ai into early access. Today we're bringing you a deep dive into LLM internals with beautiful visuals crafted by our very own @samwho.dev. Discover exactly what gets cached to offer you 10x cheaper input tokens. ngrok.com/blog/prompt-...
Some years ago, API gateways were just monoliths guarding THE prod. Now? They’re everywhere: dev boxes, CI previews, LLM stacks, even your database. 🤷 We broke down 8 modern gateway "shapes" and where ngrok fits into each one.🔮 🔗 Read more: ngrok.com/blog-post/ap...
Shipping with ngrok-operator via Helm? v0.20.0 just dropped. ☸️ This release upgrades to ngrok-go v2 with cleaner net.Conn handling and removes legacy CRDs like Tunnel, HTTPSEdge, NgrokModuleSet. 🏋️♂️ 🔗 Read more: ngrok.com/blog-post/ng...
Hot off the press ♨️: Yolanda Robla authored a blog on Dev.to about "How-to Safely Expose your MCP Servers Externally Using ngrok and ToolHive"! 👏 🔗Give it a read: dev.to/stacklok/how...
ngrok's new close-connection action started off as an internal tool to better protect ngrok-dot-com and lets you drop unwanted requests right from your Traffic Policy. 🫳 Simply bail hard when a request isn’t worth handling. 🤷 🔗 Read more: ngrok.com/blog-post/te...
ngrok is now officially in the Microsoft Store! If you're on Windows, it's the easiest and most secure way to install ngrok. ✅ Auto updates ✅ Verified source 🆕 winget install ngrok -s msstore 🆕 scoop install ngrok 🔗Get started: ngrok.com/blog-post/ng...
Need to validate users with your own identity service before traffic hits your app? 🤨 With ngrok’s http-request action, you can authenticate requests mid-flight using your internal auth logic, then route or enrich traffic accordingly. 🫶 🔗 Learn More: ngrok.com/docs/univers...
Not all users are equal. Your rate limits shouldn’t be either. 🤷 With ngrok's Traffic Policy, you can dynamically validate requests against your identity or CRM service and apply tier-based limits per user. 🥉 to 🥇, handled in YAML. 🔗 Learn more: ngrok.com/docs/univers...
Writing Traffic Policy that works is easy. Writing one that scales? 🤔✏️ From chaining and grouping to failovers and catch-alls, here’s a guide to cleaner, smarter policies with YAML you won’t hate later, curated by @joelhans.com! 🔗 Read more: ngrok.com/blog-post/pa...
Want to self-host n8n but don’t want to deal with DNS or hosting (*shocking*)? 🦾 Give ngrok a go and get a public URL, secure access with Traffic Policy, and IP-restricted dashboards, all with a singular command! 🙌 Read more: ngrok.com/docs/univers...
Expose and Secure Your Self-Hosted n8n Workflows | ngrok documentation
Get your n8n instance online to share with colleagues or receive webhook data with security measures desinged for production usage.
ngrok.com
Protect your Minecraft server from sneaky griefers. ⛏️ With ngrok's Traffic Policy, you can lock your server down by IP in just a few lines of YAML with no plugins and definitely no fuss. Build in peace and 25565 away. 🧱 Read more: ngrok.com/docs/univers...
Secure Your Public Minecraft Server | ngrok documentation
Unwanted players can quickly destroy your hard work, but you can restrict access by letting in a specific set of IP addresses.
ngrok.com
Been meaning to call pre-deployed services through Traffic Policy? 🚦 We just added a 🆕 action, http-request, that can trigger auth checks, logging, or external APIs directly from your Traffic Policy. No extra code. Just YAML and ✨. Available now in Developer Preview! 🔗 ngrok.com/blog-post/ht...
Introducing http-request: Call your services directly from Traffic Policy - ngrok
Trigger internal services, validate requests, log events, connect to AI APIs, and generally give your gateway a brain with the new http-request action.
ngrok.com
Hardcoding secrets in your Policy YAML? Not anymore! 🔐 With 🆕Secrets for Traffic Policy, you can now store sensitive values like passwords or API keys in secure vaults, and reference them at runtime! No more leaky secrets. No more risks. Read more: ngrok.com/blog-post/se...
Decouple policy from sensitive data: introducing Secrets for Traffic Policy - ngrok
Secrets let you define and manage sensitive values in secure vaults—no more hardcoding or repetitive edits during regular credential rotations.
ngrok.com
Our CEO and Founder, Alan Shreve, talked about the evolution of ngrok from a simple dev tool to a full-fledged API gateway platform and why we dogfood our own products amidst so much more, in an interview with @rawkode.dev! Give it a watch: 🔗 www.youtube.com/watch?v=QvqV...
KubeCon 2025 ☸️: ngrok founder Alan Shreve on simplifying infrastructure and beyond
YouTube video by ngrok
youtube.com
Shinobi runs AI-powered pentests in customer staging envs, no hacks required (except the good ones). 💻 With ngrok, they spin up secure, flexible access in 15 minutes, no matter how weird the network. From zero to “we’re in” that fast. 💨 Read more ⬇️ ngrok.com/blog-post/sh...
Shinobi's shortcut to AI-powered pentests in staging and dev envs - ngrok
Shinobi’s AI red team agents test apps before attackers do, and with ngrok's Traffic Policy, they can integrate with customer's unique topology in minutes.
ngrok.com
Traditional load balancers are stuck in one cluster, one network, one cloud. But your workloads? They don’t have to be. 🤷 Watch this quick video by @joelhans.bsky.social on implementing multi-cluster (and multi-cloud!) ingress in 60 seconds with ngrok! ✅ 🔗 www.youtube.com/watch?v=xD1h...
Multi-cluster (and multi-cloud!) ingress in 60 seconds with ngrok
YouTube video by ngrok
youtube.com
Load balancing is now as simple as starting two endpoints with the same URL. No configs, no complexity. Simple scaling. Read more about Endpoint Pooling and give it a go with just ✌️ commands: ngrok.com/blog-post/en...
Introducing Endpoint Pools: Load balance anything, anywhere - ngrok
With ngrok Endpoint Pools, load balancing is just starting endpoints with the same URL. Zero config. Elastic scale. Cross-cloud ready.
ngrok.com
TLS termination should come with complete control over the "when" & "how". With ngrok’s new Traffic Policy action, you choose exactly where TLS ends: at the edge, agent, or upstream service. It’s a combo of flexibility & simplicity that’ll make you go "wow". 🔗 Read More: ngrok.com/blog-post/te...
Terminate TLS however (and wherever) you want with Traffic Policy - ngrok
Need custom certs? Want fast mTLS setup? ngrok’s terminate-tls action gives you complete TLS control from one declarative config.
ngrok.com
Kubernetes ingress shouldn’t be a maze of YAML, VPNs, and duct tape. 🩹 ngrok is now your Kubernetes ingress—built to make production-ready networking effortless. Our Operator gives you full Gateway API and Ingress support, and so much more. 🧠 Read more here: ngrok.com/blog-post/ng...
ngrok is also now your Kubernetes ingress - ngrok
Simplify your Kubernetes ingress stack: global load balancing, DDoS protection, and flexible routing all built into ngrok’s Operator.
ngrok.com
🚨 94% of production APIs face security issues – are you prepared to tackle them? Join @stmcallister.bsky.social as we talks with Micah Silverman from Snyk while they explore API security. ngrok.com/resources/vi... #APISecurity #DevSecOps #CyberSecurity #APIGateway
Join us for the ngrok Developer Roundtable!
We welcome Micah Silverman, Director of DevSecOps Acceleration at Snyk, as we discuss API security.
ngrok.com
Block unwanted traffic before it hits your HTTP layer! With ngrok's Traffic Policy phases, manage access at the TCP, HTTP request, or response stage. Enforce auth, log metadata, and more...at exactly the right time. 🔗 ngrok.com/blog-post/ma...
ngrok blog: Manage traffic at critical connection points with Traffic Policy phases
Learn how ngrok's phase-based Traffic Policy gives you granular traffic control in more places, from TCP connect through HTTP response, to take decisive action.
ngrok.com
Join us tomorrow for the ngrok Developer Roundtable live stream! Our host @stmcallister.bsky.social will be joined by @dashaun.com as they discuss staying up to date with our software development tools and "living the N-0 life" by looking forward, not backward. ngrok.com/resources/vi...
Join us for the ngrok Developer Roundtable!
We welcome DaShaun Carter, Developer Advocate at Broadcom, as we discuss looking forward, not backward.
ngrok.com
I'm excited to have @dashaun.com on the show tomorrow! Join the conversation by registering at the link below!
ngrok@ngrok.com · 2y agoJoin us tomorrow for the ngrok Developer Roundtable live stream! Our host @stmcallister.bsky.social will be joined by @dashaun.com as they discuss staying up to date with our software development tools and "living the N-0 life" by looking forward, not backward. ngrok.com/resources/vi...
Follow the pink neon sign over on aisle R in #KubeCon expo hall! Come chat about gateways and grab a shirt, while they last! #kubeconna
Scott McAllister@stmcallister.bsky.social · 2y agoHey #KubeCon come find me at the @ngrok.com booth with the neon sign!! #kubeconna
