Name: Why We Ditched Kube-proxy: Scaling 10M Daily Browser Sessions With Kubernetes EndpointSlices - Rajat Khanna, CommerceIQ
Start: 2026-06-19T15:10:00+0530
End: 2026-06-19T15:40:00+0530

18-19 June
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for KubeCon + CloudNativeCon India 2026 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in India Standard Time (UTC+5:30). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date." The schedule is subject to change and session seating is available on a first-come, first-served basis.

Why We Ditched Kube-proxy: Scaling 10M Daily Browser Sessions With Kubernetes EndpointSlices - Rajat Khanna, CommerceIQ

Friday June 19, 2026 3:10pm - 3:40pm IST

Lotus 2 (Level 3)

At CommerceIQ, we scrape 850+ retailers daily through Kubernetes-orchestrated headless browsers — 10M pages, thousands of ephemeral pods per hour.

This talk covers when our networking broke at scale and how we fixed it with native Kubernetes.

At 8K+ concurrent pods, kube-proxy's iptables rules and conntrack exhaustion caused latency spikes. We bypassed kube-proxy with direct pod-to-pod routing via the EndpointSlice API — achieving 40% latency improvement while handling stale endpoints and scale-up race conditions.

We also built custom HPA metrics tied to scrape queues, scaled from 4K to 16K concurrent scrapes with spot VMs, and used MinIO as in-cluster cache to cut egress by 60%.

No fancy tooling — just deep Kubernetes knowledge solving hard problems with what's already there.

Speakers

Rajat Khanna

Senior Tech Lead, CommerceIQ

Senior Tech Lead at CommerceIQ, leading the BOT Evasion team — one of the largest browser automation fleets in e-commerce, orchestrating 10M+ daily scrapes across 850+ retailers on Kubernetes. Contributor to OpenTelemetry JS (Jaeger Remote Sampler). Active CNCF community member... Read More →

Friday June 19, 2026 3:10pm - 3:40pm IST
Lotus 2 (Level 3)

Connectivity

Content Experience Level Intermediate

KubeCon + CloudNativeCon India 2026

Rajat Khanna

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Get help with the event