Kubernetes was designed around a simple assumption: workloads are interchangeable, resources are fungible, and any pod can move to any node without much consequence. AI/ML training and inference break every part of that assumption. GPUs aren’t interchangeable — a workload that needs eight GPUs on the same NVLink domain fails just as hard on the
The muscle-memory layer: commands, config files, and scripts — for the networking person moving into HPC/AI Ops (Part two of a series — part one: From Jupyter Notebook to InfiniBand Fabric, covering what the ML/LLM team actually hands you before this stage begins.) Knowing what Slurm is and knowing what a Slurm admin does all
A network engineer’s field guide to the other side of the AI infrastructure stack If you’ve spent your career on fabric design and CCIE-grade network builds, the ML/LLM training world looks like a black box wrapped in a black box. A “job” shows up in the Slurm queue, it asks for 8 GPUs across 2
Every production LLM that answers a customer question or automates a workflow passed through the hands of five or six distinct roles before it ever served a single request. Each role hands off a well-defined artifact to the next — and when that handoff is fuzzy, that’s usually where projects stall for months. This post
Every large-scale AI system — the model that answers your question, the recommendation engine on your favorite app, the vision model in a self-driving car — was trained and is served on infrastructure built from three foundational pieces: GPUs that do the actual computation, a scheduler that decides who gets to use them and when,
Enterprises are moving large language models from pilot projects into production faster than most security programs can adapt. The result is a new attack surface that doesn’t map cleanly onto traditional application security, network security, or data security playbooks — it borrows from all three and adds failure modes none of them anticipated. This post
Around 5 years ago I have completed the Aviatrix Certified Engineer (ACE) – Multicloud Network Associate when it was talk of the town. It’s tempting to file certifications like this under “resume line item” and move on. But this one is worth writing about, because the material addresses a failure pattern that shows up repeatedly
Cloud was supposed to remove friction. Provision compute in minutes, route packets without owning a single router, let infrastructure teams move at the speed of the business instead of the speed of a six-week change-board cycle. That was the pitch. A decade in, Azure increasingly delivers the opposite: a platform so layered with named services,
Every infrastructure team is sitting on a goldmine of data and quietly starving for answers. The data isn’t missing. It’s just scattered across owners who never join their tables. It’s a familiar Monday. An auditor asks a question that sounds trivial: “Show me every production server that has no endpoint protection and isn’t being backed up.” It
Zero Trust Network Access (ZTNA) has evolved from a VPN replacement technology into a foundational enterprise security architecture in 2026. Traditional VPNs are increasingly viewed as a security liability due to excessive implicit trust, credential theft risks, lateral movement exposure, and poor visibility into third-party access. Modern enterprises now require identity-first, least-privilege access models that
