← all posts

The ops questions most candidates skip: observability, rollbacks, on-call

The ops questions most candidates skip: observability, rollbacks, on-call

Most candidates end their system design answer at the architecture diagram: boxes, arrows, a database choice, a cache. Then the interviewer asks "how do you deploy a change to this?" or "it's 3am and latency just tripled — walk me through it," and the answer falls apart. In 2026 loops, observability, deployment strategy, on-call burden, and rollback paths are graded topics, not bonus ones. Senior candidates who skip them are leaving signal on the table.

The reasoning is simple. Companies aren't hiring people to draw systems, they're hiring people to run them. An interviewer can teach architecture patterns. They can't easily teach the instincts of someone who has carried a pager.

The three questions to answer before you're asked

How do I know it's working? For every major component, be able to name the two or three signals you'd watch. The generic answer (latency, error rate, saturation) is fine. The strong answer ties signals to the design: "the queue depth on this worker pool is the early warning — if it grows, we're falling behind ingestion and users see stale data in about five minutes." That sentence proves you understand your own system's failure physics.

How does a change ship? Have a default deployment story: rolling deploy behind a health check, canary a small percentage, watch the key metrics, promote or roll back. Mention feature flags for anything user-facing. This takes thirty seconds and most candidates never say it.

How does it break, and what do I do at 3am? Pick your design's most likely failure, whether that's the database failover, the cache stampede, or the queue backup, and narrate the response: what alert fires, what the dashboard shows, what the mitigations are in order of speed. "First move is the feature flag, second is shedding the batch traffic, root cause comes after we're stable" is exactly the shape interviewers want.

Rollback is the differentiator

Everyone says "we'd roll back." The probing follow-up is: can you? This is where schema migrations, event formats, and caches bite. Strong answers show awareness of one-way doors: "the schema migration makes this deploy hard to reverse, so I'd split it — additive migration first, code after, cleanup last." Naming expand-and-contract for schema changes, or versioned event formats for queues, is worth more than another nine of theoretical availability.

On-call burden as a design input

A newer probe, especially at staff level: "what's the on-call load of this design?" It's a real question. Every component you add is something a human gets paged for. The graded move is trading architecture against operability out loud: "the second queue adds resilience but also a new class of stuck-message pages; at this team's size I'd rather keep the failure surface small." Candidates who reason about the humans running the system, not just the system, read as having been one of those humans.

How to fit this in a 45-minute round

You don't need a dedicated ops section. Attach one operability sentence to each big decision as you make it, and when the design feels complete, close with: "and before calling this done — here's how it deploys, here's the dashboard, here's the first page we'd get." Ninety seconds. It's often the part of the interview the debrief quotes.