Bhanu Chaddha
Menu

delivery-layer · part 2 of 2

Your Architecture Review Is a Negotiation

Posts, Series

It is the last twenty minutes of a design review for a payments cutover. A principal engineer has walked the room through the retry strategy, and it holds up well. Two people say it matches what they did on the last migration. Someone starts talking about the rollout date.

Then the person who joined six weeks ago says: "Probably nothing, and I might be missing context, but does the retry path double charge if the upstream times out after the commit?" Their voice goes up slightly at the end. Nobody picks it up. The chair says "good discussion, let's get this merged," and the meeting ends on time.

Nine months later, that question is the incident review.

The room did not miss the risk. It heard the risk and never had to answer it.

TL;DR

A technical review is a social forum wearing a technical costume. The information most likely to change the decision is held by one person, and group discussion is measurably biased against exactly that kind of information. The risk that ships is not the one nobody saw. It is the one raised quietly by someone without the standing to make the room stop.

  • The quietest risk is the risk raised by the person with the least social capital in the room, which makes it the one most likely to survive the meeting unaddressed.
  • Groups whose answer requires pooling unshared information are eight times less likely to find it than groups given everything up front, across 65 studies and 3,189 groups.
  • Going around the room for positions first makes this worse. Stated preferences suppress the surfacing of unshared information.
  • The chair's job is not to judge the arguments. It is to correct the sampling.
  • "Any concerns?" is not a question. It is the sound of a meeting closing.

Hero: a review ranks arguments by how well they are defended rather than by merit, shown as a believed ranking by technical strength above the actual ranking by confidence and standing, where a hedged concern from the newest person gets no reply and ships

The costume is technical. The mechanics are social.

Why Do Smart Reviews Approve a Design With a Known Flaw In It?

Everyone believes they are evaluating a design. What they are actually running is an auction with no stated currency, where the bids are made of confidence, tenure, volume, and how well someone speaks when pushed back on.

This is not a claim that engineers are irrational or that the meeting is theatre. It is narrower and worse. The technical content is real and people are trying in good faith. But the thing deciding which technical content gets considered is not itself technical, and nobody has that job.

Look at what a review is being asked to do. Five or six people each hold part of the picture. One knows the traffic shape. One knows how often the upstream service fails. One knows the migration is already behind. One knows the vendor contract renews in March. The right call usually needs two or three of those pieces to meet. No single person can get there alone, which is the whole reason the meeting exists.

That setup has a name, and researchers have been studying it for forty years.

What Does the Research Say About Groups Pooling What They Know?

Groups are bad at it. Not slightly bad.

The research calls it a hidden profile: a decision where the right answer only becomes visible once the group pools what its members each know separately. Researchers give every participant a different slice of the facts, arranged so the best option looks mediocre to each person alone and turns obviously correct only if everything gets said out loud.

A 2012 review by Lu, Yuan and McLeod covering 65 studies and 3,189 groups found that groups facing a hidden profile were eight times less likely to land on the right answer than groups handed everything up front.

The reason is the useful part. Groups talked about shared facts far more than unique ones, by a wide margin. A fact several people already know gets raised, agreed with, and built on, because every mention finds an ally in the room. A fact one person holds gets said once, finds no support, and dies there. Nobody suppressed it. It just never found a second speaker.

Supporting: shared information gets raised, confirmed, and elaborated while unique information is mentioned once and dies for lack of a second speaker

Two findings from that work change how you should run a Thursday afternoon. First, the medium made no significant difference. Moving the review into a document, a call, or an async thread does not fix this on its own, which is bad news for anyone hoping a tool would solve it. Second, and more useful: the best predictor of a good decision was coverage, meaning how much of the unshared information got mentioned at all. Not how long the discussion ran. Not how rigorous it felt. Whether the thing got said.

That changes the chair's job completely. You are not there to judge between arguments. You are there to fix a sampling problem.

Meme: two buttons, one labelled evaluate the strongest argument and one labelled make sure the argument gets made, with the sweating figure reaching for the first

Why Is the Person Who Sees the Risk Often the Person Who Cannot Say It?

Now add the human layer, because unshared information is not only unshared by accident.

Detert and Edmondson's work on silence at work found that 85% of the people they surveyed had held back a concern from a manager that they thought was important, because of what they expected raising it to cost them. That is self-reported, and from 2007, so read it as evidence about how people experience these rooms rather than a measured rate of buried risk.

Here is what makes this a delivery problem and not a culture problem. The person most likely to hold the deciding fact is often the person least able to defend it. They are new, so they still notice what everyone else stopped seeing. They are junior, so they have no standing to interrupt. They work on the next system over, so they are a guest here. Or they are simply not sure, and they know that a half-formed objection aimed at a confident senior engineer costs more than it pays back.

So they hedge. "I might be wrong, but." "This is probably fine." "Just checking." The hedge is a sensible tax on low standing. It is also exactly the phrasing a room is trained to skate past. The risk arrives wrapped in the disclaimer that guarantees it gets ignored.

This is the quietest risk: the concern raised by whoever has the least social capital in the room, which is exactly why it is the one that ships.

Pull quote: the quietest risk is the one that ships

Notice there is no villain here. Nobody overruled anyone. The senior engineer was not arrogant, the new joiner was not timid, the chair was not careless. Everyone behaved sensibly given where they sat, and the meeting still produced a bad decision. That is what a structural failure looks like, and it is why telling people to speak up more does nothing. You cannot fix a sampling problem with courage.

Meme: a review thread where the decisive risk is raised with three hedges and receives a thumbs up reaction and no reply

What Can I Change in My Next Review Without Asking Anyone's Permission?

Four things. None of them need a new process document.

Ask for concerns in writing first, separately. Get them from each attendee individually, before anyone has heard anyone else. This hits the mechanism directly, because stating positions at the start of a discussion makes a group less likely to surface what only one person knows. Writing first also strips the trailing-off voice out of the hedged concern, and that voice is the signal the room uses to discount it.

Say out loud who knows what. Open by naming it: "Priya knows the traffic shape, Tom owns the upstream, Ana has the migration timeline." Two sentences, and it hands the person with the unshared fact a standing invitation instead of making them build their own standing first.

Swap "any concerns?" for a direct question. "Any concerns?" gets answered by silence in every room, always, and silence is not agreement, which part 1 covered in detail. Ask this instead: "Ana, what would have to be true for this to go badly?" It assumes the concern exists rather than asking someone to volunteer that they have one.

Write down the risks nobody resolved, with names on them. Not the decision. The objections still open when the meeting ended. This is the cheapest thing on the list and it pays the most, because it turns a hedged comment into a tracked item with an owner. The person who raised it no longer has to win the room. They only have to get it written down.

Supporting: the four Monday interventions mapped against the specific failure each one corrects

Your Meeting Is Part of Your Architecture

The uncomfortable part is that the quality of your architecture is capped by the quality of your meeting mechanics. Most engineers who would never ship an unreviewed schema change will happily run a decision meeting with no design at all.

You would not accept a system where whether a write survived depended on how confident the caller sounded. That is the review process most teams have.

A good review is not one where the best argument wins. It is one where every argument that exists actually gets made. The winning is the easy part.

The next part goes after the axis everyone estimates on and almost nobody questions. Teams sort decisions into big and small, then spend review time proportional to size. That is the wrong sort. What matters is not how large a change is but how expensive it is to be wrong about it.


If this resonated and you're the person who ends up responsible for whether things actually ship, follow along. The series covers the 12 things I think separate projects that land from projects that stall: how decisions get made, how work gets delegated, how technical risk gets translated into business language, and what to check in your first month on a project you didn't start.