Sandra Wachter and colleagues, 2018

Realistic editorial portrait of Sandra Wachter in a responsible-AI research office

“Explanations can, in principle, be offered without opening the black box.”

Sandra Wachter and colleagues wrote this while addressing helping people understand and contest automated decisions even when a model’s internals are inaccessible. The work proposed counterfactual statements showing what minimal changes could produce a different outcome. The authors framed the result as a concrete contribution with defined assumptions, evidence, and evaluation conditions. Reading the source keeps the claim attached to the problem it actually addressed instead of the larger mythology that later accumulated around it.

The quotation is significant because the method connected explainable AI to practical rights, recourse, and decision accountability. It identifies a technical choice that could be compared with competing approaches, rather than presenting intelligence as a mysterious property. Separating the method from the marketing strengthens the insight. It allows readers to identify exactly which capability improved, which assumptions made the result possible, and which judgments still belonged to people designing or deploying the system.

Today, the idea remains useful for giving affected people actionable information while testing feasibility, stability, and fairness. Teams can preserve the original insight by defining success before deployment, reporting both favorable and unfavorable results, and checking whether the evidence transfers to the people and environments in scope. The practical test is not whether a demonstration looks impressive, but whether the approach remains dependable under ordinary constraints, unusual cases, adversarial inputs, and changing environments. Simpler alternatives should stay in the comparison.

The central caution is that an explanation can sound actionable while recommending impossible changes or concealing a discriminatory decision process. The original result should therefore be treated as evidence within boundaries, not as permission to ignore downstream effects. Teams should expect to learn from failure. Incident reporting, redress, versioned evaluations, and periodic reassessment turn responsible use from a promise into an operating practice that can respond to new evidence. The quote endures because it ties a memorable idea to a method that can be examined. Its best legacy is careful inquiry: build boldly, measure honestly, communicate uncertainty, and keep the people affected by the system in view. Readers can apply that standard by asking which evidence supports the claim, which conditions bound it, who bears the cost of error, and who remains accountable when behavior changes in practice. The research becomes more valuable when later users reproduce its results, compare simpler alternatives, disclose departures from the original setting, and connect technical performance to outcomes people actually experience. A mature field carries breakthroughs forward without erasing their limits. That balance keeps innovation open to correction.

The research addressed helping people understand and contest automated decisions even when a model's internals are inaccessible.

Its method proposed counterfactual statements showing what minimal changes could produce a different outcome, creating a result other researchers could test and extend.

The line describes a specific contribution: the method connected explainable AI to practical rights, recourse, and decision accountability.

It should not be stretched into a claim that every related technical or social problem has been solved.

The idea still informs giving affected people actionable information while testing feasibility, stability, and fairness.

Responsible use also recognizes that an explanation can sound actionable while recommending impossible changes or concealing a discriminatory decision process.