Ruha Benjamin, 2019

“Indifference to social reality is a powerful force that is perhaps more dangerous than malicious intent.”

Sociologist Ruha Benjamin uses this insight to explain why technology can reproduce inequality without a villain deliberately programming discrimination. Designers may sincerely want a system to be efficient, objective, or universal. Harm can emerge when they ignore the social conditions surrounding the data and the people affected. A model trained on existing institutions learns from histories of unequal treatment, access, and visibility. If a team treats those records as simple facts, it can automate the consequences of that history while believing it has removed human prejudice.

Indifference appears in ordinary technical decisions. A dataset may underrepresent darker skin tones because collection practices failed to include enough people. A risk score may use neighborhood or income-related variables that track segregation. An identity system may assume everyone has stable documents, addresses, or names in a narrow format. None of these choices requires malicious intent. Their effects can still be severe, especially when technology operates at scale and the burden of proving an error falls on people with the fewest resources.

The quote challenges the idea that fairness can be added as a final calculation. Social reality must shape the problem definition, not only the performance report. Teams need historians, domain experts, community knowledge, and participation from people who experience the institution differently. They should ask who is missing, what the target actually measures, which errors are most damaging, and whether automation strengthens a practice that should instead be reformed. Technical expertise remains essential, but it is incomplete without knowledge of the world in which the system will act.

Benjamin also emphasizes imagination. Critique is not merely a list of failures; it creates room to design institutions and technologies around different values. Communities can propose tools that increase access, document discrimination, support mutual aid, or make public decisions easier to examine. The aim is not to produce a perfectly neutral machine. It is to make choices visible and contestable while pursuing justice deliberately. When designers refuse indifference, they replace the fiction of inevitability with responsibility for the future their systems help construct. Benjamin’s standard moves ethical practice beyond good intentions. Responsible innovation requires curiosity about history, attention to lived experience, and the willingness to change or abandon a system when its neat solution reproduces an unjust reality. That work is slower than declaring neutrality, but it is also how institutions learn what their technology is actually doing to people. Learning requires patient listening.