2023: Databricks Opens Dolly 2

Editorial reconstruction of data engineers opening model weights, training code, and an instruction dataset

On This Day in AI: April 12, 2023

On April 12, 2023, Databricks released Dolly 2.0, a twelve-billion-parameter instruction-tuned language model, together with its training code, weights, and a human-written dataset licensed for commercial use. The project was designed to let organizations build and customize conversational models without depending entirely on a proprietary API. A wave of open chat models had followed ChatGPT, but many were tuned on synthetic outputs whose terms restricted competing commercial use. That uncertainty made it difficult for companies to adopt or redistribute otherwise promising community systems. The date matters because it turned a fast-moving technical or policy development into a visible milestone that people, institutions, and researchers could evaluate.

The substance of Databricks’ release of Dolly 2.0 was as important as the headline. More than five thousand Databricks employees contributed fifteen thousand original instruction-and-response pairs covering brainstorming, summarization, classification, extraction, open questions, closed questions, and creative writing. Dolly 2.0 fine-tuned the open Pythia-12B base model on that dataset. Those choices reveal what the people behind the milestone believed was necessary at the time. AI history rarely advances through one breakthrough alone; research, product design, infrastructure, governance, and access all shape what a system can become.

The immediate consequences reached beyond the organization at the center of the event. The release supplied a relatively clean foundation for commercial experimentation and showed that modest, carefully created instruction data could produce useful behavior. It energized open-model work and highlighted licensing and data provenance as engineering requirements rather than legal afterthoughts. The moment also invited scrutiny, because new capabilities create new dependencies. Reliability, safety, cost, privacy, and human control determine whether an impressive demonstration becomes a trustworthy part of everyday life. Those practical limits are essential to understanding both the achievement and the response it received.

In retrospect, Dolly 2.0 became an emblem of the 2023 push to democratize instruction-following models. Its lasting lesson is that openness includes more than downloadable weights: usable training data, code, documentation, and clear rights determine whether others can reproduce and extend a system. Looking back from today’s rapidly changing AI landscape, this event belongs to a larger transition from specialized machine-learning experiments to systems embedded in ordinary products, workplaces, institutions, and public decisions. Its enduring lesson is that technical progress becomes historically significant when it changes what people can do and what society expects next. That connection between capability and consequence gives the milestone its lasting relevance. The anniversary therefore records a turning point, not simply an announcement.

Databricks released Dolly 2.0, a twelve-billion-parameter instruction-tuned language model, together with its training code, weights, and a human-written dataset licensed for commercial use. The project was designed to let organizations build and customize conversational models without depending entirely on a proprietary API.

More than five thousand Databricks employees contributed fifteen thousand original instruction-and-response pairs covering brainstorming, summarization, classification, extraction, open questions, closed questions, and creative writing. Dolly 2.0 fine-tuned the open Pythia-12B base model on that dataset.

The release supplied a relatively clean foundation for commercial experimentation and showed that modest, carefully created instruction data could produce useful behavior. It energized open-model work and highlighted licensing and data provenance as engineering requirements rather than legal afterthoughts.

The event connected a concrete technical, commercial, or policy decision with the wider development of artificial intelligence.

Dolly 2.0 became an emblem of the 2023 push to democratize instruction-following models. Its lasting lesson is that openness includes more than downloadable weights: usable training data, code, documentation, and clear rights determine whether others can reproduce and extend a system.

Its influence can be traced through later products, research, governance, or industry practice.

Explore more of "On This Day ..."

Discover more events from the same date across news, politics, technology, sports, and other fields. Each link highlights significant moments that shaped history on different fronts.