Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM

Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM

Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM

“Dolly 2.0 is a 12B parameter language model based on the EleutherAI pythia model family and fine-tuned exclusively on a new, high-quality human generated instruction following dataset, crowdsourced among Databricks employees.

We are open-sourcing the entirety of Dolly 2.0, including the training code, the dataset, and the model weights, all suitable for commercial use. This means that any organization can create, own, and customize powerful LLMs that can talk to people, without paying for API access or sharing data with third parties…”

Source: www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm