Databricks Unveils Dolly Language Model as a Cheaper Alternative to ChatGPT
Databricks used a pre-existing model and trained the chatbot for merely three hours on a small set of high-quality training data.
Databricks, the data lakehouse platform, has announced its entry into the large language model vertical with Dolly, an open-source, large language model (LLM). The company has stated that buyers can develop chatbots with comparative capabilities to Open AI’s ChatGPT.
According to the Databricks blog, the company is expected to make numerous announcements in the months to come aimed towards assisting its clients in optimizing the use of LLMs by themselves.
See More: Women’s Day 2023: Tech Leaders Discuss the Impact of Digital Gender Gap
High Qualitative AI Capabilities With Lesser Training Data
Most LLMs, including the LaMDA by Google and OpenAI’s GPT-3, require vast numbers of GPU training hours and parameters, leading to high costs. Databricks is pushing to change this through Dolly, which requires only 6 billion parameters compared to GPT-3’s 175 billion.
Rather than creating a new LLM from scratch, with months of training, the company merely used a pre-existing model and used three hours of high-quality training data. This has resulted in developing some of the capabilities currently available in ChatGPT without the massive costs associated with the latter.
Dolly has been cloned from an LLM developed at Stanford – Alpaca. Researchers at Stanford have already demonstrated interactivity similar to ChatGPT with small training data sets of just approximately 50,000 questions and answers. In terms of Dolly, the model is modified slightly to enable operations, including text generation, open questions & answers, and brainstorming.
Databricks has open-sourced Dolly, and customers can use the platform to create customized versions of the chatbot model for themselves. The staggering success of ChatGPT has ignited a race among companies to introduce new and unique generative AI products to the market, with the potential to be disruptive in numerous verticals. Now, the availability of low-cost alternatives like Dolly will likely usher in a new age of how enterprises worldwide can use AI tools.
Let us know if you enjoyed reading this news on LinkedIn, Twitter, or Facebook. We would love to hear from you!
Image source: Shutterstock
MORE ON TECHNOLOGY
