Saturday, May 17, 2025
LBNN
  • Business
  • Markets
  • Politics
  • Crypto
  • Finance
  • Energy
  • Technology
  • Taxes
  • Creator Economy
  • Wealth Management
  • Documentaries
No Result
View All Result
LBNN

Databricks Has a Trick That Lets AI Models Improve Themselves

Simon Osuji by Simon Osuji
March 25, 2025
in Artificial Intelligence
0
Databricks Has a Trick That Lets AI Models Improve Themselves
0
SHARES
2
VIEWS
Share on FacebookShare on Twitter


Databricks, a company that helps big businesses build custom artificial intelligence models, has developed a machine learning trick that can boost the performance of an AI model without the need for clean labelled data.

Jonathan Frankle, chief AI scientist at Databricks, spent the past year talking to customers about the key challenges they face in getting AI to work reliably.

The problem, Frankle says, is dirty data.

”Everybody has some data, and has an idea of what they want to do,” Frankle says. But the lack of clean data makes it challenging to fine-tune a model to perform a specific task.. “Nobody shows up with nice, clean fine-tuning data that you can stick into a prompt or an [application programming interface],” for a model.

Databricks’ model could allow companies to eventually deploy their own agents to perform tasks, without data quality standing in the way.

The technique offers a rare look at some of the key tricks that engineers are now using to improve the abilities of advanced AI models, especially when good data is hard to come by. The method leverages ideas that have helped produce advanced reasoning models by combining reinforcement learning, a way for AI models to improve through practice, with “synthetic,” or AI-generated training data.

The latest models from OpenAI, Google, and DeepSeek all rely heavily on reinforcement learning as well as synthetic training data. WIRED revealed that Nvidia plans to acquire Gretel, a company that specializes in synthetic data. “We’re all navigating this space,” Frankle says.

The Databricks method exploits the fact that, given enough tries, even a weak model can score well on a given task or benchmark. Researchers call this method of boosting a model’s performance “best-of-N”. Databricks trained a model to predict which best-of-N result human testers would prefer, based on examples. The Databricks reward model, or DBRM, can then be used to improve the performance of other models without the need for further labelled data.

DBRM is then used to select the best outputs from a given model. This creates synthetic training data for further fine-tuning the model so that it produces a better output first time. Databricks calls its new approach Test-time Adaptive Optimization or TAO. “This method we’re talking about uses some relatively lightweight reinforcement learning to basically bake the benefits of best-of-N into the model itself,” Frankle says.

He adds that the research done by Databricks shows that the TAO method improves as it is scaled up to larger, more capable models. Reinforcement learning and synthetic data are already widely used but combining them in order to improve language models is a relatively new and technically challenging technique.

Databricks is unusually open about how it develops AI because it wants to show customers that it has the skills needed to create powerful custom models for them. The company previously revealed to WIRED how it developed DBX, a cutting-edge open source large language model (LLM) from scratch.



Source link

Related posts

Home Depot Promo Codes & Coupons: 50% Off | May 2025

Home Depot Promo Codes & Coupons: 50% Off | May 2025

May 17, 2025
Microsoft Surface Pro 12 Review: Beautiful and Baffling

Microsoft Surface Pro 12 Review: Beautiful and Baffling

May 17, 2025
Previous Post

The D Brief: SecDef’s OPSEC fail; Natsec team’s debate, revealed; SecNav confirmed; Counterterror efforts cut; And a bit more.

Next Post

Nigeria Customs foils attempt to smuggle animal parts in Cross River – EnviroNews

Next Post
Nigeria Customs foils attempt to smuggle animal parts in Cross River – EnviroNews

Nigeria Customs foils attempt to smuggle animal parts in Cross River - EnviroNews

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

RECOMMENDED NEWS

2024 CLF World conference April 1-4, Houston

2024 CLF World conference April 1-4, Houston

1 year ago
Long-unseen Basquiat self-portrait could reach $60m at Sotheby’s New York

Long-unseen Basquiat self-portrait could reach $60m at Sotheby’s New York

2 years ago
Influencer Slammed For Photos in Deadly Canary Islands Cave

Influencer Slammed For Photos in Deadly Canary Islands Cave

2 years ago

St. Kitts and Nevis highlights innovative role of culture and creative industries at UNESCO conference

2 years ago

POPULAR NEWS

  • Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    0 shares
    Share 0 Tweet 0
  • When Will SHIB Reach $1? Here’s What ChatGPT Says

    0 shares
    Share 0 Tweet 0
  • Matthew Slater, son of Jackson State great, happy to see HBCUs back at the forefront

    0 shares
    Share 0 Tweet 0
  • Dolly Varden Focuses on Adding Ounces the Remainder of 2023

    0 shares
    Share 0 Tweet 0
  • US Dollar Might Fall To 96-97 Range in March 2024

    0 shares
    Share 0 Tweet 0
  • Privacy Policy
  • Contact

© 2023 LBNN - All rights reserved.

No Result
View All Result
  • Home
  • Business
  • Politics
  • Markets
  • Crypto
  • Economics
    • Manufacturing
    • Real Estate
    • Infrastructure
  • Finance
  • Energy
  • Creator Economy
  • Wealth Management
  • Taxes
  • Telecoms
  • Military & Defense
  • Careers
  • Technology
  • Artificial Intelligence
  • Investigative journalism
  • Art & Culture
  • Documentaries
  • Quizzes
    • Enneagram quiz
  • Newsletters
    • LBNN Newsletter
    • Divergent Capitalist

© 2023 LBNN - All rights reserved.