Key Takeaways
- Chinese tech giant Alibaba has developed a new method, ZeroSearch, that dramatically cuts the cost of training AI for search tasks by nearly 90%.
- ZeroSearch uses simulations, allowing AI models to learn and improve their search abilities without constantly using expensive commercial search engines.
- This approach makes advanced AI search development more affordable and accessible, particularly for smaller teams or those with limited budgets.
- It works by using an AI model, already rich in knowledge, to act as a simulated search engine to train other AI systems.
Tech company Alibaba Group Holding has announced a significant step forward in making artificial intelligence more affordable. They’ve found a way to slash the expenses of training AI models for search functions by almost 90%.
Researchers at Alibaba introduced an innovative technique called ZeroSearch. This method, detailed in a research paper, helps AI models get better at searching by using simulations. This means the AI doesn’t need to interact with actual search engines during much of its training.
This is a big deal because it sidesteps the hefty fees usually involved when AI training requires sending countless queries through commercial search engines. Instead, ZeroSearch enables AI models, which are already trained on vast amounts of information, to generate quality answers on their own in response to search queries.
Essentially, ZeroSearch transforms an existing AI model into a kind of internal search engine. This “trainer” AI then teaches other AI systems how to handle queries. This greatly reduces the need for costly external search infrastructure.
The practical impact is substantial. For example, training an AI by sending 64,000 queries to Google via its programming interface might cost around $58,670. According to Alibaba’s findings, using their ZeroSearch method with a large AI model to generate responses for similar training could cost as little as $7,080. That’s a cost reduction of 88%.
This breakthrough could make sophisticated AI search technology much more accessible, helping more developers and companies enhance their AI capabilities without facing prohibitive costs. The details were published last week, according to the South China Morning Post, which is owned by Alibaba.
