The service is targeted at enterprise users and is designed to help businesses understand how well a large language model works for a particular use case.
Credit: Tada Images / Shutterstock
Google Cloud has introduced a new service inside its AI platform Vertex AI to help enterprise users ascertain whether a large language model (LLM) is suitable for a particular use case.
The service, which has been christened the generative AI evaluation service, is also effective in curtailing hallucinations, the company wrote in a blog post.
Hallucinations are faulty responses or outputs that an LLM is prone to generating basis an input when it grows in complexity and is not grounded in the data that it is being asked about.
Retrieval augmented generation (RAG), fine-tuning, and prompt engineering are a few ways to address hallucinations. RAG, for example, grounds an LLM by feeding the model facts from an external knowledge source or repository to improve the response to a particular query.