NEWS

Evaluating LLMs – What’s the right one for the job?

Evaluating LLMs

Table of Contents

LLMs move so fast. Have you noticed? One minute Open AI’s on top, then Google Gemini, nope wait – now it’s Anthropic. How do you keep up? And perhaps more importantly, how do you pick the right LLM for the job? It’s a tricky business!

At Humaxa we dynamically choose an LLM based on several factors including:

  • Answer Quality
  • Hallucination Rate
  • Performance
  • Response speed

Our tool generates a report including each metric with scores that can be used to compare LLMs. This tool can be incorporated into automated processes using a simple API (Application Programming Interface.)

But why is it important to dynamically choose an LLM?

First of all, it’s like having an army of people ready to work at your company. Some are good at math. Some are good at conversing with customers and understanding their needs. Others are good at

Have you thought about how to dynamically choose an LLM? What decision criteria do you use?

Carolyn Peer

CEO/Co-founder, Humaxa

[email protected]

More News

Automating Code Comments

Automating Code Comments

Introduction In the automotive industry, where software defined vehicles continue their increase in popularity and where software plays a critical role in vehicle functionality and safety, well-documented code is essential....

Read More
RFQ Missteps

RFQ Missteps: How to Avoid them

RFQ Responses: Why are they so laborious? Part 4 – Avoiding missteps Review In my last article, I looked at RFP/RFQ response complexity from the perspective feasibility assessments – how...

Read More