logo
Published on

Precision AI

Authors
  • avatar
    Name
    Strategic Machines
    Twitter
stack

The Route to Precision

There is a specific shift in the market to Specialized AI. We see it. And we work with it.

While the results of GenAI and generalized models have been astonishing, we’ve noted in prior posts that the risks of AI are too great for companies to deploy to their most sensitive enterprise touch points, like ecommerce or customer support. Advancements in model technology are moving quickly. Yet, given the current state, it appears to us that we are long way from solving for the imprecision of these models with the level of consistent, accurate performance required for customer-facing applications.

Which brings us back to Specialized AI. The advancements in 'function calling' among major model makers like Cohere, Anthropic and OpenAI are pronounced. Our testing has demonstrated excellent results from providing a set of functions and schemas to a model, with the model accurately selecting a function based on the user query. We’ve written about this architecture here and here but only most recently have noted the level of threshold performance needed by enterprise clients. Larger context windows, greater precision in workflow routing and improved methods for structuring responses from the models have contributed to the performance. While we know of one lab that has published disappointing scores on their tests with 'function calling', our experience has been the opposite. The difference may be that we’re deploying functions with uniform architecture, languages, and subject areas, mostly related to business processes or software development activity. Other companies, like DeepL have demonstrated the use of function-calling in language translation, with greater precision and accuracy over generalized models. We see a market shift.

While Generalized models hold great promise, we’re experiencing immediate benefits with Specialized models. Wherever you are in your AI journey, it is worth your time and attention if you need greater precision in your workflows and results. Specialized AI is Precision AI.