Technology Magazine May 2024 | Page 77

ENTERPRISE IT
languages and skills required to understand the intent behind user queries .
“ There is a wealth of proprietary data available within enterprises in the form of private documents , databases , and mission-critical applications on platforms such as Snowflake Data Cloud or Oracle Cloud ERP , which are integral to business operations ,” he says . “ The knowledge of the business or organisation is contained in this proprietary data , but leveraging it to its full potential has been a challenge .
“ With Gen AI , enterprises start with a generic LLM , sometimes referred to as a foundation model , that has been pre-trained on vast amounts of publicly available data so that it understands human languages and has a broad range of general knowledge .
“ Once a foundation model is customised with proprietary business data , enterprises can create applications that understand a company ’ s specific lingo and deliver up-to-date , businessspecific search results for both employees and customers . In many use cases , a second LLM acts as a monitor for the primary LLM to provide guardrails that prevent interactions from veering into unwanted territory .”
Gen AI for summarisation Distilling lengthy documents or virtual meetings into concise , easy-to-digest notes and bullet points has long been a pain point for businesses . Traditional approaches often require manual effort , which can be time-consuming and prone to errors . technologymagazine . com 77