DIGITAL TRANSFORMATION
foundation models out there , so for us , we focus on the client and the best technology that could meet their needs .
“ What we ’ ve been doing for the last year or so since the Gen AI craze took off has been to start a set of pilots to help our clients develop Gen AI solutions in areas such as customer service , HR and code development , that utilise some of these foundation models .”
Implementing governance to ensure security Adopting a hybrid approach in AI means the insertion of a crucial layer for governance in terms of AI capabilities , data usage and consumption tracking . “ There is a set of tooling that few others have concerned themselves with , which has to do with things like governance ,” says Ali . “ IMB ’ s platform , called Watsonx , serves as a platform for this .”
Ali explains how IBM has implemented a governance layer along with additional service layers , to ensure that the consumption of foundation models by Gen AI bots , digital workers , or similar entities is conducted in a controlled and secure manner . The discussed layer is responsible for managing and tracking the consumption of AI resources , such as GPUs , to ensure that organisations are not overspending .
“ That layer is essential ,” says Ali . “ Not only is it for governance in terms of what the AI can and can ’ t do , as well as where the data comes from and what the data is going to be used for , but also how much of this AI you ’ re going to consume .
“ For both general and hybrid cloud , people realised how much they were spending . What then happened was a ‘ FinOps ’ category came into existence , just to measure how much was being spent . It will be similar for Gen AI because it ’ s an
technologymagazine . com 61