The MNC has partnered a GenAI startup to prove that AI can be implemented reliably, sustainably and securely across its businesses

With the help of the external experts, the firm is fine-tuning the legal output for maximum accuracy and data privacy while minimizing carbon footprints. The project also extends to improving the firm’s customer service levels. The parameters of concern are:

  • The challenges posed by large LLMs — particularly their high costs, data security concerns, and environmental impact
  • Concerns raised by industry studies suggesting that popular LLMs consume 15 times more energy than a typical web search
  • Overcoming the above problems by using smaller and domain-specific LLMs that operate locally within a firm’s own environment (on-premises), to ensure resource-efficient AI and data sovereignty
  • Ensuring that data is not used for training, or retained by the provider of the underlying LLM
  • Leveraging new generation eco-sustainable AI-optimized servers running on processors that offer improved performance per watt across key workloads like AI, data analytics, high-performance computing, and others use cases