Section

AI

Models, margins and the business decisions behind applied AI. Reporting and analysis from Fathom Tech.

IBM-backed llm-d framework adds controls for running AI models in-house
Models

IBM's llm-d Framework Reaches 1.0 With Enterprise-Grade Inference Controls

IBM and collaborators released version 1.0 of the open-source llm-d distributed inference framework, introducing operational features designed to let enterprises deploy large language models on their own hardware with better cost efficiency and reliability.

·4 min read

More in AI