IBM-backed llm-d framework adds controls for running AI models in-house

IBM Corp. and several other contributors to the open-source llm-d project are releasing version 1.0 of their distributed ...
FT Markets

llm-d 1.0 Advances Open, Cost-Efficient AI Inference for Production Scale

Today, llm-d project contributors announced the release of llm-d 1.0, a major milestone for the open source project designed to help organizations deploy and scale large language model inference more ...
Open Source For You

Platform Engineering For LLM Applications

Observability, security, and cost control are all critical for LLM applications. Here are a few things you could do to ...
BIOENGINEER

Open-Source AI Grading Platform EvaluAI Turns LLMs Into Classroom Assessment Tools

Researchers at the University of Extremadura have released EvaluAI, an open-source platform that uses large language models ...
Infosecurity-magazine.com

Open Source “b3” Benchmark to Boost LLM Security for Agents

The UK AI Security Institute (AISI) has partnered with the commercial security sector on a new open source framework designed to help large language model (LLM) developers improve security posture.
ZDNet

OpenAI returns to its open-source roots with new open-weight AI models, and it's a big deal

OpenAI releases its first open-source LLMs in six years. OpenAI's smallest AI model can run on a laptop. Early reports indicate these new models may have trouble with hallucinations. Open-weight ...
InfoWorld

Swiss launch open source AI model as “ethical” alternative to big US LLMs

In January, assumptions around AI were shaken up by DeepSeek, a small Chinese company that nobody had heard of. This week it was Switzerland’s turn to stir things up. Apertus (Latin for ‘open’) is a ...
Mashable

Google launches Gemma 4, a new open-source model: How to try it

Google just released its newest AI model Gemma 4, which is now both open and open source. Credit: Thomas Fuller/SOPA Images/LightRocket via Getty Images Google just released the latest version of its ...
InfoWorld

AiSuite: An open-source AI gateway for unified LLM access

Python project from Andrew Ng provides a streamlined approach to working with multiple LLM providers, addressing a significant pain point in the AI development workflow. The proliferation of large ...
Help Net Security

Garak: Open-source LLM vulnerability scanner

LLMs can make mistakes, leak data, or be tricked into doing things they were not meant to do. Garak is a free, open-source tool designed to test these weaknesses. It checks for problems like ...
Forbes

Building Open-Source AI Models That Emphasize Generating Mental Health Advice

Forbes contributors publish independent expert analyses and insights. Dr. Lance B. Eliot is a world-renowned AI scientist and consultant. In today’s column, I examine the development of open-source ...