llamafile Reloaded: What’s New in v0.10.0
llamafile 0.10.0 unifies portability and modern model features. Bundle weights, run multimodal models, and access tool calling and Anthropic Messages API support, all from a single executable.
Latest
When Shipping Becomes Too Easy
AI is changing product development. When building becomes effortless, the real constraint is no longer code. It’s clarity, product judgment, and knowing when the right decision is not to ship yet.
Federate Phishing Detection: Training a URL Classifier without Sharing Browsing Data
Mozilla.ai joins Flower Hub as a launch partner with fed-phish-guard, a federated phishing detection project. The classifier trains across distributed clients and shares only model updates, allowing collaborative learning without centralizing browsing data.
Owning Code in the Age of AI
AI lets engineers generate thousands of lines of code in minutes. But humans still reason about systems slowly. That gap forces a rethink of ownership, reliability, and where safety really lives in modern software systems.
The Star Chamber: Multi-LLM Consensus for Code Quality
The Star Chamber runs code reviews across multiple LLM providers and aggregates their feedback by consensus. Instead of relying on one model’s perspective, developers get a structured view of where models agree, disagree, and raise unique insights.
any-llm in the Wild: Three Integrations as We Grow Our Ecosystem
any-llm now integrates with JupyterLiteAI, LangChain, and Headroom. A single provider-agnostic layer powering notebooks, agents, and context optimization across OpenAI, Anthropic, Mistral, and local models.
Run OpenAI, Claude, Mistral, llamafile, and more from one interface, now in Go!
Run any model, from any provider, like OpenAI, Claude, Mistral, or llamafile from one interface, now in Go. any-llm-go delivers type-safe provider abstraction, channel-based streaming, and normalized error handling across eight providers.
Integrating Alinia into any-guardrail for Multilingual AI Security
The newest integration with any-guardrail: Alinia AI, whose security models are specifically built to detect threats like prompt injection, data exfiltration, and policy violations by understanding the cultural and linguistic nuances of multilingual AI interactions.
Evaluating Multilingual, Context-Aware Guardrails: Evidence from a Humanitarian LLM Use Case
A technical evaluation of multilingual, context-aware AI guardrails, analyzing how English and Farsi responses are scored under identical policies. The findings surface scoring gaps, reasoning issues, and consistency challenges in humanitarian deployments.
The Misunderstood Small Model Market: A Look Beyond OpenRouter's Data
The State of AI report from OpenRouter and a16z offers valuable insight into API-based model usage. But many small models run locally on CPUs and consumer GPUs, outside managed services. This finding, however, warrants critical examination.
Octonous: Making AI useful for everyday work
Octonous helps people stay in flow while work runs across connected apps. The assistant takes real actions, reads messages, updates tools, and creates items while showing every step and asking for approval before anything changes.
AI Generated Code Isn’t Cheating: OSS Needs to Talk About It
Remember early 2025? "Vibe coding" was a meme and seemed mostly a tool for casual builders or those new to coding. It's now 2026, and we find ourselves living in a new reality. Industry leaders like DHH, Karpathy, and Lutke are publicly embracing AI-generated code controlled by human prompting.
Product Release
Secure Your Keys, Track Your Costs: any-llm Managed Platform Enters Open Beta
Secure, encrypted LLM API key management across OpenAI, Anthropic, Google providers. Track costs, set budgets, avoid vendor lock-in. Free beta access now.
Product Release
mcpd Plugins: Extend Your Agent Infrastructure Without Touching Your Code
The new plugin system transforms mcpd from a tool-server manager into an extensible enforcement and transformation layer—where authentication, validation, rate limiting, and custom logic live in one governed pipeline.
Announcement
Building in the Open at Mozilla.ai: 2025 Year in Review
The year 2025 has been a busy one at Mozilla.ai. From hosting live demos and speaking at conferences, to releasing our latest open-source tools, we have made a lot of progress and more exploration this year.
Technical Content
Polyglot AI Agents: WebAssembly Meets the Java Virtual Machine (JVM)
Leverage the JVM's polyglot capabilities to create a self-contained, enterprise-optimized server-side blueprint that combines the performance benefits of WebAssembly with the reliability and maturity of Java's ecosystem.
Product Release
Introducing any-llm managed platform: A secure cloud vault and usage-tracking service for all your LLM providers
any-llm managed platform adds end-to-end encrypted API key storage and usage tracking to the any-llm ecosystem. Keys are encrypted client-side, never visible to us, while you monitor token usage, costs, and budgets in one place. Supports OpenAI, Anthropic, Google, and more.
Product Release
Encoderfile v0.1.0: Deploy Encoder Transformers as Single Binary Executables
Encoderfile compiles encoders into single-binary executables with no runtime dependencies, giving teams deterministic, auditable, and lightweight deployments. Built on ONNX and Rust, Encoderfile is designed for environments where latency, stability, and correctness matter most.
Product Release
mcpd-proxy: Centralized Tool Access for AI agents in VS Code, Cursor, and Beyond
With mcpd-proxy, teams no longer juggle multiple MCP configs. Run all servers behind one proxy and give every developer the same zero-config access inside their IDE.
Product Release
Control LLM Spend and Access with any-llm-gateway
Gain visibility and control over your LLM usage. any-llm-gateway adds budgeting, analytics, and access management to any-llm, giving teams reliable oversight for every provider.
Technical Content
Can Open-Source Guardrails Really Protect AI Agents?
AI Agents extend large language models beyond text generation. They can call functions, access internal and external resources, perform deterministic operations, and even communicate with other agents. Yet, most existing guardrails weren’t built to protect these operations.
Product Release
Run Any LLM with a Single API: Introducing any-llm v1.0
Run any model like OpenAI, Claude, Mistral, or llama.cpp from one interface. any-llm v1.0 delivers production-ready stability, standardized reasoning output, and auto provider detection for seamless use across cloud and local models.
Product Release
llamafile Returns
Mozilla.ai is adopting llamafile to advance open, local, privacy-first AI—and we’re inviting the community to help shape its future.
Product Release
Introducing any-guardrail: A common interface to test AI safety models
Building AI agents is hard, not just due to LLMs, but also because of tool selection, orchestration frameworks, evaluation, safety, etc. At Mozilla.ai, we’re building tools to facilitate agent development, and we noticed that guardrails for filtering unsafe outputs also need a unified interface.