The landscape of LLMs has evolved dramatically since ChatGPT burst onto the scene in late 2022. At Mozilla.ai, we’re focused on improving trust in open-source AI by supporting their use in appropriate situations and their proper evaluation.
When deciding on a new Blueprint, we focus on selecting an end application that is both practical and impactful, along with the best techniques to implement it. With endless possible applications of LMs today, selecting one that is actually useful can be challenging.
Lumigator is a developer-first tool designed and built by the community to help engineers evaluate and compare AI models with ease. Lumigator empowers developers to make data-driven choices when integrating AI models into their applications.
Blueprints are customizable workflows that help developers build AI applications using open-source tools and models. In this blog, we’ll dive into our first Blueprint: document-to-podcast. We’ll explain how it works, our technical decisions, and how you can use and customize it yourself.
Developers today face many challenges when trying to integrate AI into their apps or building an “AI solution” from scratch. At Mozilla.ai, we’re committed to breaking down these barriers with Blueprints – our initiative to help developers adopt open-source AI tools and models with confidence.
Lumigator 🐊 is a self-hosted, open-source Python application for evaluating large language models using offline metrics. It targets common machine learning use-cases, starting with summarization, and is extensible at the task and job level.
The behavior of ML models is often affected by randomness at different levels, from the initialization of model parameters to the dataset split into training and evaluation. Thus, predictions made by a model (including the answers an LLM gives to your questions) are potentially different every time you run it.
An MVP for Simplifying AI Model Selection In today’s fast-moving AI landscape, choosing the right large language model (LLM) for your project can feel like navigating a maze. With hundreds of models, each offering different capabilities, the process can be overwhelming. That’s why Mozilla.ai is developing Lumigator,
Introduction We are witnessing explosive growth in the development of artificial intelligence (AI) applications across various industries, from virtual agents to healthcare diagnostics and autonomous driving. This growth is powered by vast datasets and advanced algorithms that enable AI systems to learn and make decisions in real-world scenarios. However, the
Subscribe to receive updates
At the TAUS Massively Multilingual AI conference in Rome, I had the honor of moderating a panel on Multilingual AI provocatively titled “No English Please - How to move towards truly multilingual AI”. In this panel, we explored the pressing need for AI to transcend linguistic barriers and embrace global
Over the past few months at Mozilla.ai, we’ve engaged with a number of organizations to learn how they are using language models in practice. We spoke with 35 organizations across various sectors, including finance, government, startups, and large enterprises. Our interviewees ranged from ML engineers to CTOs, capturing
On our journey toward our product MVP, we are building a platform that will guide users through the process of machine learning model selection by performing evidence-based evaluation. We’re starting with text summarization as a first platform task for two main reasons: First, the product interviews we’ve conducted
In the bustling AI news cycle, where new models are unveiled at every turn, cost and evaluation don’t come up as frequently but are crucial to both developers and businesses in their use of AI systems. It is well known that LLMs are extremely costly to pre-train; but closed
Like our parent company, Mozilla.ai’s founding story is rooted in open-source principles and community collaboration. Since our start last year, our key focus has been exploring state-of-the-art methods for evaluating and fine-tuning large-language models (LLMs), including continued open-source LLM evaluation experiments and establishing our GPU cluster’s infrastructure.
In a year marked by extraordinary advancements in artificial intelligence, largely driven by the evolution of large language models (LLMs), one factor stands out as a universal accelerator: the exponential growth in computational power. Over the last few years, researchers have continuously pushed the boundaries of what a ‘large’ language
After a year of breakneck innovation and hype in the AI space, we have now moved sufficiently beyond the peak of the hype cycle to start asking a critical question: are LLMs good enough yet to solve all of the business and societal challenges we are setting them up for?
Announcing Mozilla.ai, a startup building a trustworthy and open-source AI ecosystem with agency, accountability, and openness at its core. Mozilla will make an initial $30M investment in the company to fund the vision for making it easy to develop trustworthy AI products.
