Introducing the Langroid Blog & Newsletter
Simplifying LLM app development with Multi-Agent Programming
The LLM Opportunity
Given the remarkable abilities of recent Large Language Models (LLMs), there is an unprecedented opportunity to build intelligent applications powered by this transformative technology. The top question for any enterprise is: how best to harness the power of LLMs for complex applications? For technical and practical reasons (such as limited context length, LLM brittleness, hallucinations, and token costs), building LLM-powered applications is not as simple as throwing a task at an LLM-system and expecting it to do it.
Why Agents?
Effectively leveraging LLMs at scale requires a principled programming framework. In particular, there is often a need to maintain multiple LLM conversations, each instructed in different ways, and "responsible" for different aspects of a task.
An agent is a convenient abstraction that encapsulates LLM conversation state, along with access to long-term memory (vector-stores) and tools (a.k.a functions or plugins). Thus a Multi-Agent Programming framework is a natural fit for complex LLM-based applications.
Langroid Framework
Langroid is the first open source Python LLM-application framework built from the ground up with Agents as first-class citizens, and Multi-Agent Programming as the core design principle.
Langroid allows an intuitive definition of agents, tasks and task-delegation among agents. There is a principled mechanism to orchestrate multi-agent collaboration. Agents act as message-transformers, and take turns responding to (i.e., transforming) the current message. The architecture is lightweight, transparent, flexible, and allows other types of orchestration to be implemented.
To create an LLM application using Langroid, you set up Agents, equip them with optional components (LLM, vector-store and methods), assign them tasks, and have them collaboratively solve a problem by exchanging messages. This Multi-Agent paradigm is inspired by the Actor Framework (but you do not need to know anything about this!).
Langroid is a fresh take on LLM app-development, where considerable thought has gone into simplifying the developer experience. It does not use Langchain
or Llama-Index
.
Langroid was founded by Prasad Chalasani and Somesh Jha. In future posts the founders and guest authors will share updates about Langroid, specific types of agents and applications we have built, as well as general LLM-related musings, ideas and research. Subscribe to our newsletter to stay updated: