BerriAI
Call every LLM API like it's OpenAI [100+ LLMs]
Founding Engineer
About the role
Founding engineer will help with migrating key systems to aiohttp, handle LLM provider-specific quirks like Azure role handling, standardize LLMs to OpenAI Spec.
- Strong Python and async framework experience (e.g., aiohttp, FastAPI).
- Familiarity with LLM APIs (OpenAI, Azure, Hugging Face)
- Proven ability to optimize scalable, high-performance systems.
About the interview
Step 1: solve 1 ticket
- allows you to get familiar with litellm
- allows us to evaluate proficiency
Step 2: 2 week work sprint
(gives both people data on what working together would be like)
Step 3 decision + offer
About BerriAI
LiteLLM (https://github.com/BerriAI/litellm) is a Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere] and is used by companies like Rocket Money, Adobe, Twilio, and Siemens.
