Tl;dr: Are you finding it difficult to track your LLM costs per project/user? Do you want to set a custom rate/spend-limit for each project/user?

Create a free account and try us out today 😄

Hey everyone, this is @Spike Lu and @Donovan So! We're excited to share that we've launched BricksAI Cloud.

The Problem

A lot of enterprise features are still missing from today's LLM providers, particularly:

1. there isn't a good way of controlling LLM spendings in a granular way (e.g. per user/project/env/feature etc.)
2. there isn't a good way of monitoring LLMs in a granular way

But building an LLM wrapper in-house takes away valuable engineering time from shipping features that actually drive business value.

The solution

BricksAI Cloud is an open-core SaaS solution that protects and monitors your LLM usage. We're a proxy, so instead of using API keys from your providers, you'd create and use Bricks API keys that come with custom limits (e.g. expiry date, rate-limit, or spend-limit).

Demo video ⭐

We currently have official support OpenAI and Anthropic, meaning you’ll be able to accurately track your token usage and cost without any configuration. We also support integrations with custom models.

Over the past few months, we have streamlined LLM operations for a wide range of clients, including a late-stage sustainability tech startup, a major leadership training nonprofit, a top European travel agency, and multiple AI startups.

Now, we're opening up our tool to the world with the launch of BricksAI Cloud. We'd love to see how it can transform your GenAI stack.

The ask

1. Star us on Github ⭐
2. Create a free account and try us out today. Heads up: we require a 15-min account activation call, this helps us get to know your use case better. Don’t worry, it’s super quick and casual!
3. Questions? Feedback? Feature requests? Book a call with us or email founders@bricks-tech.com.