Confident AI
Open-Source Unit Testing for LLM Applications
Founding Fullstack (Infrastructure) Engineer
About the role
What you'll be doing:\
- Working on Confident AI, the DeepEval cloud platform.\
- Scale Confident AI's backend infrastructure to process millions of evaluations a month.\
- Deploying Confident AI on-premises for enterprises.\
- Support our closed-source customers and help them with anything they might need.\
- Occasionally, write interesting content around how you're scaling Confident AI's systems for the developer community.
You should be able to:\ - Write SQL, and be an expert in scaling relational database systems (PostgresQL).\
- Dockerize distributed, and have experience working with the AWS services such as EKS.\
- Conduct on-premise deployments in our customers' cloud providers such as AWS, Azure, and GCP.\
- Work with multi-tenant (authentication) systems.\
- Follow best data practices to ensure we remain SOCII and HIPAA complied.\
- Code proficiently and quickly in Python and Typescript.\
- Work 6 days a week, we're not hiding we expect a lot from you.
Your work will:\ - Be used by hundreds of engineering teams, all the way from individual developers to Fortune 500 companies.\
- Enable hundreds of engineering teams to gain instantly visibility into the performance of their LLM applications that wouldn't otherwise be possible.\
- Make DeepEval even more popular (counter-intuitively).\
- Be respected and appreciated by our customers.
By joining us, you will:\ - Bring LLM testing and evaluation to the largest companies available.\
- Learn how to serve enterprise customers as a startup, in a relatively safe environment.\
- Work closely with the founders, with the possibly of promoted to an executive role in the future.\
- Be compensated highly, with generous founding equity. This also means that we expect a lot from you.
About the interview
The entire process is usually remote and most communication happens over email or via video chat in Google Meet. We know that you may be interviewing elsewhere as well so am respectful of your time and will get back no later than 2 days of each step along the process.
The entire process has 4 steps and takes around 1.5 week in total:
- Initial 15-30 minute phone screening interview.
- One 30-45 minute technical interview.
- One week fully-paid work trial.
- Full-time offer.
You'll be working with the founders directly throughout the entire process.
About Confident AI
Confident AI is the leading LLM evaluation platform that helps teams evaluate, test, benchmark, optimize, monitor, and red-team LLM applications. Powered by DeepEval, the go-to LLM evaluation framework with over 600k monthly downloads, 5.3k GitHub stars, and over 40 million evaluations conducted, Confident AI is trusted by hundreds of companies from leading startups to international corporations.
