TL;DR

Benchify is a code review tool that uncovers real bugs by actually running your code on strategically generated inputs, using methods typically restricted to rocket science and chip design.  When errors are found, Benchify provides verified bugs, unit tests, and a patch (coming soon).

The problem

Engineers (like you) spend almost half their time testing and debugging, which, let’s be honest, they’d rather spend doing literally anything else.

• Lower velocity: Projects are delayed by testing & debugging
• Site outages: Despite all the effort, critical errors slip through, leading to site outages and other failures
• Low test coverage: Developing exhaustive tests is nearly impossible and generally put off for later…
• Shallow test depth: Testing is limited to a few hard-coded cases

The solution

We test your code using magic (ok, formal methods) and deliver the results in an actionable comment on your PR.

• Automatic logical blueprint: Benchify automatically writes a blueprint that says how your code is intended to function
• Run thousands of tests: Benchify tests your code against the blueprint using thousands of strategically generated inputs
• Provide counterexamples: Concrete, minimal counterexamples are provided when code fails so you can easily debug
• Generate unit tests: We automatically translate counterexamples into unit tests for easy reproducibility and test-driven development
• Propose solutions: When Benchify detects an error, it attempts to propose a solution, which it subjects to the same battery of tests as the original code

Does it work?

The testing techniques Benchify uses are typically leveraged for mission critical use cases, such as silicon chip design, rocket engineering, and high-speed trading. Our secret sauce is in making these techniques usable and actionable.

The Team

Max and Juan first met as bright-eyed freshmen at Dartmouth College almost a decade ago and have been fast friends and on-and-off roommates since.  They’re deeply passionate about software assurance (who isn’t?) and excited to test your code.

• Max holds a PhD in Computer Science from Northeastern University, focused on security and interactive theorem proving. He has worked at NASA, the DoD 😉, and Galois. Most importantly, he holds a Blue Belt from 10th Planet Jiu Jitsu.
• Juan built and sold a business, helped companies like Instawork and Klaviyo grow, and advised on deals at McKinsey. Juan double-majored in Economics and survival skills at Dartmouth (okay, the second one isn’t official), and later picked up an MBA from MIT, where he unfortunately missed out on a chance to test his skills with the pirate certificate.

Asks

• Hop on a call with us to try out Benchify or talk about your frustrations with software testing
• Try out our beta code reviewer and give us feedback
• Shoot us an email at hello@benchify.com with your biggest backend software testing pain points, and we’ll see if we can help out!