Head of Engineering

++++

Please apply to this role on our website

https://www.atla-ai.com/jobs/head-of-engineering

++++
As Atla’s Head of Engineering, you will lead and scale our engineering team, driving the technical execution of language model training, evaluation, and deployment. As part of your role, you will:

• Design, implement, and manage robust APIs to facilitate access to fine-tuned language models, ensuring scalability and security for high-stakes applications.
• Lead and empower a world-class engineering team, setting a high bar of excellence that propels Atla forward.
• Design and optimise a scalable post-training framework to efficiently manage training runs while controlling costs.
• Engineer robust, high-performance inference platforms to ensure our models' reliability, throughput and speed at scale.
• Partner with the research team to accelerate the iteration of new research ideas and improve training workflows.

Please note that this role is in-person (we can sponsor visas and offer international relocation support as a UK AI Futures partner)

Qualifications

Proven engineering leadership ability:

• Track record of 5+ years in software or ML engineering, focusing on building robust, scalable systems.
• Demonstrated success leading teams, fostering collaboration and achieving significant milestones.
• Skilled in creating and managing multi-instance clusters for data and model parallel training on GPUs/TPUs, preferably using DeepSpeed or PyTorch FSDP.
• Experience with orchestration systems like SLURM or Ray, along with MLOps tools such as Kubernetes, Vertex, or Sagemaker.
• Proficient in serving large machine learning models at scale, including quantization, distributed computing, and using frameworks like vLLM or Ray Serve.

Nice to have

• Experience at a leading machine learning company (Mistral, Anthropic, X.ai, HuggingFace, Neuralink, OpenAI, etc.)
• Publications in top AI conferences.
• Interested in and thoughtful about of the impacts of AI technology.

About you

You are going to thrive at Atla with the following mindset:

• Collaborative and team-oriented, with strong communication skills.
• Comfortable with the uncertainty of a hyper-growth startup.
• Unpretentious and hard working; find the best ideas wherever they come from.

Compensation

• £150K - £300K
• Significant stake in equity as one of our core technical leaders
• Pension plan with employer contributions
• Medical, dental, and vision benefits

Join us in making a dent in the universe by engineering safe, beneficial AI systems!