Senior Data Pipeline Engineer

Data is at the heart of Gaiascope's mission to provide its sustainable energy clients with superior insights for making strategic and actionable, trading and dispatch decisions. Every day, Gaiascope forecasts more than 38 million individual data points on the electric grid. Each hour we forecast over 700 price points, 900 generating units, 4,400 bus-level loads and 9,800 line and transformer flows.

To power this mission, we are looking for a highly skilled Data Pipeline Engineer to join our team of Software Engineers and Data Scientists. The ideal candidate is passionate about data, is extremely detail-oriented, self motivated, curious, and communicative, and has a diverse software background with extensive experience developing and scaling cloud based pipelines.

You will work closely with data scientists and other stakeholders to understand their data needs and develop solutions that extend the capabilities of our products.

Your role will involve working with a variety of external data sources and ensuring that data is fetched, processed and stored in a way that is both efficient and scalable.

You will also be responsible for monitoring the performance of data pipelines, troubleshooting issues, and implementing improvements to enhance scalability, reliability and observability.

Excellent problem-solving skills, attention to detail, and the ability to work in a fast-paced environment are essential for this role. If you are passionate about data and have the skills and experience we are looking for, we would love to hear from you.

Responsibilities Include:

• Building and maintaining scalable, reliable, observable data pipelines.
• Building and maintaining integrations to sources of weather and grid data.
• Supporting data governance and compliance initiatives.
• Buildings dashboards and tools for monitoring and alerting.
• Contributing to our overall data pipeline architecture.
• Performance tuning and troubleshooting.
• Promoting best practices in data management and pipeline development.
• Participate in code reviews and contribute to team knowledge sharing

Requirements:

• 8-10 years of industry experience as a data, data pipeline, machine learning, or software engineer.
• A track record of building high-volume, low-maintenance data pipelines for machine learning applications. Experience with reliability and hardening a plus.
• Experience with ETL processes and ingesting data from multiple data sources.
• Experience with source code control tools and CI/CD practices.
• Proficiency in a programming language such as Python and a database query language like SQL.
• Knowledge of cloud services (AWS, Azure, or GCP) and their data-related services, as well as orchestration tools such as Dagster (our choice), Prefect, or Airflow.
• Knowledge of data security and privacy practices.
• Understanding of distributed systems.
• Team first mentality.
• Attention to detail.

What We Offer:

Gaiascope is an accomplished and rapidly growing climate tech startup in the sustainable energy sector. You’ll be hands-on with emerging technologies that are already revolutionizing the green energy sector, bettering people and planet. Also:

• Opportunity to work with an innovative team on big, impactful problems.
• A fast-growing startup with a supportive investor base.
• Competitive pay and opportunity for equity.
• Ability to work from home.
• Diverse work with chance to experience all aspects of a premiere start-up.

Employee Programs & Benefits:

Gaiascope offers competitive benefits and programs to support our employees and their families. These include:

• Competitive comprehensive medical, dental, and life insurance benefits.
• Parental and family leave policies.
• Unlimited paid time off.
• Continued learning opportunities.

Visit https://gaia-scope.com to learn more.