Senior Data Infrastructure Specialist

We are seeking an experienced Senior Data Infrastructure Engineer to join our team. In this role, you will be responsible for designing and building the next generation of our data platform.

As a key member of our Data Infrastructure team, you will work closely with product managers, data engineers, analysts, and data scientists to develop tooling and infrastructure to support their needs.

Some specific responsibilities of this role include:

• Designing and building the next generation of our data platform
• Developing, running, and supporting our batch and real-time data pipelines using tools like Airflow, PlanetScale, Kinesis, Snowflake, and Tableau, all in AWS
• Collaborating with product managers, data engineers, analysts, and data scientists to develop tooling and infrastructure to support their needs
• Developing automation and tooling to support the creation and discovery of high-quality analytics data in an environment where dozens of changes can be shipped daily
• Implementing systems to monitor our infrastructure, detect, and surface data quality issues

Recent projects that our team has delivered include:

• Refactoring of our MySQL ingestion pipeline for reduced latency and 10x scalability
• Redshift -> Snowflake migration
• Unified Local Analytics Development Environment for Airflow and DBT
• Building our next-generation company metrics framework, adding anomaly detection and alerting, and enabling easier discovery and consumption

To be successful in this role, you should have:

• 5+ years of full-time, professional work experience in the data space using Python and SQL
• Solid experience building and running data pipelines for large and complex datasets including handling dependencies
• Hands-on cloud provider experience (preferably AWS) including service integrations and automation via CLI and APIs
• Solid understanding of data security practices and passion about privacy
• Demonstrated significant impact that your work has had, both on the technology side as well as with the teams you've been part of
• Great sense of what should be worked on next and know how to break big ambiguous problems into small workable chunks
• Lovely helping people grow and recognize where your mentorship might be more valuable than your direct technical contributions on a project
• Care about your craft

It would be beneficial if you have:

• Worked with Apache Airflow - we use Airflow extensively to orchestrate and schedule all of our data workflows. A good understanding of the quirks of operating Airflow at scale would be helpful
• Experience or understanding of tools and technologies included in the modern data stack (Snowflake, DBT)
• Industry awareness of up-and-coming technologies and vendors

We offer a competitive salary and equity in a fast-growing startup. We serve lunch every weekday, plus a variety of snack foods and a fully stocked kitchen. We have a pension scheme and match up to 4%. We provide comprehensive health and dental insurance for you and your dependents. We have open vacation policy and flexible holidays so you can take time off when you need it. We offer paid maternity leave, as well as 6 weeks paternity leave for fathers, to let you spend valuable time with your loved ones. If you're cycling, we've got you covered on the Cycle-to-Work Scheme. With secure bike storage too. We use MacBooks as standard, but we also offer Windows for certain roles when needed.

Intercom is committed to diversity and is an equal opportunities employer. We believe in working under a hybrid in-office model. Are you willing to work from our office location 3 days per week? Please email me about future job openings.