Data Engineer

3 weeks ago


Dublin, Dublin City, Ireland Twilio Full time

See yourself at Twilio

Join the team as Twilio's next Data Engineer, Messaging Data Platform team.

Who we are & why we're hiring

Twilio powers real-time business communications and data solutions that help companies and developers worldwide build better applications and customer experiences.

Although we're headquartered in San Francisco, we have presence throughout South America, Europe, Asia and Australia. We're on a journey to becoming a global company that actively opposes racism and all forms of oppression and bias. At Twilio, we support diversity, equity & inclusion wherever we do business.

About the job

This position is needed to build and maintain highly scalable, reliable, and efficient data pipelines that will empower both inbound and outbound messaging stacks, not to mention other internal engineering solutions, with its data insights interfaces for real-time decision-making.

Responsibilities

In this role, you'll:

  • Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems).
  • Design and implement efficient data pipelines for the acquisition, storage, and analysis of large datasets.
  • Collaborate with cross-functional teams to understand data requirements and implement solutions.
  • Ensure the availability and integrity of data pipelines and systems.
  • Optimize and fine-tune performance of data solutions.
  • Troubleshoot and resolve data-related issues in a timely manner.
  • Develop and maintain documentation for data processes and pipelines.
  • Stay abreast of emerging technologies and industry trends related to data engineering.
  • Create tools that make it easy for non-technical users to easily, and reliably, transform and query data.

Qualifications

Not all applicants will have skills that match a job description exactly. Twilio values diverse experiences in other industries, and we encourage everyone who meets the required qualifications to apply. While having "desired" qualifications make for a strong candidate, we encourage applicants with alternative experiences to also apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table

Required:

  • 3+ years of experience with Big Data processing tools and frameworks such as Apache Spark, PySpark, SparkSQL.
  • Deep technical understanding of ETL tools, low-latency data stores, multiple data warehouses and data catalogs.
  • Familiarity with data testing and verification tooling and best practices.
  • Experience with cloud services (AWS preferred, Google, Azure etc.)
  • Proficient in working with Key-Value, Streaming, and Search Database technologies, including AWS DynamoDB, Apache Kafka, and ElasticSearch.
  • Readiness to participate in the on-call rotation.

Desired:

  • Experience with Lakehouse technologies, such as Apache Hudi, Apache Iceberg, Databricks Delta Lake.
  • Experience in building AI/ML pipelines.
  • Demonstrated technical breadth and depth as evidenced by papers, code, and/or presentations.
  • Experience in high-level programming languages, like Java, Python, Scala.
  • Exposure to service-oriented architectures, microservices and REST APIs.
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Bachelor's degree in Computer Science, Engineering or a related field, or equivalent training, fellowship, or work experience.

Location

This role will be based in Dublin or remotely in Ireland.

Travel

We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

There are many benefits to working at Twilio, including, in addition to competitive pay, things like generous time-off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic. Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now

If this role isn't what you're looking for, please consider other open positions.


#J-18808-Ljbffr

  • Dublin, Dublin City, Ireland Veda Data Full time

    Veda helps patients get the care they need by untangling complex data management problems using advanced scientific approaches and in-depth collaboration. Our technology reflects what our people provide: quality without ego, honesty backed by science, and warmth in an industry not known for having much heat. Veda is made up of talented professionals that...

  • Senior Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland DATA MART Consulting GmbH Full time

    eir evo talentare currently seeking applicants for aSenior Data Engineer.This is a12 month daily rate contractposition located with our client inDublin City Centre. This is a hybrid role,requiring2 days on-siteper week.Key ResponsibilitiesWork with senior managers and executives to establish the vision for managing data as a business asset.Take authority,...


  • Dublin, Dublin City, Ireland Veda Data Solutions Full time

    Veda helps patients get the care they need by untangling complex data management problems using advanced scientific approaches and in-depth collaboration. Our technology reflects what our people provide: quality without ego, honesty backed by science, and warmth in an industry not known for having much heat.Veda is made up of talented professionals that are...


  • Dublin, Dublin City, Ireland DATA MART Consulting GmbH Full time

    The ultimate purpose of technology teams in GxP environments is to serve the evolving needs of the business. We are a specialist provider of consultancy and implementation services for IT infrastructure and data architectures within life science manufacturing. Our role is to be a companion on the road for technology teams to be able to use as a tool at times...


  • Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Do you enjoy using network and Unix systems engineering to provide simple, sustainable, and repeatable solutions? Are you interested in playing a critical role in ensuring the stability and longevity of future networks?About the Role:AWS Infrastructure Services is responsible for the design, implementation, and maintenance of all AWS global infrastructure....


  • Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Do you like to use network and Unix systems engineering to deliver simple, sustainable, and repeatable solutions? Would you like to play a key role in driving the stability and sustainability of next-generation networks?AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the...

  • Advanced Data Analyst

    3 weeks ago


    Dublin, Dublin City, Ireland DATA MART Consulting GmbH Full time

    Honeywell Connected Enterprise, a software development company, is seeking an Advanced Data Analyst to join their team in Dublin. In this role, you will manage data analytics processes for Legal and Sourcing initiatives. You will work closely with cross-functional teams and develop robust analytics frameworks to track legal and procurement metrics. By...

  • Data Engineer

    4 days ago


    Dublin, Dublin City, Ireland GRIFOLS, S.A. Full time

    Would you like to join an international team working to improve the future of healthcare? Do you want to enhance the lives of millions of people? Grifols is a global healthcare company that since 1909 has been working to improve the health and well-being of people around the world. We are leaders in plasma-derived medicines and transfusion medicine and...

  • Data Engineer

    5 days ago


    Dublin, Dublin City, Ireland Grifols Shared Services North America, Inc Full time

    Would you like to join an international team working to improve the future of healthcare? Do you want to enhance the lives of millions of people? Grifols is a global healthcare company that since 1909 has been working to improve the health and well-being of people around the world. We are leaders in plasma-derived medicines and transfusion medicine and...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland The Irish Times Full time

    We are in search of a skilled Data Engineer to join our proactive Group Analytics & Insights team to help us develop and maintain robust data pipelines, infrastructure, and analytics systems. As a Data Engineer at The Irish Times, you will be essential in ensuring the availability, reliability, and scalability of our data infrastructure. Your...

  • Data Engineer

    1 month ago


    Dublin, Dublin City, Ireland SODA Full time

    Data Engineer (MI Reporting)We've just had a new role go live with a long term client of mine in the insurance space. They're a thriving local business who are searching for a Data engineer to join their analytics team. The team expanded last year but after signing off a number of new projects they're adding another member to understand the business needs...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Adaid Eu Full time

    It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're looking to write mobile app code, engineer the servers behind our massive ad tech stacks, or develop algorithms to help us process trillions of data points a day, what you do here will have a huge impact on our business—and the world. Want...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Microsoft Full time

    OverviewJoin our Small and Medium Business (SMB) Engineering team to help unlock the potential of this rapidly growing segment. We are a creative and determined team focused on fostering an experimentation culture within the E+D family. Despite being a recent addition, we have the opportunity for substantial growth and impact, specifically in accelerating...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Ryanair Full time

    Ryanair Labs is the technology brand of Ryanair, a start-up inside a corporation and a state of-the-art digital & IT innovation hub creating Europe's Leading Travel Experience for customers. More than 600+ IT enthusiasts are working on 30+ projects with a collaboration of our Dublin, Madrid, Wroclaw and Portugal Labs teams and are making your travel...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Flywheel Digital Full time

    OpportunityWe are looking for a Senior Data Engineer to join our team. The best candidates will hit the ground running and contribute to our data team as we develop and maintain necessary data automation, reports, ETL/ELT, and quality controls using leading-edge cloud technologies. You will have a deep knowledge and understanding of all stages in the...

  • Data Engineer

    1 week ago


    Dublin, Dublin City, Ireland RenaissanceRe Full time

    RenaissanceRe is a leading writer of Property & Casualty Reinsurance. For over 25 years, we have helped customers and communities recover and build resilience through our industry-leading ability to understand risk, source efficient capital and rapidly pay claims.Our global team shares a passion for solving our customers' biggest problems through a...

  • Data Center Manager,

    3 weeks ago


    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services Team - Join Us! Are you ready to be a part of the team that keeps the cloud running smoothly? We are on the lookout for talented individuals who are eager to take on challenging problems and make a difference. What We Do: Support all AWS data centers and equipment to ensure continuous access to innovation. Collaborate with a...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Tenable Full time

    Tenable is known as the Exposure Management company, with 44,000 organizations worldwide choosing Tenable to manage and minimize cyber risk. The global team supports 65 percent of the Fortune 500, 45 percent of the Global 2000, and significant government agencies. Join us on our journey! Why Tenable is a fantastic place to build your career:Collaborative...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Clear Strategy Full time

    We have a number of positions open and are looking for Data Engineers with various levels of experience ranging from junior (2-3 years) to experienced (5+ yrs.). The responsibilities and expectations listed in this job description will therefore vary based on your level of experience.About UsClear Strategy is a fast-growing professional services & solutions...

  • Sr Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland People Can Fly Full time

    People Can Fly is seeking a Senior Data EngineerWho doesn't want to work at a place called People Can Fly, right? Hey, they are looking for someone awesome to join their Game Analytics team! So, if you're passionate about building cutting-edge game analytics platforms and tools to boost player experiences, keep on reading.ResponsibilitiesCollaborate with...