Expert Data Pipeline Architect

5 days ago


Dublin, Dublin City, Ireland UnitedHealth Group Full time
Job Responsibilities
  • Design and build data pipelines (mostly in Databricks/Spark/DBT) to process terabytes of data.
  • Orchestrate in Azure Data Factory/Airflow the data tasks to run on Databricks or Azure Container Instances for the ingestion, processing and cleaning of data.
  • Design, build and maintain Azure Postgres database.
  • Design, build and maintain effective OLTP database optimization tactics to facilitate the processing of large numbers of concurrent updates.
  • Create Docker images for various applications and deploy them on Azure.
  • Design and build best in class processes to clean and standardize data.
  • Design and build tests in Great Expectations/DBT Elementary.
  • Troubleshoot production issues in our Azure Environment.
  • Tuning and optimizing data processes and pipelines.
  • Data Modelling for transactional databases.
  • Data Modelling of big volume datasets to maximize performance for our customers.
  • Sustainment of existing data pipelines.


  • Dublin, Dublin City, Ireland Focus Cloud Group Full time

    Job Description: Senior Data Pipeline ArchitectAbout UsFocus Cloud Group is a leader in delivering innovative cloud-based solutions. We pride ourselves on our commitment to excellence and our dedication to pushing boundaries. Our team of experts works collaboratively to drive business growth and deliver exceptional results.Role SummaryWe are seeking a...


  • Dublin, Dublin City, Ireland Atrium (EMEA) Full time

    Atrium (EMEA) is seeking a skilled Complex Data Pipeline Architect to join our team. As a key member of our data engineering team, you will design and implement complex data pipelines, leveraging Snowflake, Azure, and Airflow.Key Responsibilities:Design and implement high-performance data pipelines using Airflow and Snowflake.Integrate data from diverse...


  • Dublin, Dublin City, Ireland Apple Inc. Full time

    We're looking for a skilled professional to join our Analytics and Data Engineering team as a Staff Software Engineer.In this role, you'll lead the development of a data pipeline knowledge graph, unifying insights on data processing and lineage across the entire Services division.You'll leverage your expertise in Python, Go, and data systems to design and...


  • Dublin, Dublin City, Ireland Realtime Recruitment Full time

    Take Your Technical Leadership Skills to New HeightsAbout the Job:We are seeking a highly skilled Lead Data Architect to drive innovation and efficiency in our data infrastructure.This is an exceptional chance to work on cutting-edge projects, collaborate with global stakeholders, and enjoy the flexibility of hybrid working in Dublin.Key...

  • Data Architect

    4 days ago


    Dublin, Dublin City, Ireland Atrium UK Full time

    Data Architect - DublinAtrium UK is looking for an accomplished Data Architect to support a Dublin based client developing a new cutting-edge data analytics platform, which will support data pipelines that will enable new commercial products. You will research cutting edge big data tools, and design innovative solutions to solve business problems that only a...


  • Dublin, Dublin City, Ireland Tbwa ChiatDay Inc Full time

    Job DescriptionWe're looking for a skilled Solutions Architect to join our Field Engineering team and help drive the growth of our enterprise business.The ideal candidate will have a deep understanding of modern data warehousing architectures and be able to design and implement scalable, secure, and efficient data pipelines using dbt Cloud.In this role, you...

  • Data Architect

    2 weeks ago


    Dublin, Dublin City, Ireland Real Time Recruitment Full time

    Data Architect6-9 Month Daily Rate ContractRemote Work (must be based in Ireland)Are you ready to architect the future of data for leading businesses? Our client is seeking a talented Data Architect, specialized in Microsoft Data Technologies, to join their dynamic team on a contract basis.Relevant Skills Explained:5+ years experience in an IT Architecture...

  • Data Architect

    7 days ago


    Dublin, Dublin City, Ireland Bristol Myers Squibb UK & Ireland Full time

    Job DescriptionWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will be responsible for designing and implementing data architectures that support business decision-making.The ideal candidate will have a strong background in data architecture, with experience working with cloud-based data platforms such as AWS, Azure,...

  • Data Architect- SME

    4 days ago


    Dublin, Dublin City, Ireland TN Ireland Full time

    Social network you want to login/join with:Data Architect- SME (Subject Matter Expert), DublinClient:itContractingLocation:Dublin, IrelandJob Category:OtherEU work permit required:YesJob Reference:26de82ddd548Job Views:3Posted:21.03.2025Job Description:OverviewData Architect- SME (Subject Matter Expert)Job Type: PermanentLocation: Dublin, Ireland – Hybrid,...


  • Dublin, Dublin City, Ireland Realtime Recruitment Full time

    We are seeking an experienced Data Engineer to join our team at Realtime Recruitment. As a member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines for high-frequency and large-scale data processing.You will work closely with our quantitative analysts, traders, and developers to integrate...

  • Data Architect

    3 days ago


    Dublin, Dublin City, Ireland Atrium Uk Full time

    Contract Role – Data Architect – Dublin/Hybrid – 12 Months Initial We are seeking a skilled Data Architect (70% architecture + 30% hands-on technical acumen).You will be part of a newly formed team in our Dublin office that is focused on developing a new, cutting-edge big-data analytic platform that will support data pipelines enabling new commercial...

  • Data Architect

    2 weeks ago


    Dublin, Dublin City, Ireland Brightwater Capital, LLC Full time

    Data Architect12 Month ContractAbout the CompanyOur client is a leading multinational technology services company renowned for their data teams and is known for being a great place to work.About the PositionYou will explore the latest big data tools and create innovative solutions to address business challenges that only a Data Architect can tackle. As part...

  • Data Architect

    4 days ago


    Dublin, Dublin City, Ireland Atrium UK Full time

    Contract Role – Data Architect – Dublin/Hybrid – 12 Months InitialWe are seeking a skilled Data Architect (70% architecture + 30% hands-on technical acumen). You will be part of a newly formed team in our Dublin office that is focused on developing a new, cutting-edge big-data analytic platform that will support data pipelines enabling new commercial...

  • Data Architect

    5 days ago


    Dublin, Dublin City, Ireland Atrium Uk Full time

    Join a highly technical and hands-on team in Dublin, developing a modern big data analytics platform.As a Data Architect, you will design and implement a comprehensive data architecture, ensuring scalability, security, and performance.You must have a broad solution architecture background and the ability to speak to all components of a modern data...


  • Dublin, Dublin City, Ireland Codec Azure Full time

    Senior Microsoft Data ArchitectDepartment: AzureEmployment Type: Full TimeLocation: DublinReporting To: Alberto MerinosDescriptionCodec are recruiting for a Microsoft Data Architect who is knowledgeable and experienced in Business Intelligence and Data Warehousing. This is a great opportunity for an Architect to grow and develop their career in BI and Data...


  • Dublin, Dublin City, Ireland TN Ireland Full time

    Job OverviewWe are seeking a highly skilled and experienced Data Architect to join our team in Dublin. As a Subject Matter Expert, you will play a key role in supporting a major project in the utilities sector.Your Key ResponsibilitiesDeveloping data architecture principles in Azure to meet business needs.Defining reference data architectures that align with...


  • Dublin, Dublin City, Ireland Expleo Full time

    About ExpleoWe are a consultancy team looking for a highly experienced Solution Architect to join us.With experience in the retail franchise sector, you will partner with a prestigious global retail client to design and oversee the implementation of a data platform for a retail franchise.This role demands a deep understanding of data engineering, data...


  • Dublin, Dublin City, Ireland Ergo Full time

    Senior Data Solution Architect (BBBH3010) Dublin, Republic of IrelandOverview of RoleErgo is a leading technology solutions provider. We are the 2024 Microsoft Ireland Country Partner & the 2024 Dynamics 365 Sales & Customer Insights Partner of the Year.Due to rapid growth in our data and AI business, we are currently recruiting for a senior data architect...

  • Data Architect- SME

    4 weeks ago


    Dublin, Dublin City, Ireland itContracting Full time

    Overview Data Architect- SME (Subject Matter Expert) Job Type: Permanent Location: Dublin, Ireland – Hybrid, 1 – 2 days onsite per week at customer office. The Role A  Subject Matter Expert: Data Architect  to support a key project in the utilities sector . Key responsibilities: Understanding business requirements relating...


  • Dublin, Dublin City, Ireland Flywheel Full time

    About the JobFlywheel is seeking a talented Senior Data Engineer to join our team.This individual will be responsible for designing and developing high-quality data pipelines using leading-edge cloud technologies.The ideal candidate will have a strong background in software development, data modeling, and experience working with cloud-based technologies.Key...