Current jobs related to Expert in Scalable Data Pipelines and ETL Processes - Dublin, Dublin City - Realtime Recruitment


  • Dublin, Dublin City, Ireland Solas IT Recruitment Full time

    Job RequirementsThe ideal candidate will have strong experience in data engineering with Azure or AWS, with hands-on expertise in Databricks, Delta Lake, Data Factory, and NoSQL databases.ResponsibilitiesDesign and develop scalable ETL/ELT pipelines for data transformation.Manage Data Lakes and big data frameworks, ensuring performance and...


  • Dublin, Dublin City, Ireland Solas IT Recruitment Full time

    About the RoleThe ideal candidate will have strong experience in designing and optimizing Data pipelines, with expertise in data engineering and analytics. The role involves managing Data Lake architectures on Azure or AWS, and leveraging tools like Databricks, Data Factory, Delta Lake, NoSQL, and Spark.ResponsibilitiesDevelop and maintain scalable ETL/ELT...


  • Dublin, Dublin City, Ireland Amazon Full time

    The DISCO team at Amazon Music is looking for a talented data engineer to lead the design and implementation of scalable data solutions. With a strong background in data engineering, you will be responsible for fostering a collaborative culture, driving innovation in big data solutions, and ensuring data governance, security, and privacy best practices.Your...

  • Data Engineer

    6 days ago


    Dublin, Dublin City, Ireland Atrium Uk Full time

    Job Description:Atrium Uk seeks a skilled Data Engineer to design and implement scalable data pipelines using Azure Databricks and Azure Data Lake.Responsibilities:Develop and maintain ETL workflows to ensure data quality, integrity, and availabilityManage and analyze data at scale within the Azure ecosystemDevelop and optimize graph database solutions using...


  • Dublin, Dublin City, Ireland HCLTech Full time

    HCLTech is a leader in the IT services industry with a strong focus on innovation and excellence.We are seeking an ETL Solutions Architect to lead the development and implementation of complex data pipelines using Python and Tableau.The role involves designing and implementing scalable solutions that meet the needs of our clients.The ideal candidate will...


  • Dublin, Dublin City, Ireland Solas It Recruitment Full time

    About the RoleWe are seeking a highly skilled Senior Data Architect to join our team. As an expert in data engineering and analytics, you will be responsible for designing and optimizing data pipelines, managing data lake architectures on Azure or AWS, and leveraging tools like Databricks, Data Factory, Delta Lake, NoSQL, and Spark.Key...


  • Dublin, Dublin City, Ireland Solas It Recruitment Full time

    About the JobWe are seeking a highly skilled Data Transformation Specialist to join our team. As an expert in data engineering and analytics, you will be responsible for designing and optimizing data pipelines, managing data lake architectures on Azure or AWS, and leveraging tools like Databricks, Data Factory, Delta Lake, NoSQL, and Spark.Key...


  • Dublin, Dublin City, Ireland Atrium UK Full time

    Key Responsibilities:Atrium UK requires an experienced Senior Data Engineer with expertise in graph databases to join its dynamic team. The ideal candidate will have a strong background in data engineering, graph querying languages, and data modelling, with a keen interest in leveraging cutting-edge technologies like vector databases and LLMs to drive...


  • Dublin, Dublin City, Ireland Auxilion Full time

    Auxilion, a leading Irish-owned organisation, seeks a highly skilled Data Transformation Expert to join its team. As a key member of the company's data strategy, you will be responsible for designing and developing large-scale data analytic solutions using Microsoft Fabric.The ideal candidate will have extensive experience in data engineering, with a strong...

  • Big Data/etl

    23 hours ago


    Dublin, Dublin City, Ireland Adecco UK Limited Full time

    Big data/ETL /SQL Data Engineer Dublin contract.My client a leading global name is in urgent need of a talented and experienced ETL Data Engineer to join them on a contract basis for 6-18 months with extensions.The role encompasses the full development lifecycle: requirements, design, develop, document, test and deploy You will be: working in an agile team,...


  • Dublin, Dublin City, Ireland Amazon Full time

    As a seasoned data engineer, you will lead a team of experts to design and implement scalable data pipelines that empower Amazon Music's business domains. With a strong background in cloud technologies, you will foster a collaborative culture and drive innovation in big data solutions.The DISCO team relies on you to develop high-quality data engineering...

  • Data Engineer

    4 weeks ago


    Dublin, Dublin City, Ireland Eolas Recruitment Full time

    Our Dublin based client is looking for a Data Engineer to join their team on a daily rate contract basis. The ideal candidate will have extensive experience in ETL architecture and BI solution development. This role involves designing, constructing, installing, testing, and maintaining highly scalable data management systems, ensuring optimal ETL (Extract,...

  • Data Engineer

    3 weeks ago


    Dublin, Dublin City, Ireland Luxevision Consulting LLC Full time

    About Us:Luxe Vision Consulting is a Wisconsin-based consulting firm dedicated to connecting top global talent with leading U.S. companies. We specialize in sourcing skilled professionals, conducting rigorous screening and technical assessments, and preparing candidates for opportunities in the U.S. job market.Our mission is to bridge the gap between...


  • Dublin, Dublin City, Ireland Solas IT Recruitment Full time

    Job DescriptionWe are seeking a skilled Data Engineer with expertise in data engineering and analytics to design and optimize Data pipelines. The role involves managing Data Lake architectures on Azure or AWS, and leveraging tools like Databricks, Data Factory, Delta Lake, NoSQL, and Spark.Key ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines...


  • Dublin, Dublin City, Ireland Apple Inc. Full time

    We're looking for a skilled professional to join our Analytics and Data Engineering team as a Staff Software Engineer.In this role, you'll lead the development of a data pipeline knowledge graph, unifying insights on data processing and lineage across the entire Services division.You'll leverage your expertise in Python, Go, and data systems to design and...


  • Dublin, Dublin City, Ireland Eirevo Full time

    We are looking for a skilled Data Engineer to join our team in Dublin. In this hybrid role, you will work on developing, testing, and supporting scalable data pipelines.This role involves:Designing and implementing data architecture solutions using Azure and Fabric Services.Migrating existing systems to Microsoft Fabric Platform.To succeed in this position,...


  • Dublin, Dublin City, Ireland Fruition Group Full time

    My Dublin City Centre based client looking for an experienced Senior Data Warehouse Developer to join a growing data team and help drive the design, development, and optimisation of scalable data warehouse solutions. This role involves working closely with stakeholders across the business to understand data needs, shape data models, and build robust ETL...


  • Dublin, Dublin City, Ireland Fruition Group Full time

    About the Role">Fruition Group is seeking a highly skilled Senior Data Warehouse Developer to join our data team and contribute to the design, development, and optimisation of scalable data warehouse solutions. This role involves working closely with stakeholders across the business to understand data needs, shape data models, and build robust ETL pipelines...


  • Dublin, Dublin City, Ireland Pulsate Mobile, Ltd. Full time

    Company Overview:Pulsate Mobile, Ltd. is a pioneering mobile engagement platform serving the financial sector.We provide personalized, real-time messaging to customers, ensuring institutions are top of mind for financial decisions.In a nutshell:We develop technology driving personalization and growth in finance. Backed by experts, we have partnered with...


  • Dublin, Dublin City, Ireland Adecco UK Limited Full time

    Adecco UK Limited is in urgent need of a talented and experienced ETL Data Engineer to join their team on a contract basis for 6-18 months with extensions. The role encompasses the full development lifecycle: requirements, design, develop, document, test and deploy.You will be working in an agile team, delivering solutions to restructure, simplify and...

Expert in Scalable Data Pipelines and ETL Processes

2 weeks ago


Dublin, Dublin City, Ireland Realtime Recruitment Full time

We are looking for an experienced Quantitative Data Specialist to join our team. The ideal candidate will have a strong background in data engineering, with expertise in designing, developing, and maintaining scalable data pipelines for high-frequency and large-scale data processing.

The successful candidate will work closely with our cross-functional teams to optimize data access, storage, and processing, and will be responsible for implementing robust ETL processes and developing real-time and historical data retrieval systems.

Responsibilities:
  • Design and implement scalable data architectures to handle high-volume and high-velocity data.
  • Collaborate with cross-functional teams to optimize data access, storage, and processing.
  • Implement data governance, security, and best practices in data management.
Requirements:
  • Bachelor's, Master's, or PhD in Computer Science, Data Engineering, Mathematics, or a related field.
  • 5+ years of experience in data engineering, preferably in trading and capital markets.
  • Extensive experience in Python and its suite of data processing libraries, big data technologies like Spark, Hadoop, and Kafka, and data modeling, ETL workflows, and pipeline orchestration tools.