Senior Data Engineer

3 months ago


Dublin, Ireland Bank of Ireland Full time

What is the opportunity?

Join our Data Engineering team in this exciting time as we implement Bank of Ireland's new cloud based data lake, take advantage of AI opportunities and transition workloads to that new Enterprise Data Lake platform.

As Senior Data Engineer, you will be responsible for the technical leadership, hands on engineering and mentoring of data engineers within the Data Engineering function.

We work in a very collaborative environment with a learning culture and you will use your experience to help guide future development across the team, the tools we use, help drive automation and introduce new and exciting test engineering patterns and frameworks.

In this Role, you will

  • Provide technical leadership and guidance to other data engineers
  • Take the lead in the design and build of complex data flows and process's using our Enterprise Data Lake and Cloud Data Platform
  • Make decisions on engineering frameworks, tooling and patterns
  • Advocate and drive Automation and the adoption of processes such as TDD
  • Be naturally curious and have experimented the use of AI to enhance software engineering processes
  • Solve complex technical problems and provide creative solutions from your experience or through a rational problem solving process.
  • Ensure teams are following engineering best practices, our engineering standards and process's while driving improvements in parallel
  • Ensure that technical development processes, standards, governance and tooling are appropriate and effective for the Enterprise Data Lake and Operational Data Store and meet business requirements

What Will Make You Stand Out

We are seeking a leader with enthusiasm and a growth mentality who prioritises collaboration with others. You are proactive to achieve the necessary outcome while improving processes, people and tooling along the way

You have a proven track record (7+ years) as a Senior Engineer in the Data Lake or Data Warehouse domain working in an agile team. You have deep technical knowledge of Data Lakes, Cloud Technologies and Architecture, preferably AWS.

Further technical knowledge and/or experience in the below are necessary to apply:

  • Proficiency in SQL, Python and Scala.
  • Expertise in processing large datasets, streaming data, and unstructured data using HBase, Hive, Impala, Spark.
  • Streaming Data Pipelines with tools like Kafka, NiFi, Spark Streaming.
  • Workflow orchestration skills using Oozie, Airflow, Ctrl-M.
  • Familiar with AI concepts and willingness to explore LLM's, Generative AI and Machine Learning
  • Knowledge in Metadata Management, Governance frameworks (Atlas, Collibra), and Reporting tools (Observability, Looker, Tableau, Qlikview).
  • Building data solutions on AWS
  • Strong knowledge of Cloud Data Platforms and data pipelines
  • Data Ops expertise including Bitbucket, Jenkins, Terraform.
  • Scrum/Kanban, SAFe delivery methodologies.

Experience with any of the following will help you to stand out but is not necessary in order to apply for this role;

  • REST APIs
  • Cloudera CDH/CDP platform and appropriate Cloudera certifications
  • The ability to derive and share Data-Driven insights with Business and Technical teams
  • The ability of identifying and introducing process optimizations

Essential Qualifications

There are no specific qualifications or minimum educational requirements needed for this role.

More About The team

Our growing and exciting Data Engineering team provides the engineering services for the Group's Enterprise Data Warehouse, Enterprise Data Lake and Operational Data Store. We sit within the Group Data & Analytics Office which is the core team for all things data in the bank.

We deliver the data elements to support Digital, Customer, Regulatory and other change initiatives that drive the Group's transformation agenda.

We have fully embraced agile software engineering and a DevOps mentality and operate in a highly collaborative team environment.

#li-hybrid #ij-hybrid

Why work with us?

The Bank of Ireland company culture prioritises work-life balance with an opportunity for flexible working, along with 25 days annual leave and excellent pension contributions. Family can mean different things to different people; we offer 6 months paid maternity leave, an innovative fertility and surrogacy policy and working parent supports.

Your wellbeing is important to us; we have an employee assistance program, WebDoctor and financial wellbeing coaches available. We also encourage and support staff to pursue educational and professional qualifications to grow and enhance your career

Flexible working matching promise

We know how important flexible working arrangements are to our colleagues, and we promise to try to match your current flexible working arrangement in this new role (all existing working arrangements considered)

Key Competencies

  • Customer Focused - People Manager
  • One Group, one team - People Manager
  • Champion Transformation - People Manager
  • Accountable - People Manager
  • Manage Risk - People Manager

Where Agency assistance is required Bank of Ireland Recruitment Team will engage directly with suppliers. Unsolicited CVs / profiles supplied to Bank of Ireland by Recruitment Agencies will not be accepted for this role.

We're on a continuous journey to build an inclusive and diverse workplace. We welcome applications from people of all backgrounds, lived experience, abilities and perspectives. Reasonable accommodations are offered at every stage of our recruitment process. If you require any assistance, please complete this form and one of our recruitment team members will be in touch via email. Any information provided will be treated as confidential within the recruitment team and used only for the purpose of determining and providing appropriate accommodations for the application and recruitment process.


  • Senior Data Engineer

    1 month ago


    Dublin, Dublin City, Ireland The Hertz Corporation Full time

    Job Description:The Senior Data Engineer, PySpark will be responsible for building and maintaining data pipelines and workflows that support ML, BI, analytics, and software products. This individual will work closely with data scientists, data engineers, analysts, software developers and SMEs within the business to deliver new and exciting products and...


  • Dublin, Ireland Coca Cola Full time

    Description Summary: Position Overview: The Data Engineer role is to design and build BI solutions that deepen analytical capability and quality of insights in the Coca-Cola System. The Data Engineer will be responsible for processing user requirements coming from Product Owners into new modules for existing applications or developing new...


  • Dublin, Ireland Bank of Ireland Full time

    What is the opportunity? Join our exciting data engineering team on our journey of data and digital transformation! We are a data led organisation where we play a pivotal role helping our business and customers make critical financial decisions. This is an exciting time for Data Engineering in BOI as we progress implementing our cloud strategy, pivoting from...


  • Dublin, Ireland Amazon Data Services Ireland Limited Full time

    Our Data Centers runs critical IT infrastructure, it requires a reliable supply of uninterrupted cooling and power at all times, in order to deliver continuous uptime availability for our customers. We encounter interesting, challenging & complex problems every day, being a technical manager in Amazon means that you can innovate to solve these issues and...

  • Data Engineer

    3 weeks ago


    Dublin, Ireland Bank of Ireland Full time

    What is the opportunity? Join our Data Engineering team on our journey of data and digital transformation! Help us implement our Data Strategy, pivoting from a traditional on-premise landscape to a modern cloud-based data platform, to drive and underpin Bank Digital and Customer Strategies As a Data Engineer, you will work in agile delivery teams engineering...


  • Dublin, Ireland Amazon Development Centre Ireland Limited Full time

    Central Reliability and Response Engineering (CRRE) helps Amazon service teams around the globe with the purpose of improving Amazon’s availability.Our data team build mechanisms for availability risk management, develop and operate bulk-access/API analytic interfaces and offer expertise in analytics for decision making. CRRE offers insights into Amazon's...


  • Dublin, Ireland Amazon Data Services Ireland Limited Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...


  • Dublin, Ireland Snowflake Full time

    Build the future of data. Join the Snowflake team. Snowflake Support is committed to providing high-quality resolutions to help deliver data-driven business insights and results. We are a team of subject matter experts collectively working toward our customers’ success. We form partnerships with customers by listening, learning, and building connections....

  • Senior Data Engineer

    3 weeks ago


    Dublin, Ireland UnitedHealth Group Full time

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion,...

  • Senior Data Engineer

    2 weeks ago


    Dublin, Ireland Optum Full time

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion,...


  • Dublin, Ireland Fiserv Full time

    You deserve to do what you love, and love what you do – a career that works as hard for you as you do. At Fiserv, we are more than 40,000 #FiservProud innovators delivering superior value for our clients through leading technology, targeted innovation and excellence in everything we do. You have choices – if you strive to be a part of a team driven to...


  • Dublin, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...


  • Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are currently seeking a Data Center Operations Electrical/Mechanical/Control Technician to join our Engineering Oprerations Team. The successful candidate will oversee the operation and maintenance of the electrical and mechanical infrastructure for Data Centers (DC) in Amazon Web Services (AWS) Cloud regions. Our technicians are operating and maintaining...


  • Dublin, Ireland Snowflake Full time

    Build the future of data. Join the Snowflake team.Snowflake Support is committed to providing high-quality resolutions to help deliver data-driven business insights and results. We are a team of subject matter experts collectively working toward our customers’ success. We form partnerships with customers by listening, learning, and building...


  • Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are currently seeking a Data Centre Engineering Operation Technician to serve as a technical resource within our mission critical Data Centre. The position will help ensure overall availability and reliability to meet or exceed defined service levels of Data Centre Operations. Due to the success of the Amazon’ operations and rapid expansion of Data...

  • Graph Data Engineer

    2 months ago


    Dublin, Dublin City, Ireland Client 1 Full time

    Graph Data Engineer - Dublin - HIRING ASAP Start date: ASAP Duration: 5 MonthsLocation: Hybrid Working: Dublin office Rate: FLEXIBLEResponsibilitiesOur client is looking for a Graph Database AI/ML Engineer to work on an exciting project involving Graph Database and AI Models.As a Graph Database AI/ML Engineer, you'll be at the forefront of innovative...


  • Dublin, Ireland IE018 Marsh & McLennan Innovation Centre (Ireland) Full time

    Description: Marsh McLennan Innovation Centre welcome candidates for a hands-on Principal Data Engineer to be based in our Dublin office. Be the technical expert for the global team, helpg us establish the architectural & engineering standards, best practices, and processes that will guide the scaled development of a new technology platform. ...


  • Dublin, Ireland Amazon Data Services Ireland Limited Full time

    As a Senior Project Design Electrical Engineer, you will lead design projects in operational data centers, that remediate issues, upgrade our existing infrastructure and add new services. You will be the 'go to' engineering resource for these projects and will provide lifecycle support from design through implementation. Key job responsibilitiesYou will use...


  • Dublin, Ireland Cubic Telecom Full time

    The CompanyFounded in 2009, Cubic Telecom has grown to become one of the leading providers of connectivity solutions and analytics services that help vehicle and IoT device manufacturers manage and grow revenue streams. Fast paced, smart, ambitious, and continually seeking new, ideas. That’s us, is it you? At Cubic you will find an environment filled with...

  • Data Engineer

    4 weeks ago


    Dublin, Dublin City, Ireland realtime recruitment Full time

    Experienced mature Data Engineer required with a strong background in Azure Synapse and proven experience in Power BI. The ideal candidate will have a minimum of 5 years of hands-on experience in data engineering, with exposure to Microsoft Fabric being a distinct advantage. This role requires exceptional cross-functional collaboration skills and the ability...