Lead Data Engineer

3 weeks ago


Dublin, Dublin City, Ireland Coca Cola Full time

Description

Summary:

Position Overview:

The Data Engineer role is to design and build BI solutions that deepen analytical capability and quality of insights in the Coca-Cola System. The Data Engineer will be responsible for processing user requirements coming from Product Owners into new modules for existing applications or developing new applications himself/herself or jointly with other members of the regional and Global Development Centers. The development required will include data ingestion and transformation using a combination of Azure Data Factory, Python/PySpark/Spark/Synapse Spark for ETL/ELT in DataBricks or Azure Synapse, Azure Logic Apps, Azure SQL. All the assigned tasks will be scoped appropriately to the knowledge level of the Developer, with support from senior team members and time allocated for further professional training. The Data Engineer will be expected to follow Agile practices while developing solutions.

Work Focus

In this senior role, you will lead and be accountable for the end-end data architecture solutions under the data development teams' scope. Partnering closely with other developers and stakeholders worldwide, you will be responsible for transforming business opportunities into comprehensive, integrated solutions that would deliver differentiating capabilities.

What You'll Do for Us:

Architectural accountability for all critical data solutions within the scope of the development organization. Partner strategically with Data, Technology, and Business Services Leads across TCCC to guide technology direction, short/long term roadmaps, and holistic value over the portfolio. Technical recommendations for clients based on our global platforms and best data architecture practices, including performance, security advice, and costs. Ensure that the architectural design is in the implementation of the solutions, including high-level code review and data quality. Guiding migration and upgrades in data products by collaborating with Platform Architects. Mentoring candidates for data architecture roles.

Qualifications and Requirements:

BA/BS required. BA/BS in Information Technology, computer science, mathematics, statistics, or related field 3+ years of experience in Data Lake platform implementation, including hands-on implementation and performance tuning. Experience ingesting data from different sources and/or ETL development experience. Hands-on experience with Big Data tools such as Apache Spark, and Azure Synapse Analytics. Experience in implementing data solutions over clouds. (Preferred Azure) SQL/NoSQL databases and Data Warehousing solutions. Competence in at least two programming languages of these: Python, Java, Scala, R. Understanding and building data pipelines and being aware of the different technologies for designing, constructing, integrating, and monitoring (DataOps). Understands logical and physical data models, big data storage architecture, data modeling methodologies, metadata management, master data management, data lineage & data profiling Experience leading and working with external resources (onshore and offshore). Expertise in communicating an architectural vision, conceptual, logical, and physical architectures to different stakeholders, including business, data analysts, advanced analytics people, and technical people such as data engineers. Team player with high emotional intelligence able to multi-task in a dynamic franchise model. Self-starter, self-confident, and assured in personal abilities

Additional Skills (Preferred):

Any Master's related to Science, Technology, and Data. Consulting experience Experience in implementing real-time streaming data architectures. Understanding basic Data Science and Machine Learning concepts and integrating ML model output into the data pipeline. Data engineer and Data Architect certifications (from DASCA or any similar). Cloud certifications (preferred Azure) Agile certifications

What We Can Do for You:  

Innovation & Technology: The ability to work with an award-winning team that is on the cutting edge of innovation. Exposure to World Class Leaders: Availability to global technology leaders that will expand your network and exposure you to emerging technologies and techniques. Agile Work Environment: We embrace agile with management that believes in removing barriers, so you are empowered to experiment, iterate and innovate.

Skills:

Apache Synapse, Big Data, Communication, Data Analytics, Data Integration, Influencing, Microsoft Azure, Microsoft Power BI, Problem Solving, Python (Programming Language), Tableau
  • Lead Data Engineer

    2 weeks ago


    Dublin, Dublin City, Ireland Oliver James Associates Ltd. Full time

    Lead Data EngineerDublinAbout the Company:This is a dynamic and rapidly growing technology company focused on providing innovative solutions to its global customer base. Leveraging vast amounts of data, the company strives to build and maintain a world-class data infrastructure to support its analytical and operational needs. It fosters a collaborative and...

  • Lead Data Engineer

    1 week ago


    Dublin, Dublin City, Ireland beBee Careers Full time

    Data Engineering ExcellenceWe're seeking a skilled Data Engineer to lead our data engineering efforts. As a technical expert, you will drive the technical direction of our data platform, leading a small team of engineers while also being hands-on in developing data pipelines and infrastructure.You'll ensure the integrity, scalability, quality, and...


  • Dublin, Dublin City, Ireland beBee Careers Full time

    About the Role:">We are seeking a highly skilled and experienced data engineer to lead our team in designing, building, and optimizing scalable data pipelines and infrastructure. As a Data Engineering Lead, you will be responsible for driving the technical direction of our data platform, leading a small team of engineers, and ensuring the integrity,...


  • Dublin, Dublin City, Ireland beBee Careers Full time

    Job DescriptionWe are seeking a highly experienced Data Engineering Manager to lead our technical data platform. The ideal candidate will have extensive experience in designing, building, and optimising data pipelines and infrastructure using Snowflake, Hadoop, Apache NiFi, Spark, Python, and other technologies.Key ResponsibilitiesDesign and build scalable...


  • Dublin, Dublin City, Ireland beBee Careers Full time

    Job Description">Synopsis:This role involves leading the technical direction of a critical data platform. You will be responsible for driving the development of scalable data pipelines and infrastructure, ensuring the integrity, quality, and performance of our data systems.The ideal candidate will have extensive experience in data engineering, with expertise...

  • Lead Data Engineer

    4 weeks ago


    Dublin, Dublin City, Ireland Reperio Human Capital Full time

    Lead Data Engineer 101249 Desired skills: Lead Data Engineer, Azure, Databricks, Synapse, Dublin, Hybrid Hybrid Reperio has partnered with a financial services company looking for a Data Engineer who specialises in the Azure environment to lead their small team. They have recently adopted the Microsoft Fabric application. As the lead engineer,...

  • Data Engineer Lead

    5 days ago


    Dublin, Dublin City, Ireland beBee Careers Full time

    Job Description:We are seeking a skilled Data Engineer to lead the development of our machine learning data infrastructure. This role involves driving innovation, enhancing capabilities in managing and utilizing data effectively, and ensuring efficient, scalable solutions for AI product offerings.About the Role:Lead projects to improve our current platform...

  • Data Engineering Lead

    2 weeks ago


    Dublin, Dublin City, Ireland Focus Cloud Group Full time

    About Us:Focus Cloud Group is a dynamic IT services and consulting company dedicated to delivering exceptional cloud solutions. Our mission is to help businesses unlock their full potential by leveraging the power of cloud technology.We are committed to fostering a culture of innovation, collaboration, and excellence. Our team of experts is passionate about...

  • Lead Data Engineer

    22 hours ago


    Dublin, Dublin City, Ireland TN Ireland Full time

    Cpl are working with a data driven organization in their search for a Lead Data Engineer on a permanent basis. The perfect candidate will have proven experience delivering data initiatives and have technical expertise across Data Engineering, Data Architecture, Governance, Modeling and ETL.Role:Responsible for managing company and client dataDevelop and...


  • Dublin, Dublin City, Ireland beBee Careers Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in developing and scaling our strategic data platform on Azure Cloud.Key Responsibilities:Collaborate with cross-functional teams to enhance our Azure-based data platform.Lead the creation of a...