Expert Data Engineer

4 days ago

Limerick, Limerick, Ireland beBeeDataEngineering Full time €35,184 - €156,528
Job Title: Data Engineering Expert

We are seeking a highly skilled Data Engineer to join our team.

About the Job:

  • This role will involve designing, developing and maintaining scalable data pipelines using Databricks and Apache Spark.
  • You will collaborate with data analysts and scientists to understand data needs and provide appropriate solutions.
  • The ideal candidate will have experience in ETL pipeline development and optimisation, as well as strong knowledge of SQL, Python and Scala programming languages.
  • Cloud experience is also essential, with Azure preferred but AWS also suitable.

Your Key Responsibilities:

  1. Data Pipeline Development: Design and develop scalable data pipelines using Databricks and Apache Spark to ensure efficient data processing and analysis.
  2. Data Quality Assurance: Ensure data quality by implementing validation and testing procedures to guarantee accuracy and reliability.
  3. ETL Optimisation: Optimize existing ETL processes for enhanced performance and efficiency to meet business requirements.
  4. Data Modelling and Design: Assist in data modelling and design of data warehouses to support business intelligence initiatives and drive strategic decision-making.
  5. Performance Monitoring and Troubleshooting: Monitor and troubleshoot data pipeline performance issues to identify areas for improvement.
  6. Code Reviews and Best Practices: Participate in code reviews and contribute to best practices and standards in data engineering to maintain high-quality code and ensure consistency.
  7. Documentation and Knowledge Sharing: Document data processes, architecture, and workflows for knowledge sharing across the team to facilitate collaboration and innovation.

Your Requirements:

  • Databricks & Apache Spark
  • ETL pipeline development and optimisation
  • SQL, Python/Scala
  • Cloud experience (Azure preferred, AWS also suitable)
  • Data warehousing & modelling

About Our Organisation:

We are a forward-thinking organisation with a passion for harnessing the power of data to drive business growth and success. We offer a dynamic work environment that fosters collaboration, innovation, and continuous learning.

  • Data Engineer

    4 weeks ago

    Limerick, Limerick, Ireland Nab-Ire Ventures Limited Full time

    North is a dynamic and innovative technology company dedicated to reshaping the landscape of financial risk and compliance management.We seek a Data Engineer with focus on building scalable data solutions to join our talented team at the Fraud & Risk Management Research & Development Centre of Excellence in Limerick City Centre.At North, we are committed to...

  • Data Engineer

    7 days ago

    Limerick, Limerick, Ireland hays-gcj-v4-pd-online Full time

    Data Engineer - Contract (Stamp 4, Stamp 1G, and EU citizens)Your new company My client is a Pharma company with a large base in Ireland with offices spread across Limerick and Cork.Your new role Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark. Collaborate with data analysts and data scientists to understand data needs...

  • Expert Data Engineer Opportunity

    2 weeks ago

    Limerick, Limerick, Ireland beBeeDatabaseDeveloper Full time €98,765 - €123,456

    At Kneat, we're looking for a skilled and proactive Data Professional to join our growing team. As a Database Developer, you will play a key role in designing and maintaining scalable and efficient database schemas."],

  • Data Conversion Expert

    1 week ago

    Limerick, Limerick, Ireland beBeeDataConversion Full time €90,000 - €120,000

    Product Applications EngineerWe are seeking a Product Applications Engineer to join our team. In this role, you will be responsible for promoting and taking a leading role in supporting the DSP/algorithm of both released transceiver products and new products under development at lead customers.">Promote and take a leading role in supporting the DSP/algorithm...

  • Data Integrity and Quality Governance Expert

    1 hour ago

    Limerick, Limerick, Ireland beBeeQuality Full time €100,000 - €120,000

    Job TitleAs a Data Integrity and Quality Governance Expert, you will be responsible for overseeing the site's data integrity initiatives. This role involves driving continuous improvement, collaborating with cross-functional teams, and ensuring compliance with regulatory requirements.Key Responsibilities:Qualifications:Skills and Qualifications:

  • Electrical Engineering Expert

    2 days ago

    Limerick, Limerick, Ireland beBeeElectricalEngineer Full time €60,000 - €85,000

    Are you an electrical engineering expert looking to take on a challenging role? We are seeking a Senior Electrical Project Engineer to join our team. This is a fantastic opportunity for someone who wants to leverage their skills and experience in electrical engineering to drive projects forward.This role will involve overseeing the electrical aspects of...

  • Data Technician Or Trainee Data Technician

    2 weeks ago

    Limerick, Limerick, Ireland Onnec Full time

    Data Technician or Trainee Data TechnicianEarnings:Competitive - dependent on experienceONNEC Group is a leading independent technology partner and global integrator with over 30 years of experience and a team of 800+ global experts.We specialize in providing end-to-end connectivity solutions that propel organizations worldwide.Our services range from...

  • Senior Data Engineering Specialist

    2 weeks ago

    Limerick, Limerick, Ireland beBeeData Full time €73,104 - €154,912

    Job DescriptionWe are seeking a highly skilled and experienced Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining scalable data pipelines using Databricks and Apache Spark.You will collaborate with data analysts and data scientists to understand data needs and...

  • Data Technician or Trainee Data Technician

    2 weeks ago

    Limerick, Limerick, Ireland Onnec Full time

    Data Technician or Trainee Data TechnicianEarnings: Competitive - dependent on experienceONNEC Group is a leading independent technology partner and global integrator with over 30 years of experience and a team of 800+ global experts. We specialize in providing end-to-end connectivity solutions that propel organizations worldwide.Our services range from...

  • Senior Data Engineer

    6 days ago

    Limerick, Limerick, Ireland beBeeData Full time €74,912 - €149,424

    Big Data SpecialistOur ideal candidate is a skilled data pipeline developer with experience in designing, building and maintaining large-scale data systems. They will work closely with cross-functional teams to understand business needs and develop tailored solutions.Collaborate with data analysts and scientists to provide appropriate data solutions.Optimise...