Databricks Senior Data Engineer

3 weeks ago

Dublin, Dublin City, Ireland Amach Full time
Senior Data Engineer Opportunity

Join our Dublin-based team as a Senior Data Engineer and play a pivotal role in shaping our data architecture. You will work with innovative cloud technologies to drive impactful, data-centric projects.

We are seeking an accomplished Senior Data Engineer with in-depth experience in Databricks, Snowflake, AWS, and MLOps. The ideal candidate will have expertise in designing and implementing cloud-native data solutions, building and maintaining MLOps pipelines, and establishing data governance and quality standards.

  • Design Cloud-Native Data Solutions: Develop scalable, resilient data platforms using cloud-native technologies, data mesh frameworks, and integration across diverse data sources
  • Build and Maintain MLOps Pipelines: Use tools like MLflow to create reliable, efficient pipelines for deploying machine learning models in production environments
  • Establish Data Governance and Quality Standards: Develop and uphold data governance practices, ensuring robust data quality and compliance using tools like Databricks Unity Catalog
  • Oversee Data Integration and Migration: Lead migration projects from legacy data systems to modern cloud platforms, focusing on optimising operational costs and efficiencies
  • Performance Optimisation and Tuning: Use tools such as Snowflake and Delta Lake to enhance data accessibility, reliability, and performance, delivering robust, high-quality data products
  • Data Mesh Architecture: Design and deploy data mesh frameworks to support seamless data integration and scalability across business functions
  • Operationalise MLOps Pipelines: Develop and manage MLOps pipelines to streamline machine learning model deployment and operational efficiency
  • Data Migration and Cost Optimisation: Lead large-scale data migrations to Azure and AWS, focusing on business-critical data sources and substantial cost reductions
  • Data Governance Applications: Create applications to reinforce data governance, quality, and enterprise standards, ensuring a secure and compliant production environment

Required Experience:

  • Proven experience in architecting and delivering large-scale, cloud-native data solutions
  • Hands-on experience in Databricks, Spark, Pyspark, and Delta Lake, with strong skills in data warehousing and lakehouse solutions
  • Practical experience in MLOps, ideally with MLflow for model management and deployment
  • Strong knowledge of AWS, with additional experience in Azure advantageous for multi-cloud setups
  • Advanced coding abilities in Python, SQL, and Scala
  • Familiarity with version control (GitHub), CI/CD tools (Azure DevOps, GitHub Actions), orchestration tools (Airflow, Jenkins), and dashboarding tools (Tableau, Alteryx)
  • Experience with Synapse Analytics, Netezza, and legacy data systems
  • Knowledge of data governance best practices and tools
  • Excellent problem-solving skills, with the ability to work both autonomously and collaboratively in cross-functional teams

This is an excellent opportunity to join a fast-growing company and contribute to driving digital innovation. As a Senior Data Engineer, you will be responsible for designing and implementing cloud-native data solutions, building and maintaining MLOps pipelines, and establishing data governance and quality standards.

The ideal candidate will have a strong background in data engineering, experience with cloud-native technologies, and a passion for delivering high-quality data products. We offer a competitive salary, ongoing learning and development opportunities, support for career advancement, and a collaborative working environment.

Our company values empowerment, quality, integrity, and success. We strive to foster a culture of diversity, equity, and inclusion and believe that a diverse team is essential for creating fulfilling environments and better solutions for our people and customers.

As a Senior Data Engineer at Amach, you will be part of a talented team of technology specialists who deliver sustainable digital innovation across systems, processes, and people. If you are passionate about data engineering and want to contribute to driving digital innovation, we encourage you to apply for this exciting opportunity.

Competitive salary and rates

Ongoing learning and development

Support for career advancement

Pension

Health Insurance

  • Azure Databricks and Data Engineering Expert

    2 days ago

    Dublin, Dublin City, Ireland Brightwater Capital, LLC Full time

    Azure Data Engineering Expert WantedWe are looking for a highly skilled Azure Data Engineering expert to join our team. As a Senior Data Engineer, you will design and implement scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.ResponsibilitiesDevelop and deploy data pipelines using Azure Databricks and Azure Data...

  • Principal Data Engineer – Azure Databricks

    2 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Principal Data Engineer – Azure Databricks Join a fast-scaling FinTech Cutting-edge technologies: Databricks, PySpark, Azure Build data lakes and pipelines Join a rapidly expanding FinTech redefining the industry with its cloud-native approachAs an Azure Senior Data Engineer , you'll be a key player in a newly established Data team, working on complex,...

  • Databricks Senior Data Engineer

    7 days ago

    Dublin, Dublin City, Ireland Amach Full time

    Join one of the world's fastest growing technical teamsWe understand that looking for a new role can be a bit of a roller coaster, and at Amach we pride ourselves on providing a personal feel to the process, really getting to know our candidates.Amach is an industry-leading technology driven company with headquarters located in Dublin and remote teams in UK...

  • 15h Left) Principal Data Engineer Azure Databricks

    2 weeks ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Principal Data Engineer Azure Databricks Join a fast-scaling FinTech Cutting-edge technologies: Databricks, PySpark, Azure Build data lakes and pipelines Join a rapidly expanding FinTech redefining the industry with its cloud-native approach As an Azure Senior Data Engineer, youll be a key player in a newly established Data team, working on complex,...

  • Senior Cloud Data Engineer

    2 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    At Archer Recruitment, we are seeking a seasoned Senior Cloud Data Engineer to join our team as an Azure Databricks Specialist. This is a rare opportunity to be part of a high-performing, global team that thrives on innovation.You'll design, build, and optimize large-scale data solutions using the latest technologies, including Databricks, PySpark, and...

  • Senior Data Engineer

    2 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Archer Recruitment is seeking a highly skilled Senior Data Engineer to lead the development of scalable data pipelines using Databricks and PySpark.Job Description:Leverage expertise in Azure, Databricks, and PySpark to design and optimize data lakes for large-scale analyticsCollaborate with international teams to ensure seamless data integration and drive...

  • Azure Databricks Engineer

    2 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    As a Senior Data Engineer at Archer Recruitment, you will play a pivotal role in shaping the company's data infrastructure and driving business-critical decisions.About the Team:You will be part of a fast-growing FinTech that is redefining the industry with a fully cloud-native approach.Your Key Responsibilities:Design and optimize data lakes for large-scale...

  • Principal Data Scientist

    2 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Archer Recruitment is seeking a highly skilled Principal Data Scientist to lead our team in developing new data lakes and pipelines using the latest technologies, including Databricks, PySpark, and Azure.The ideal candidate will have 15+ years of experience as a Senior Data Engineer, deep expertise in designing and building data lakes, strong communication...

  • Senior Data Engineer – Remote First

    7 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior Data Engineer – Remote FirstWork on impactful, global projectsLead innovation in a cutting-edge FinTechModern tech stack: Databricks, PySpark, AzureJoin a fast-growing FinTech that is revolutionizing the industry with a fully cloud-native approachAs a Senior Data Engineer, you'll be a key player in a newly established Data team, working on...

  • Azure Senior Data Engineer – Amazing Benefits

    6 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Azure Senior Data Engineer – Amazing Benefits Lead innovation in a cutting-edge FinTechShape the future of a rapidly expanding companyModern tech stack: Azure, Databricks, PySparkJoin a fast-growing FinTech that is redefining the industry with a fully cloud-native approachAs a Senior Data Engineer, you will play a pivotal role in shaping the company's data...

  • Azure Senior Data Engineer – Amazing Benefits

    1 week ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Azure Senior Data Engineer – Amazing Benefits Lead innovation in a cutting-edge FinTechShape the future of a rapidly expanding companyModern tech stack: Azure, Databricks, PySparkJoin a fast-growing FinTech that is redefining the industry with a fully cloud-native approachAs a Senior Data Engineer, you will play a pivotal role in shaping the company's data...

  • Azure Senior Data Engineer

    7 days ago

    Dublin, Dublin City, Ireland Archer - The It Recruitment Consultancy Full time

    Join a rapidly expanding FinTech redefining the industry with its cloud-native approachAs an Azure Senior Data Engineer , you'll be a key player in a newly established Data team, working on complex, high-impact projects that drive the company's data strategy.This is a rare opportunity to be part of a high-performing, global team that thrives on...

  • Azure Senior Data Engineer – Amazing Benefits

    3 weeks ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Azure Senior Data Engineer – Amazing Benefits- Lead innovation in a cutting-edge FinTech- Shape the future of a rapidly expanding company- Modern tech stack: Azure, Databricks, PySparkJoin a fast-growing FinTech that is redefining the industry with a fully cloud-native approach As a Senior Data Engineer, you will play a pivotal role in shaping the...

  • Senior Data Engineer Lead

    8 hours ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Archer Recruitment is seeking a seasoned Senior Data Engineer to spearhead the development of cutting-edge data infrastructure. As a key player in this rapidly expanding FinTech, you will drive business-critical decisions and enable scalable solutions across the organization.This role offers a unique opportunity to be at the forefront of innovation, ensuring...

  • Azure Senior Data Engineer – Remote First

    3 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Azure Senior Data Engineer – Remote First Drive innovation in FinTechWork on impactful, global-scale projectsModern tech stack: Databricks, PySpark, AzureJoin a fast-growing FinTech that is revolutionizing the industry with a fully cloud-native approachAs a Senior Data Engineer, you'll be a key player in a newly established Data team, working on...

  • Senior Data Engineer – Modern Tech Stack

    10 hours ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior Data Engineer – Modern Tech StackExciting opportunity to work on high-impact, global projectsAdvance your career in a cutting-edge FinTechModern tech stack: Databricks, PySpark, AzureJoin a rapidly growing FinTech that is revolutionizing the industry with a fully cloud-native approach.As a Senior Data Engineer, you'll be a key player in a newly...

  • 15h Left: Senior Data Engineer Amazing Benefits

    2 weeks ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior Data Engineer Amazing Benefits High-impact projects in a global FinTech Shape the future of data innovation Cutting-edge tech stack: Databricks, PySpark, Azure Take your career to the next level with a leading global FinTech that operates in a fully cloud-native environment As a Senior Data Engineer, youll play a pivotal role in building and scaling...

  • Senior Data Engineer – Modern Tech Stack

    3 weeks ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior Data Engineer – Modern Tech Stack- Exciting opportunity to work on high-impact, global projects- Advance your career in a cutting-edge FinTech- Modern tech stack: Databricks, PySpark, AzureJoin a rapidly growing FinTech that is revolutionizing the industry with a fully cloud-native approach. As a Senior Data Engineer, you'll be a key player in a...

  • Data Engineer for Scalable Solutions

    2 days ago

    Dublin, Dublin City, Ireland Brightwater Capital, LLC Full time

    About Brightwater Capital, LLCWe are a leading information and technology-enabled health services business. Our mission is to modernize the healthcare system and improve lives by serving virtually every dimension of the health system.Position OverviewWe are seeking an experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you...

  • Cloud Data Engineer with Azure Experience

    2 days ago

    Dublin, Dublin City, Ireland Brightwater Capital, LLC Full time

    Cloud Data Engineer with Azure ExperienceWe are seeking an experienced Cloud Data Engineer with expertise in Azure to join our team. As a Senior Data Engineer, you will design and implement scalable data solutions using Azure Databricks, Azure Data Lake, and Azure Cosmos DB.ResponsibilitiesDevelop and deploy data pipelines using Azure Databricks and Azure...