Senior Big Data Systems Engineer

21 hours ago

Dublin, Dublin City, Ireland beBee Careers Full time
About the Role
Are you a highly skilled and experienced software development engineer looking to take your career to the next level? We are seeking a talented individual to join our team as a Senior Software Development Engineer In Test.

We are looking for someone who is passionate about ensuring the reliability, performance, and testability of systems. As a key member of our engineering team, you will be responsible for maintaining large-scale big data infrastructures, optimizing system performance, and ensuring high availability while constantly seeking improved ways to improve stability and reliability.

In this role, you will have the opportunity to work with cross-functional teams to design, build, and maintain robust big data solutions using Hadoop ecosystem, Apache suite of tools (Spark), and related technologies. You will also collaborate with data engineers and developers to understand data requirements to ensure data quality and create automated tests to continuously monitor system health, performance, and functionality.

If you have experience in implementing and managing automation tools and infrastructure as code (IaC) for deployment, monitoring, and scaling of big data clusters, we want to hear from you. Your strong knowledge of cloud platforms (AWS, Azure, GCP), continuous delivery, and/or continuous integration, along with your excellent technical acumen and problem-solving skills, make you an ideal candidate for this position.

Key Responsibilities:
• Maintain large-scale big data infrastructures
• Optimize system performance and ensure high availability
• Collaborate with cross-functional teams to design, build, and maintain robust big data solutions
• Implement security best practices to safeguard sensitive data within the big data ecosystem
• Create automated tests to continuously monitor system health, performance, and functionality

Requirements:
• Bachelor/Master Degree in Computer Science or equivalent work experience
• Experience in Performance Testing
• Excellent technical acumen, strong organizational and problem-solving skills
• Strong experience in Automated testing/software development
• Experience working with other developers to ensure that systems are designed for reliability, performance, and testability

About You
We are looking for someone who is passionate about technology and has a strong desire to learn and grow. If you have a keen eye for detail and are able to think critically, we would love to hear from you. In return, we offer a competitive salary and benefits package, including a modern and hybrid working environment, world-class technical ecosystem, and opportunities for professional growth and development.

  • Big Data Engineer

    4 hours ago

    Dublin, Dublin City, Ireland beBeeDataEngineer Full time

    About the RoleThis opportunity presents a chance to collaborate with an esteemed engineering team working on designing and developing innovative features for a leading product range. As part of this exciting project, you will be responsible for creating applications that provide valuable insights for trading data.Responsibilities:You will work alongside...

  • Big Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland beatmysalary Full time

    Roles and Responsibilties :- Build, optimize and maintain ETL pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark).- Collaborate with teams to ensure efficient and reliable data processing.- Perform data modeling, quality checks, and system performance tuning.- Contribute to modernization efforts, including potential cloud or Databricks...

  • Big Data Systems Developer

    2 weeks ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    Big Data Engineer Job DescriptionAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team. The successful candidate will be responsible for building, optimizing and maintaining ETL pipelines using Hadoop ecosystem tools (HDFS, Hive, Spark).This is a fantastic opportunity for experienced professionals looking to take their career to...

  • Senior Big Data Architect

    1 week ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    Big Data Systems EngineerReperio have partnered with a leading FinTech company renowned for innovation within the technology space, providing top solutions to financial clients. They are looking for a Big Data Systems Engineer to join their team after announcing plans for an upcoming project.

  • Senior Engineering Professional

    2 weeks ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    Key Responsibilities:The Role involves working alongside talented engineers in the Big Data team, designing, developing and integrating new capabilities into the Pico Big Data platform. This includes developing applications to provide insights for trading data such as order entry and market data.You will use best practice CI/CD methodologies to produce a...

  • Big Data Expert

    4 days ago

    Dublin, Dublin City, Ireland beBeeEngineer Full time

    Job Title: Big Data Engineer">This role is crucial in eBay's data infrastructure, ensuring robust and scalable solutions for data processing and storage.">Oversee and enhance Hadoop-related projects to meet eBay's extensive data scale requirements.Create customer-facing tools and ensure smooth integration with other systems.

  • Highly Skilled Java and Big Data Engineer Wanted

    2 weeks ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    Are you a seasoned software engineer looking for a challenging role that combines your passion for Java and Big Data Technologies?Job DescriptionThis Senior Software Engineer position offers the opportunity to build a brand-new Greenfield platform from scratch, utilizing cutting-edge technologies like Apache Kafka and Azure. As part of a highly skilled team,...

  • Senior Data Architect

    2 weeks ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team. In this position, you will be responsible for designing, building, and optimizing robust, scalable data pipelines and infrastructure to support advanced analytics, reporting, and decision-making across the organization.You will take ownership of complex data projects, contribute to...

  • Big Data Engineer

    4 hours ago

    Dublin, Dublin City, Ireland beBeeData Full time

    Big Data Engineer - Kafka and SparkThe data platform team is responsible for automating the operations of our big data platforms at scale. This includes ensuring fault-tolerant replication, installation, backups, and more. Engineers in this role will create and automate infrastructure features of data platforms using Python.Job Description:This role involves...

  • Big Data Engineer

    1 week ago

    Dublin, Dublin City, Ireland beBee Careers Full time

    Big Data Engineer RoleWe are seeking an experienced Big Data Engineer to join our team. In this role, you will be responsible for designing, building, and implementing automation processes for production release of data engineering, machine learning, and business intelligence processes.This is a fantastic opportunity to work on cutting-edge technologies and...