AWS Data Engineer

5 days ago

Dublin, Dublin City, Ireland Spark Digital & Analytics Remote Work Freelance Full time

Spark is a powerhouse of innovation, a champion among firms, blazing a trail for SMEs and enterprise businesses. Our secret weapon? Data. With our unmatched expertise, we bring unparalleled value to our customers, propelling them to new heights of success.

At Spark, we don't settle for the ordinary. We're on a mission to revolutionise the business landscape, one data-driven solution at a time. From inception to execution, we provide comprehensive end-to-end services encompassing strategy, design, development, and implementation, relentlessly pursuing excellence, constantly optimising operations, boosting revenue, and reducing costs.

This unwavering dedication ensures our customers stay ahead of the competition, achieving extraordinary results that redefine what's possible.

But here's the thing—we can't do it alone. We need a team of brilliant minds, trailblazers, and visionaries to join our ranks, eager to make a difference and deliver on our promises to our customers. So, if you're ready to embark on an exciting journey where every day is an opportunity to create something remarkable, look no further.

Spark is calling.

We are looking for a highly skilled and motivated AWS Data Engineer to join our dynamic team as a contractor.

The ideal candidate will have extensive experience in building and maintaining data pipelines, data warehouses, and data lakes using AWS services. You will work closely with our data science and analytics teams to ensure data is readily available, secure, and efficiently processed.

Specifically, we see your time is spent:
  1. Design, develop, and maintain scalable data pipelines and ETL processes using AWS Glue, Glue Crawlers, and Glue Data Catalog.
  2. Manage and optimise Redshift clusters, ensuring high availability and performance of data warehousing solutions.
  3. Implement serverless data processing workflows using AWS Lambda.
  4. Utilise Apache Airflow for orchestrating complex data workflows and ensure smooth and timely execution of data pipelines.
  5. Implement and manage data versioning and schema evolution using Apache Hudi.
  6. Ensure data security and compliance through robust IAM policies and AWS Lake Formation.
  7. Collaborate with data scientists, analysts, and stakeholders to understand data needs and deliver high-quality data solutions.
  8. Monitor and troubleshoot data pipelines and workflows to ensure data quality and system reliability.
  9. Document data workflows, architectures, and best practices to ensure knowledge sharing and continuous improvement.
What will pique our interest is someone that might have:
  1. Bachelor's degree in Computer Science, Information Technology, or a related field.
  2. Minimum of 1 year experience using DBT.
  3. 3+ years of experience as a Data Engineer with a focus on AWS technologies.
  4. Strong expertise in AWS Glue, Glue Crawlers, and Glue Data Catalog.
  5. Proficiency in Amazon Redshift including performance tuning, cluster management, and data warehousing best practices.
  6. Experience with AWS Lambda for building serverless data processing applications.
  7. Hands-on experience with Apache Airflow for orchestrating ETL workflows.
  8. Familiarity with Apache Hudi for managing large-scale data lakes.
  9. In-depth knowledge of IAM for managing access and permissions in AWS.
  10. Experience with AWS Lake Formation for managing secure data lakes.
  11. Strong programming skills in Python, SQL, and other relevant languages.
  12. Excellent problem-solving skills and the ability to troubleshoot complex data issues.
  13. Strong communication and collaboration skills to work effectively with cross-functional teams.
How we can support you:
  • We embrace a hybrid approach that lets you work where you're most productive while staying connected with a collaborative and innovative team. With a strong remote-friendly culture, we ensure you have the support, tools, and flexibility to thrive. Whether you're collaborating virtually or joining team meetups, you'll experience the networking, camaraderie, and dynamic environment that make our company an exciting place to grow—all while maintaining a healthy work-life balance.
#J-18808-Ljbffr

  • Data Engineering Manager AWS

    2 days ago

    Dublin, Dublin City, Ireland Fenergo Full time

    Are you passionate about data engineering and looking for a challenging role where you can make a meaningful impact? We're seeking an experienced Cloud Data Platform Architect to lead the design, implementation, and operation of a data lake using AWS data lake technologies.In this role, you will be responsible for developing and managing scalable data lake...

  • Software Engineering Manager, Aws Security

    6 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Join us in leading a team that builds innovative services protecting AWS from security threatsAs a Software Engineering Manager in AWS Security, you'll lead a team in building and managing innovative services that detect and automate the mitigation of cyber threats across all of Amazon's infrastructure.You'll manage software development engineers, data...

  • Regional Environmental Engineer, Aws Environmental, Aws Environmental

    3 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    For over 15 years, Amazon Web Services (AWS) has been the world's most comprehensive and broadly adopted cloud computing platform.What is cloud computing?Cloud computing is the on-demand delivery of IT resources over the Internet.In 2019, Amazon announced The Climate Pledge, which includes our commitment to power our operations with 100% renewable energy by...

  • AWS Systems Security Engineer

    3 weeks ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    AWS Trust and Safety (T&S) Risk & Response (R&R) is seeking a motivated Security Engineer with a strong background in incident response, threat investigation, and developing solutions to security issues. As a Security Engineer in R&R, you will employ your technical skills to develop solutions to complex and ambiguous security-related events originating from...

  • Sr Data Engineer, AWS Data Platform

    4 weeks ago

    Dublin, Dublin City, Ireland Amazon Full time

    AWS Utility Computing (UC) provides product innovations — from foundational services such as Amazon's Simple Storage Service (S3) and Amazon Elastic Compute Cloud (EC2), to consistently released new product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development...

  • Security Engineer, Aws Security

    5 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Come and build innovative services that protect our cloud from advanced security threatsAs a Security Engineer on our team, you'll help build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure, including advanced persistent threats.You'll work with data scientists, software development...

  • AWS Security Solutions Architect

    4 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    We're seeking a highly skilled AWS Security Solutions Architect to join our team at Amazon Data Services Ireland Limited. As an AWS Security Solutions Architect, you'll help us design and implement secure solutions that meet the needs of our customers.You'll work closely with data scientists, software development engineers, and other security engineers...

  • Regional Environmental Engineer, AWS Environmental

    3 weeks ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    For over 15 years, Amazon Web Services (AWS) has been the world's most comprehensive and broadly adopted cloud computing platform. What is cloud computing? Cloud computing is the on-demand delivery of IT resources over the Internet.In 2019, Amazon announced The Climate Pledge, which includes our commitment to power our operations with 100% renewable energy...

  • Security Engineer, AWS Security

    2 weeks ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Come and build innovative services that protect our cloud from advanced security threatsAs a Security Engineer on our team, you'll help build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure, including advanced persistent threats. You'll work with data scientists, software development...

  • AWS Cloud Engineer – Data Lake Specialist

    3 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Job DescriptionA new opportunity has opened for a Senior Data Engineer to join a company driving innovation in a cloud-first environment. Be part of a team of experts, the first in Ireland to implement Dremio for advanced data lake solutions.In this role, you'll not only be hands-on with the latest AWS tech like Athena, Lambdas, Glue, S3, but also enjoy...

  • AWS Threat Intelligence Engineer

    4 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    We are seeking an experienced AWS Threat Intelligence Engineer to join our team. As a threat intelligence engineer, you will be responsible for collecting, analyzing, and documenting information to author threat reports that drive scalable mitigation and remediation actions.">Key Responsibilities:Collect and analyze threat intelligence from various sources,...

  • Senior Security Engineer, Aws Security

    5 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Come and build innovative services that protect our cloud from advanced security threatsAs a Senior Security Engineer on our team, you'll help build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure, including advanced persistent threats.You'll work with data scientists, software development...

  • Software Development Engineer, AWS Incident Tooling

    1 week ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Amazon Web Services is the largest consumer cloud offering in the world, powering cutting edge science, rapidly growing start-ups and industry-leading companies.The AWS Incident Response Systems team is building systems to ensure these AWS customers can rely on the highest-availability, lowest-latency cloud platform on the planet. We work closely with the...

  • Senior AWS Data Engineer – 6 Month Contract

    2 weeks ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior AWS Data Engineer – 6 Month Contract6 Month Contract – Extension highly likelyAWS Tech Stack; DREMIO, Glue, Lambdas100% Greenfield Data-Driven ProjectsA new opportunity has opened for a Senior Data Engineer to join a cutting-edge company driving innovation in a cloud-first environment. Be part of a team of experts, the first in Ireland to...

  • Senior AWS Data Engineer – 6 Month Contract

    3 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior AWS Data Engineer – 6 Month Contract6 Month Contract – Extension highly likelyAWS Tech Stack; DREMIO, Glue, Lambdas100% Greenfield Data-Driven ProjectsA new opportunity has opened for a Senior Data Engineer to join a cutting-edge company driving innovation in a cloud-first environment. Be part of a team of experts, the first in Ireland to...

  • Senior AWS Data Engineer – 6 Month Contract

    7 days ago

    Dublin, Dublin City, Ireland Archer Recruitment Full time

    Senior AWS Data Engineer – 6 Month Contract6 Month Contract – Extension highly likelyAWS Tech Stack: DREMIO, Glue, Lambdas100% Greenfield Data-Driven ProjectsA new opportunity has opened for a Senior Data Engineer to join a cutting-edge company driving innovation in a cloud-first environment. Be part of a team of experts, the first in Ireland to...

  • Senior Software Development Engineer, Aws Security

    5 days ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Come and build innovative services that protect our cloud from advanced security threatsAs a Senior Software Development Engineer on our team, you'll help build and manage services that detect and automate the mitigation of cybersecurity threats across Amazon's infrastructure, including advanced persistent threats.You'll work with security engineers and data...

  • AWS System Engineer

    5 days ago

    Dublin, Dublin City, Ireland ENGINEERINGUK Full time

    About the TeamAWS Network Alerts owns the design, planning, delivery, and operation of the core monitoring and detection engines for AWS Network. We work on a set of the most challenging problems, with huge amounts of data and thousands of variables impacting the AWS network, and we're looking for talented people who want to solve these with us.You'll join a...

  • Optical Network Development Engineer, Data Center Regional Engineering Services

    3 weeks ago

    Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    Do you like to use network and Unix systems engineering to deliver simple, sustainable, and repeatable solutions? Would you like to play a key role in driving the stability and sustainability of next-generation networks?AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the...

  • AWS Data Center Operations Expert

    5 days ago

    Dublin, Dublin City, Ireland Amazon Full time

    About UsAWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. We are seeking a Critical Infrastructure Mechanical Engineer to join our team of experts who keep the cloud running. This role requires a Bachelor's Degree in Mechanical Engineering or equivalent experience and 4+ years of experience in...