Senior Data Engineer New

3 weeks ago

Dublin, Dublin City, Ireland CPL Full time
Senior Data Engineer - 6 month rate contract

€500 per day - Dublin (remote)

Key Responsibilities

· Maintain/develop data pipelines required for the extraction, transformation, cleaning, pre-processing, aggregation and loading of data from a wide variety of data sources using Python, SQL, DBT, and other data technologies

· Design, implement, test and maintain data pipelines/ new features based on stakeholders' requirements

· Develop/maintain scalable, available, quality assured analytical building blocks/datasets by close coordination with data analysts

· Optimize/ maintain workflows/ scripts on present data warehouses and present ETL

· Design / develop / maintain components of data processing frameworks

· Build and maintain data quality and durability tracking mechanisms to provide visibility into and address inevitable changes in data ingestion, processing, and storage

· Collaborate with stakeholders to define data requirements and objectives.

· Translate technical designs into business appropriate representations and analyse business needs and requirements ensuring implementation of data services directly correlates to the strategy and growth of the business

· Address questions from downstream data consumers through appropriate channels

· Create data tools for analytics and BI teams that assist them in building and optimizing our product into an innovative industry leader

· Stay up to date with data engineering best practices, patterns, evaluate and analyze new technologies, capabilities, open-source software in context of our data strategy to ensure we are adapting our own core technologies to stay ahead of the industry

· Contribute to Analytics engineering process

Required Qualifications

5+ Years Relevant Work Experience

BA / BS in Data Science, Computer Science, Statistics, Mathematics, or a related field

Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workload management

Experience with Snowflake, Hands-on experience with Snowflake utilities, Snow SQL, Snow Pipe. Must have worked on Snowflake Cost optimization scenarios.

Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL

Have experience with workflow management solutions like Airflow

Have experience on Data transformations tools like DBT

Experience working with Git

Experience working with big data environment, like, Hive, Spark and Presto

Ready to work flexible hours

Preferred Requirements

Experience supporting Support, Customer Success,

DAG Airflows

Knowledge of natural language processing (NLP) and computer vision techniques.

Familiarity with version control systems (e.g., Git).

Snowflake

DBT

Working knowledge of Power BI

AWS environment, for example S3, Lambda, Glue, Cloud watch

Basic understanding of Salesforce

Experience working with remote teams spread across multiple time-zones

Have a hunger to learn and the ability to operate in a self-guided manner

For more info please contact Michael on 01 6146058 / [email protected]

#LI-MF7

  • Senior Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Equifax Full time

    OverviewEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you.Workforce Solutions Data & Analytics (EWS D&A) is a high-energy, fast-growing organization within Equifax charged with building and...

  • Data Scientist Senior Consultant

    4 weeks ago

    Dublin, Dublin City, Ireland Data X Full time

    When you join KPMG Ireland, you are joining a community of over 4,200 employees who collectively work together, both in person and virtually, to achieve their full potential.We are known as an organisation who want you to come as you are and do work that truly matters.Joining KPMG Ireland is an opportunity to enhance your career, not only in the work that...

  • Senior Data Engineer

    1 week ago

    Dublin, Dublin City, Ireland Integral Ad Science Full time

    Join to apply for the Senior Data Engineer role at Integral Ad Science2 weeks ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at Integral Ad ScienceIntegral Ad Science (IAS) is a leading global media measurement and optimization platform that delivers the industry's most actionable data to drive superior results for the...

  • Data Scientist Senior Consultant

    2 weeks ago

    Dublin, Dublin City, Ireland Data X Full time

    When you join KPMG Ireland, you are joining a community of over 4,200 employees who collectively work together, both in person and virtually, to achieve their full potential.We are known as an organisation who want you to come as you are and do work that truly matters. Joining KPMG Ireland is an opportunity to enhance your career, not only in the work that...

  • Senior Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Cognizant Life Sciences Manufacturing Full time

    Get AI-powered advice on this job and more exclusive features.Direct message the job poster from Cognizant Life Sciences ManufacturingCognizant is a world leader in delivering digital transformation solutions to Life Sciences. Through our knowledge and expertise in Automation, MES & Digital, we deliver stable manufacturing systems that are optimized to...

  • Senior Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Apple Inc. Full time

    Dublin, County Dublin, Ireland Software and ServicesDescriptionWe are looking for a Senior Data Engineer to design and develop data pipelines that will be the basis of our Knowledge Graph. The Knowledge Graph aims to unify insights on data processing and lineage across the entire Services division, pulling in metadata on workflows, execution jobs, schemas...

  • Senior Data Engineer

    5 days ago

    Dublin, Dublin City, Ireland Apple Inc. Full time

    Dublin, County Dublin, Ireland Software and ServicesDescriptionWe are looking for a Senior Data Engineer to design and develop data pipelines that will be the basis of our Knowledge Graph.The Knowledge Graph aims to unify insights on data processing and lineage across the entire Services division, pulling in metadata on workflows, execution jobs, schemas and...

  • Senior Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Equifax Full time

    OverviewEquifax is where you can power your possible. If you want to achieve your true potential, chart new paths, develop new skills, collaborate with bright minds, and make a meaningful impact, we want to hear from you.Workforce Solutions Data & Analytics (EWS D&A) is a high-energy, fast-growing organization within Equifax charged with building and...

  • Senior Data Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Houston Texans Full time

    Kitman Labs is the performance intelligence company, disrupting and transforming the way the sports industry uses data to unlock the potential of the world's top athletes.Driven by a passion to innovate in the areas of sports performance, analytics and user experience, we have assembled a team of the industry's top data scientists, sports performance...

  • Senior Data Engineer

    6 days ago

    Dublin, Dublin City, Ireland Workhuman Full time

    Join to apply for the Senior Data Engineer role at Workhuman1 day ago Be among the first 25 applicantsJoin to apply for the Senior Data Engineer role at WorkhumanGet AI-powered advice on this job and more exclusive features.The OpportunityThe Senior Data Engineer will join a team developing a world class data platform to support our customers, products,...