Senior Data Engineer
1 week ago
Overview
8 West Consulting is one of the country’s largest software development organisations. Formerly named DeCare Systems Ireland, the company has been operating successfully in Cork city since 1998. 8 West Consulting employ a wide range of technologies including Mobile (iOS, Android, Windows), Java SE/Java EE (WebLogic, WebSphere, Spring, Akka, Hibernate, GWT, etc.), Microsoft .NET (ASP.NET, C#, etc.), JavaScript (AngularJS, JQuery, dojo, etc.), various database management systems (MongoDB, Oracle, SQL Server, MySql, etc.). 8 West Consulting provides consultancy and leading-edge software solutions for a wide variety of US, EU and UK based clients in the insurance, healthcare, retail and public sector markets.
For more on 8 West Consulting visit our website www.8west.ie
Position Summary
The Senior Data Engineer is responsible for designing, developing, and maintaining scalable data solutions across both legacy and modern cloud platforms. The role requires deep expertise in cloud-based data warehousing, strong hands-on skills in Python and ETL pipeline development, and the ability to work in dynamic, agile environments.
The successful candidate must demonstrate excellent verbal and written English communication skills and be able to collaborate effectively with stakeholders across the business.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT processes, including pipelines for extraction, transformation, cleaning, pre-processing, aggregation, and loading of data from diverse sources
- Develop, enhance, and maintain ETL solutions using SSIS and cloud-based data platforms
- Deliver across the full agile lifecycle, including design, coding, testing, and deployment of iterative data solution
- Collaborate with cross-functional teams to ensure data quality, integrity, availability, and auditability
Qualifications & Experience
- Minimum 10 years’ experience in data engineering with a strong focus on cloud data platforms
- Deep expertise in Snowflake, including cloud-based data warehousing, ELT/ETL pipeline development, and performance tuning
- Demonstrated experience building and maintaining ETL processes, ideally using SSIS and Snowflake
- Strong proficiency in Python for scripting, automation, and data pipeline development
- Hands-on experience with AWS (e.g., data lakes, Glue, S3, Redshift) and exposure to Azure data services
- Practical experience using Terraform (or similar IaC tools) for provisioning and managing cloud infrastructure
- Proficiency in working with JSON, XML, and other semi-structured data
- Work with messaging and queuing systems (e.g., SQS, SNS) to support event-driven data flows
- Familiarity with streaming data platforms (e.g., Kafka, Kinesis) is an advantage
- Strong background in Git-based workflows (branching strategies, pull requests, CI/CD pipelines)
- Excellent verbal and written English communication skills
Skills & Competencies
- Strong analytical and problem-solving skills
- Ability to design scalable, reliable, and high-performance data solutions
- Clear communicator, capable of presenting complex technical concepts to varied audiences
- Excellent documentation and technical writing skills
- Strong understanding of infrastructure automation and best practices in cloud resource management
- Proactive, adaptable, and able to deliver results in fast-paced environments
[Please note this is a daily rate contract position]
#J-18808-Ljbffr
-
Cork, Ireland Aiven Full timeA leading technology firm in Cork is seeking a Senior Data Engineer to build and own critical components of their data platform. This role involves tackling complex data challenges and delivering scalable solutions. Ideal candidates have a strong execution focus, experience in data pipelines, and the ability to contribute to architectural decisions. A...
-
Senior Data Engineer
7 days ago
Cork, Ireland Aiven Full timeWe’re a global team of over 400 people, working together to push the boundaries of open-source technology and multi-cloud solutions. Our vision is to become the trusted Data & AI Platform for everyone, leveraging the most popular open-source technologies like Apache Kafka®, Aiven for PostgreSQL®, Aiven for Clickhouse®, and Aiven for OpenSearch® to help...
-
Cork, Ireland Pfizer Pharmaceutical Full timeCompany description: Pfizers purpose is to deliver breakthroughs that change patients lives. Research and Development is at the heart of fulfilling Pfizers purpose as we work to translate advanced science and technologies into the therapies and vaccines that matter most. Whether you are in the discovery sciences, ensuring drug safety and efficacy or...
-
Senior Data Analyst
4 days ago
Cork, Ireland Arlo Technologies, Inc. Full timeSenior Data Analyst page is loaded## Senior Data Analystlocations: Cork, Irelandtime type: Full timeposted on: Posted 5 Days Agojob requisition id: JR100169**About Arlo:**At Arlo, we're passionate about creating innovative and reliable solutions that help people protect what matters most to them. Our team is dedicated to delivering products that...
-
3 Days Left! Senior Data Engineer
4 weeks ago
Cork, Ireland Quest Software Canada Inc Full timeOverview Quest's Software Center for Advanced AI Architecture in Cork, Ireland is seeking visionary data science leaders to shape our AI strategy and drive organizational transformation. As the central hub for AI innovation across Quest's entire SaaS platform ecosystem, it will shape the future of enterprise AI solutions that serve millions of users...
-
Senior Data Engineer
4 days ago
Cork, Ireland Qualcomm Full timeCompany: QT Technologies Ireland Limited Job Area: Engineering Group, Engineering Group > ASICS Engineering General Summary Qualcomm is a company of inventors that unlocked 5G—ushering in an age of rapid acceleration in connectivity and new possibilities that will transform industries, create jobs, and enrich lives. But this is just the beginning. It takes...
-
Lead Data Engineer
2 weeks ago
Cork, Ireland Cpl Resources Full timeOur client, a leading technology platform provider is seeking aLead Data Engineer to join the team. This role will take ownership of a transitioning data and analytics platform as they move from on-premise to a modern, cloud-based environment. This is a hands-on leadership role, combining technical expertise with strategic influence to design, build, and...
-
Senior Product Manager
4 weeks ago
Cork, Ireland Everseen Full timeJoin to apply for the Senior Product Manager - Data Intelligence role at Everseen . Everseen : A leader in vision AI solutions for the world’s leading retailers. The Role As the Data Intelligence Sr. Product Manager, your primary goal is to build a product line for retail customers based on intelligence gathered with Everseen products and...
-
Lead Data Engineer
2 weeks ago
Cork, Ireland CPL Full timeOur client, a leading technology platform provider is seeking a Lead Data Engineer to join the team. This role will take ownership of a transitioning data and analytics platform as they move from on-premise to a modern, cloud-based environment. This is a hands-on leadership role, combining technical expertise with strategic influence to design, build, and...
-
Senior Technical Support Engineer
4 weeks ago
Cork, Ireland NetApp Full timeJoin to apply for the Senior Technical Support Engineer role at NetApp 3 days ago Be among the first 25 applicants Join to apply for the Senior Technical Support Engineer role at NetApp Get AI-powered advice on this job and more exclusive features. About NetApp NetApp is the intelligent data infrastructure company, turning a world of disruption into...