Data Engineer

Found in: Talent IE C2 - 2 weeks ago

Dublin, Ireland Microsoft Full time

Overview

Every day, hundreds of millions of people use Microsoft services such as Microsoft365, Azure, Xbox, Outlook.com… While they may not know it, all those user accounts are protected from cybercriminals by Microsoft’s Identity security team.

The Microsoft Identity security team is on a mission to protect our users from account compromise and fraud. Our data science team is at the core of this mission, creating and improving the machine learning based detections that are used to find and block the malicious actors from harming our systems and customers.

We are looking for a data engineer to join our growing team of data scientists and machine learning engineers. You will contribute to designing the next-gen cloud-based ML and data infrastructure that support a full-stack Data Science team. You will be responsible for creating, maintaining, and optimizing the data sets and data pipelines used by our cross-functional Data Science team. You will also partner with the data scientists and analysts to define business metrics and build dashboards to monitor our protections systems and detections and guide our product planning.

Do you love big data and the challenges it entails? Do you like the idea of applying your technical skills to protect millions of Microsoft customers from malicious actors? Do you want be part of team of smart, talented and mission driven people? Then this job is for you

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

Qualifications

Basic Qualifications:

Experience in a Data Engineer or Software Engineer role with a focus on cloud-based big data processing. Experience in developing tools and data pipelines using Apache Spark and Python or similar tools. Experience in building and optimizing "big data" workflows using modern cloud-based platforms, including ETL, business intelligence pipelines, and data visualization tools like Power BI. Strong understanding in data modeling.

Preferred Qualifications:

Experience with one of the major cloud-based data platforms. Familiarity with relational databases and working knowledge of a variety of big data sources in Spark, Scala, Snowflake and/or other big data systems. Experience in designing/implementing large-scale data infrastructure to support a Data Science team. Demonstrated proficiency in writing complex, highly optimized queries across diverse data sets and implementing data science applications in Python using cloud-based tools. Excellent written and verbal communication skills.

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Responsibilities

Designing and developing data pipelines. Create data pipelines and ETL (Extract, Transform, Load) processes to extract data from various sources, transform it, and load it into data warehouses, lakes, or other storage systems. Ensuring scalability, reliability and effeciency is crucial. Create and manage reports and dashboards to monitor KPIs, the identity attack ecosystem, and other indicators crucial for understanding the threat landscape and assessing the accuracy and performance of our detections. Collaborate with the team to address business inquiries using telemetry data. Effectively communicate key insights and results to stakeholders and leadership. Utilize data storytelling and visualization techniques to recommend product decisions. Implementing Data Integration Solutions: This involves setting up batch and real-time data ingestion, data synchronization, and data streaming.

Building and Maintaining Data Warehouses and Lakes. Configure schema designs, partitioning strategies, indexing, and storage optimization techniques to support data analytics and reporting requirements.

Deploying and managing cloud-based data platforms (Microsoft Azure SQL Data Warehouse/ Data Lake) with proper security and access controls. Monitoring troubleshooting Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.Industry leading healthcareEducational resourcesDiscounts on products and servicesSavings and investmentsMaternity and paternity leaveGenerous time awayGiving programsOpportunities to network and connect

  • Mechanical Engineering Technician

    Found in: Talent IE C2 - 3 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are currently seeking a Data Center Operations Electrical/Mechanical/Control Technician to join our Engineering Oprerations Team. The successful candidate will oversee the operation and maintenance of the electrical and mechanical infrastructure for Data Centers (DC) in Amazon Web Services (AWS) Cloud regions. Our technicians are operating and maintaining...

  • Mechanical Engineering Technician

    Found in: Talent IE C2 - 2 days ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are currently seeking a Data Center Operations Electrical/Mechanical/Control Technician to join our Engineering Oprerations Team. The successful candidate will oversee the operation and maintenance of the electrical and mechanical infrastructure for Data Centers (DC) in Amazon Web Services (AWS) Cloud regions. Our technicians are operating and maintaining...

  • Data Center Engineering Operation Technician

    Found in: Talent IE C2 - 1 week ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are currently seeking a Data Centre Engineering Operation Technician to serve as a technical resource within our mission critical Data Centre. The position will help ensure overall availability and reliability to meet or exceed defined service levels of Data Centre Operations. Due to the success of the Amazon’ operations and rapid expansion of Data...

  • Data Center Technician

    Found in: Talent IE C2 - 1 day ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    This role is a unique opportunity to work in some of the most cutting edge data centers in the world. Amazon data centers are large-scale high-density centers where you will be working on changing the face of Cloud technology in the region. A Data Center Technician will work as part of the Operations team whose primary responsibility is the maintenance and...

  • Data Center Engineering Operation Technician

    Found in: Talent IE C2 - 1 week ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    We are looking for a Data Center Engineering Operations Technician to join our expanding Infrastructure Operations team. Data Center Engineering Operations Technician is a hands-on electrical and mechanical equipment troubleshooting and operation responder. If you like to use apply your electrical and mechanical skills to solve problems, we’d like to meet...

  • Data Center Facility Manager, Data Center

    Found in: Talent IE C2 - 3 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    Our Data Centers runs critical IT infrastructure, it requires a reliable supply of uninterrupted cooling and power at all times, in order to deliver continuous uptime availability for our customers. We encounter interesting, challenging & complex problems every day, being a technical manager in Amazon means that you can innovate to solve these issues and...

  • Electrical Engineering Technician

    Found in: Talent IE C2 - 3 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    The successful candidate will oversee the operation and maintenance of the electrical and mechanical infrastructure for Data Centers (DC) in Amazon Web Services (AWS) Cloud regions. Our technicians are operating and maintaining AWS DCs’ world-class mechanical and electrical infrastructure. In addition to technical operations and maintenance, the successful...

  • Data Engineer

    Found in: Talent IE C2 - 1 week ago

    Dublin, Ireland The Irish Times Full time

    We are in search of a skilled Data Engineer to join our proactive Group Analytics & Insights team to help us develop and maintain robust data pipelines, infrastructure, and analytics systems. As a Data Engineer at The Irish Times, you will be essential in ensuring the availability, reliability, and scalability of our data infrastructure. Your...

  • Sr. Electrical Controls Engineer, Data Center Controls SysDev Engineering

    Found in: Talent IE C2 - 4 days ago

    Dublin, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Sr. Electrical Controls Engineer, Data Center Controls SysDev Engineering

    Found in: Talent IE C2 - 2 days ago

    Dublin, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Data Center Manager,

    Found in: Talent IE C2 - 3 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Data Engineer

    Found in: beBee jobs IE - 2 weeks ago

    Dublin, Dublin City, Ireland Reperio Human Capital Full time

    Data Engineer Initial 6 month Contract (great potential to extend)Location: Cork area, Ireland Rate: Competitive A new opportunity has opened up for a Data Engineer to join my client, based in Dublin, Ireland. This is an initial 6 month contract with great potential to extend beyond. This role is hybrid 2-3 days per week in office, and you must be based in...

  • Data Center Lifecycle BIM Specialist, Fleet Remediation Engineering

    Found in: Talent IE C2 - 2 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited Full time

    Are you an experienced BIM/CAD professional with a passion for data center design and looking for a challenge of contributing to BIM lifecycle management? Are you well versed in graphical communication for data center building drawings in all disciplines? If so, we are looking for you to help us make history.As a Lifecycle BIM Specialist, you will produce...

  • Data Engineer

    Found in: Talent IE 2A C2 - 1 week ago

    Dublin, Ireland Solas IT Recruitment Full time

    My client is seeking a smart and critical-thinking Data Engineer with experience in Microsoft SQL Server database design & development and some experience in Microsoft .Net C# software development. You will be responsible for designing, developing, and maintaining data pipelines, ETL processes, and data integration solutions which are responsible for...

  • Data Engineer

    2 weeks ago

    Dublin, Ireland Cubic Telecom Full time

    The Company Founded in 2009, Cubic Telecom has grown to become one of the leading providers of connectivity solutions and analytics services that help vehicle and IoT device manufacturers manage and grow revenue streams. Fast paced, smart, ambitious, and continually seeking new, ideas. That’s us, is it you? At Cubic you will find an environment filled...

  • Data Engineer

    Found in: Talent IE C2 - 2 weeks ago

    Dublin, Ireland Cubic Telecom Full time

    The Company Founded in 2009, Cubic Telecom has grown to become one of the leading providers of connectivity solutions and analytics services that help vehicle and IoT device manufacturers manage and grow revenue streams. Fast paced, smart, ambitious, and continually seeking new, ideas. That’s us, is it you? At Cubic you will find an environment filled with...

  • Data Center IT Infrastructure Manager,

    Found in: Talent IE C2 - 3 weeks ago

    Dublin, Ireland Amazon Data Services Ireland Limited - A65 Full time

    AWS Infrastructure Services owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we’re the people who keep the cloud running. We support all AWS data centers and all of the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely...

  • Data Engineer

    Found in: beBee jobs IE - 3 weeks ago

    Dublin, Dublin City, Ireland GlobeTech Full time

    GlobeTech is a global provider of software localisation, translation, QA and data analysis to the multinational IT sector. We provide market leading solutions to our clients with the core objective of helping them to expand and grow their business in the personalised and data driven age. Established in 1997 by two expert Engineers, our bespoke services have...

  • Data Engineer

    2 weeks ago

    Dublin, Ireland Clear Strategy Full time

    We have a number of positions open and are looking for Data Engineers with various levels of experience ranging from junior (2-3 years) to experienced (5+ yrs.). The responsibilities and expectations listed in this job description will therefore vary based on your level of experience. About Us Clear Strategy is a fast-growing professional services &...

  • Azure Data Engineer

    Found in: Talent IE C2 - 11 hours ago

    Dublin, Ireland Epicor Full time

    Epicor is seeking a highly skilled Azure Data Engineer to join our dynamic team. As Data Engineer, you will be responsible for overseeing all aspects of our Azure data processing pipelines, including development, implementation, and testing. In addition, you will work closely with our business functions and BI team to identify opportunities to optimize...