Cloud Data Engineering Expert for Trading Firms

3 days ago


Dublin, Dublin City, Ireland Realtime Recruitment Full time

Join our team of experts at Realtime Recruitment and take on the challenging role of Data Engineer. In this position, you will design, develop, and maintain scalable data pipelines for high-frequency and large-scale data processing.

You will work closely with our quantitative analysts, traders, and developers to integrate various data sources into a cohesive data architecture. Our goal is to develop cutting-edge models, analytics, and technology solutions that drive business growth and success.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines for high-frequency and large-scale data processing.
  • Collaborate with cross-functional teams to optimize data access, storage, and processing.
  • Implement robust ETL processes to ensure data integrity and availability.
  • Develop and optimize real-time and historical data retrieval systems for analysis and model development.
  • Improve data system performance, ensuring low-latency and high-availability for critical applications.
  • Implement data governance, security, and best practices in data management.
  • Automate workflows to improve operational efficiency in data ingestion, transformation, and analysis.
  • Stay updated on emerging technologies and best practices in data engineering, cloud computing, and big data.

Requirements:

  • Bachelor's, Master's, or PhD in Computer Science, Data Engineering, Mathematics, or a related field.
  • 3+ years of experience in data engineering, preferably in trading and capital markets.
  • Proficiency in Python and experience with Python libraries for data processing.
  • Experience with big data technologies like Spark, Hadoop, and Kafka.
  • Knowledge of cloud platforms such as AWS, GCP, or Azure.
  • Familiarity with data modeling, ETL workflows, and pipeline orchestration tools (e.g., Airflow, Prefect).
  • Understanding of data storage methodologies and distributed computing principles.
  • Excellent communication skills to effectively interact with quantitative analysts, traders, and developers.
  • Strong problem-solving skills, attention to detail, and ability to work in a fast-paced environment.


  • Dublin, Dublin City, Ireland Realtime Recruitment Full time

    Rise Above the Rest with Our Cloud Data Engineering ExpertAbout the Job:We're seeking a seasoned Cloud Data Engineering Expert to drive innovation and efficiency in our data infrastructure.This is an exceptional chance to work on cutting-edge projects, collaborate with global stakeholders, and enjoy the flexibility of hybrid working in Dublin.Key...


  • Dublin, Dublin City, Ireland Geneva Trading Full time

    Geneva Trading is committed to hiring talented individuals who share our passion for financial markets.We are looking for a highly skilled Interest Rate Trader to join our team.The ideal candidate will have:A strong understanding of the key macroeconomic drivers of interest ratesA deep knowledge of monetary policy and key reference ratesProfessional poise...

  • Cloud Engineer

    2 weeks ago


    Dublin, Dublin City, Ireland Damson Cloud Full time

    Title: Cloud EngineerRemote status: Fully Remote (In Ireland)Annual Salary range: €50,000 - €55,000Department: Operations/Technical TeamEmployment Type: Full-TimeCompany OverviewDamson Cloud is a Google Cloud Premier Partner in Ireland. With over 22+ years of experience in the IT industry we focus on helping organisations leverage the value of Google...


  • Dublin, Dublin City, Ireland Regal Cloud Full time

    About the Role:We are seeking a highly skilled Vmware Sr. Specialist to join Regal Cloud in Dublin, Ireland.This onsite role requires a specialist with extensive experience in managing and optimizing VMware environments.You will be responsible for the installation, configuration, and maintenance of vSphere environments, along with migration, monitoring,...


  • Dublin, Dublin City, Ireland Fruition Group Ireland Full time

    Job Description:Fruition Group Ireland is a leading trading firm that requires a Senior Python Developer to develop, optimize, and maintain high-performance Python applications.The successful candidate will design and implement robust database solutions to support trading operations, work closely with quantitative analysts and traders to develop trading...


  • Dublin, Dublin City, Ireland Archer Recruitment Full time

    We are seeking a highly skilled Data Solutions Architect to lead our team in building big data and cloud solutions. As an expert in designing and building data lakes, you'll play a key role in developing new data pipelines that will power our client's future growth.The ideal candidate will have 15+ years of experience as a Senior Data Engineer, deep...


  • Dublin, Dublin City, Ireland Taiga Cloud Limited Full time

    Cloud Solution Architect Platform (m/f/d)As the AI Cloud Solution Architect – Platform, you will play a critical role in shaping and implementing the platform architecture that powers our AI cloud solutions. Your role is to secure and win customers' technical decision and empower them to utilize our technology. You will collaborate with clients, early in...


  • Dublin, Dublin City, Ireland Tbwa ChiatDay Inc Full time

    We are seeking a highly motivated Trade Operations Specialist to join our team at Virtu Financial. In this role, you will be responsible for managing the clearance, settlement, and reconciliation of trades and positions on behalf of trade desks across the firm.About Virtu FinancialVirtu Financial is a leading financial firm that utilises cutting-edge...


  • Dublin, Dublin City, Ireland Archer - The IT Recruitment Consultancy Full time

    We are looking for a talented Cloud-Based Data Warehouse Expert to join our team in Dublin. As a Cloud-Based Data Warehouse Expert, you will be responsible for designing, developing, and maintaining cloud-based data warehouse infrastructure using Microsoft technologies such as SSIS, SSRS, and SSAS.This is an exciting opportunity to work on cutting-edge...


  • Dublin, Dublin City, Ireland Amazon Data Services Ireland Limited Full time

    At Amazon Data Services Ireland Limited, we are seeking a talented Cloud Networking Engineer to join our team of experts in designing and developing software and services for our global optical network.The successful candidate will work closely with our System and Network Development Engineers, Network Operations, and peer software teams to ensure designs...


  • Dublin, Dublin City, Ireland Jobs For Humanity Full time

    About You:As a seasoned Full Stack Engineer, you bring proven experience in building RESTful APIs, GraphQL services, and backend systems using TypeScript, React, and clean code practices. Your strong skills in cloud environments (AWS, Google Cloud) and technologies like Docker, Kubernetes, and Terraform make you an ideal fit for this role.In addition to your...


  • Dublin, Dublin City, Ireland Cloud Cover LLC Full time

    MongoDB's mission is to empower innovators to create, transform, and disrupt industries by unleashing the power of software and data. We enable organizations of all sizes to easily build, scale, and run modern applications by helping them modernize legacy workloads, embrace innovation, and unleash AI. Our industry-leading developer data platform, MongoDB...


  • Dublin, Dublin City, Ireland Archer Recruitment Full time

    We are seeking a highly skilled Data Engineer to join our team at Archer Recruitment. As a key member of our team, you will be responsible for designing, developing, and maintaining ETLs, Data Lake, and Data Warehouse structures using SSIS, SSRS, SSAS, and the Azure tech stack.This role offers full ownership of the data warehouse, including an upcoming...


  • Dublin, Dublin City, Ireland Hudson River Trading Full time

    The Trade Operations (TradeOps) team is responsible for managing HRT's live trading environment. The team creates and maintains one of the most robust and efficient trading platforms in the world. This includes configuring, monitoring, and optimizing the firm's trading as well as handling risk, regulatory, and development tasks. The Trade Operations team...


  • Dublin, Dublin City, Ireland TN Ireland Full time

    Social network you want to login/join with:Data Analytics and Cloud Security Expert - DublinClient:Location:Dublin, IrelandJob Category:OtherEU work permit required:YesJob Reference:c7fe750686adJob Views:7Job Description:The Data Analytics and Cloud Security Expert will play a key role in delivering secure data analytics solutions that meet the needs of our...


  • Dublin, Dublin City, Ireland Geneva Trading Full time

    How You Can Make an ImpactGeneva Trading is seeking a motivated Part Qualified Junior Accountant to join our dynamic Finance team in Dublin. In this role, you'll gain broad exposure to the financial operations of a fast-paced trading business. The ideal candidate will have a solid academic background, excellent analytical skills, and a passion for...


  • Dublin, Dublin City, Ireland Tbwa ChiatDay Inc Full time

    The role of a Business Analyst for Trade Operations is to manage the clearance, settlement, and reconciliation of trades and positions on behalf of trade desks across Virtu Financial.About Virtu FinancialVirtu Financial is a leading financial firm that leverages cutting-edge technology to deliver liquidity to global markets and innovative trading solutions...


  • Dublin, Dublin City, Ireland Amazon Full time

    At Amazon Web Services, we are on a mission to be the leading provider of cloud-based services. Our team is comprised of experts in various fields, and we are looking for talented individuals who can help us achieve our goals.About UsWe pioneered cloud computing and never stopped innovating. Our robust suite of products and services powers businesses across...


  • Dublin, Dublin City, Ireland ESB Full time

    Job Summary: We are seeking an experienced Power Trading Expert to join our team. The successful candidate will be responsible for analyzing market trends, developing trading strategies, and optimizing our trading operations.About ESB: ESB is a leading energy company in Ireland, committed to delivering safe, reliable, and sustainable energy solutions to our...


  • Dublin, Dublin City, Ireland Regal Cloud Full time

    About Regal CloudCompany OverviewWe are a leading enterprise solutions provider, delivering cutting-edge storage infrastructure and expertise to our clients.Our team of experts is dedicated to ensuring seamless operations and optimal performance of PowerScale infrastructure.