Senior MLOps Engineer, vLLM Inference

4 days ago

Waterford, Ireland Red Hat Full time

At Red Hat, we believe the future of AI is open, and we are on a mission to bring the power of open-source LLMs and vLLM to every enterprise. The Red Hat Inference team accelerates AI for the enterprise and brings operational simplicity to GenAI deployments.
We are seeking an experienced ML Ops engineer to work closely with our product and research teams to scale SOTA deep learning products and software. As an ML Ops engineer, you will work closely with our technical and research teams to manage training and deployment pipelines, create DevOps and CI/CD infrastructure, and scale our current technology stack.
In this role, your primary responsibility will be to build and release the Red Hat AI Inference runtimes, continuously improve the processes and tooling used by the DevOps team, and find opportunities to automate procedures and tasks.
What You Will Do
Collaborate with research and product development teams to scale machine learning products for internal and external applications
Create and manage model training and deployment pipelines
Actively contribute to managing and releasing upstream and midstream product builds
Test to ensure correctness, responsiveness, and efficiency
Troubleshoot, debug, and upgrade Dev & Test pipelines
Identify and deploy cybersecurity measures by continuously performing vulnerability assessment and risk management
Collaborate with a cross-functional team about market requirements and best practices
Keep abreast of the latest technologies and standards in the field
What You Will Bring
2+ years of experience in MLOps, DevOps, Automation, and modern Software Deployment practices
Experience evaluating LLMs for performance on accelerators and accuracy
Strong experience with Python and PyTest
Experience with Git, Github Actions, Terraform, Jenkins, Ansible, and common technologies for automation and monitoring
Highly experienced with administering Kubernetes/Openshift
Familiar with Agile development methodology
Experience with Cloud Computing using at least one of the following Cloud infrastructures: AWS, GCP, Azure, or IBM Cloud
Solid programming skills, especially in Python
Solid troubleshooting skills
Ability to interact comfortably with the other members of a large, geographically dispersed team
Experience maintaining an infrastructure and ensuring stability
Benefits
Comprehensive medical, dental, and vision coverage
Flexible Spending Account - healthcare and dependent care
Health Savings Account - high deductible medical plan
Retirement 401(k) with employer match
Paid time off and holidays
Paid parental leave plans for all new parents
Leave benefits including disability, paid family medical leave, and paid military leave
Red Hat is proud to be an equal opportunity workplace and an affirmative action employer. We review applications for employment without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, physical or mental disability, medical condition, marital status, or any other basis prohibited by law.

#J-18808-Ljbffr

  • Senior UI Engineer

    4 weeks ago

    Waterford, Waterford, Ireland Red Hat Full time

    Red Hat Waterford, County Waterford, IrelandAre you ready to join a game-changing open-source AI platform that harnesses the power of hybrid cloud to drive innovation?The Red Hat OpenShift AI (RHOAI) team is looking for a Software Engineer with Kubernetes and MLOps (Machine Learning) experience to join our rapidly growing engineering team. Our focus is to...

  • RHOAI Senior Customer Experience Engineer.

    1 week ago

    Waterford, Ireland Red Hat Full time

    RHOAI Senior Customer Experience Engineer Red Hat, Waterford, County Waterford, Ireland What You Will Do Contribute to the architecture, design, development, and testing of new features and solutions for RHOAI Test like a customer and provide feedback and recommendations on how to make our RHOAI platform better Innovate in the MLOps domain by...

  • RHOAI Senior Customer Experience Engineer

    4 weeks ago

    Waterford, Waterford, Ireland Red Hat Full time

    RHOAI Senior Customer Experience EngineerRed Hat, Waterford, County Waterford, IrelandWhat You Will DoContribute to the architecture, design, development, and testing of new features and solutions for RHOAITest like a customer and provide feedback and recommendations on how to make our RHOAI platform betterInnovate in the MLOps domain by participating in...

  • Software Engineer

    3 weeks ago

    Waterford, Ireland Red Hat Full time

    Software Quality Engineer - Notebooks (Waterford, Ireland) page is loaded Software Quality Engineer - Notebooks (Waterford, Ireland) Apply remote type Hybrid locations Waterford City time type Full time posted on Posted 3 Days Ago job requisition id R-043835 Company Description At Red Hat, we connect an innovative community of customers, partners, and...

  • Software Engineer

    2 weeks ago

    Waterford, Ireland Red Hat Full time

    Software Quality Engineer - Notebooks (Waterford, Ireland) page is loadedSoftware Quality Engineer - Notebooks (Waterford, Ireland)Apply remote type Hybrid locations Waterford City time type Full time posted on Posted 3 Days Ago job requisition id R-043835Company DescriptionAt Red Hat, we connect an innovative community of customers, partners, and...

  • Machine Learning Engineer

    3 weeks ago

    Waterford, Ireland Red Hat Full time

    Machine Learning Engineer - Tooling Experience (Waterford, Ireland) page is loaded Machine Learning Engineer - Tooling Experience (Waterford, Ireland) Apply remote type Hybrid locations Waterford City time type Full time posted on Posted Yesterday job requisition id R-043833 Company Description At Red Hat, we connect an innovative community of customers,...

  • [Urgent] Senior Engineer

    2 weeks ago

    Waterford, Ireland Global Professional Consultants Full time

    Our client, a premier Tier 1 contractor, is looking for a Senior Engineer to join their team on a major healthcare project in Waterford. This role is ideal for a highly motivated engineering professional eager to contribute to a flagship development with significant impact on the local community. Key Responsibilities: Provide technical leadership and...

  • Senior Civil Engineer

    1 hour ago

    Waterford, Ireland Access Talent Group Full time

    OverviewFlexible remote working policy, working hours and 9-day fortnightThis is a fantastic opportunity to lead on high-profile infrastructure and development projects across Ireland, while progressing your career within a forward-thinking and supportive environment.The RoleAs Senior Civil Engineer, you will:Lead the planning, design, and delivery of...

  • Senior Civil Engineer

    1 week ago

    Waterford, Ireland Access Talent Group Full time

    OverviewFlexible remote working policy, working hours and 9-day fortnightThis is a fantastic opportunity to lead on high-profile infrastructure and development projects across Ireland, while progressing your career within a forward-thinking and supportive environment.The RoleAs Senior Civil Engineer, you will:Lead the planning, design, and delivery of...

  • Senior Resident Engineer

    1 week ago

    Waterford, Ireland Roughan & O'Donovan Full time

    OverviewSenior Resident Engineer - Waterford at Roughan & O'Donovan (ROD).This is a fixed-term contract role for a Waterford City Public Infrastructure Project, including the Sustainable Transport Bridge and South Plaza Works.Location: Waterford City Centre.Salary: Competitive.Contract duration: 12 months.ResponsibilitiesSupervise the construction of the...