AI/HPC Network Development Engineer

2 weeks ago

Dublin, Dublin City, Ireland xAI Full time
About the Role

xAI was first in the world to build a 100k GPU cluster on an ethernet network and then did it again in 92 days, floors, walls and all. We need an engineer with deep experience in RoCEv2 that can develop at hyper scale while optimizing performance and availability.

Responsibilities
  • Develop at hyper scale with RoCEv2 to optimize performance and availability for AI training and inference workloads.
  • Spend significant time deep inside NCCL, building metric dashboards and tweaking configurations to ensure optimal performance.
  • Help design the next iteration of our backend and front-end networks to enable seamless expansion of GPU infrastructure with minimal engineering assistance.
  • Understand current network performance and availability and optimize it in support of training models and customer inference queries.
  • Travel to Memphis for data center builds and participate in a team on-call rotation, contributing to deployment and operations frameworks to reduce repetitive tasks.
Location

We have 2 openings, one based in Palo Alto, California and the other in Dublin, Ireland. There will be significant travel to Memphis, Tennessee for data center buildouts and to the head office in Palo Alto for team collaboration.

Ideal Experiences
  • A minimum of 10 years designing and operating large scale networks with 5 years in the ethernet AI/HPC space.
  • Deep understanding of congestion control on ethernet, with Infiniband as an added bonus.
  • Deep understanding of AI training and inference workloads and how they operate on the network. Ability to use and debug NCCL and potentially commit to the library.
  • Experience creating a portfolio of metrics for performance and operations to optimize the fleet for training and inference traffic.
  • Experience with Python to automate repetitive tasks and to analyze large datasets.
Interview Process

After submitting your application, the team reviews your CV and statement of exceptional work. If your application passes this stage, you will be invited to an initial interview (45 minutes – 1 hour) during which a member of our team will ask some basic questions. If you clear the initial phone interview, you will enter the main process, which consists of five interviews:

  • Coding assessment in a language of your choice.
  • Data center network technologies and RoCEv2.
  • Meet and greet with the wider team where you will run through a presentation of a body of work you are proud of.
Compensation and Benefits

Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.

xAI is an equal opportunity employer.

Position details
  • Seniority level: Mid-Senior level
  • Employment type: Part-time
  • Job function: Information Technology
  • Industries: Technology, Information and Internet
#J-18808-Ljbffr

  • Advanced AI/HPC Network Solutions Expert

    5 days ago

    Dublin, Dublin City, Ireland beBeeNetwork Full time €180,000 - €250,000

    Spearhead AI/HPC Network Development EngineerxAI is revolutionizing the field of artificial intelligence by developing systems that can accurately understand the universe and contribute to humanity's pursuit of knowledge.Job DescriptionAs a key member of our team, you will be responsible for designing and operating large-scale networks with a focus on...

  • Ai/Hpc Network Development Engineer

    3 weeks ago

    Dublin, Dublin City, Ireland Pantera Capital Full time

    About xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.Our team is small, highly motivated, and focused on engineering excellence.This organization is for individuals who appreciate challenging themselves and thrive on curiosity.We operate with a flat organizational...

  • AI/HPC Network Development Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Pantera Capital Full time

    About xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational...

  • AI/HPC Network Development Engineer

    2 days ago

    Dublin, Dublin City, Ireland Pantera Capital Full time

    About xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational...

  • AI/HPC Network Development Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland xAI Full time

    Dublin, IRLAbout xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat...

  • Ai/Hpc Network Development Engineer

    3 days ago

    Dublin, Dublin City, Ireland Xai Full time

    Dublin, IRLAbout xAIxAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.Our team is small, highly motivated, and focused on engineering excellence.This organization is for individuals who appreciate challenging themselves and thrive on curiosity.We operate with a flat organizational...

  • HPC Software Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland Canonical Full time

    OverviewJoin to apply for the HPC Software Engineer role at Canonical. Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers...

  • High-Performance Network Engineer

    2 weeks ago

    Dublin, Dublin City, Ireland beBeeNetwork Full time €120,000 - €140,000

    About xAIWe are looking for a seasoned engineer to join our team and contribute to the development of high-performance networks. Our ideal candidate will have extensive experience in designing and operating large-scale networks, with a strong focus on ethernet AI/HPC solutions.

  • HPC Application Developer

    2 weeks ago

    Dublin, Dublin City, Ireland beBeeSoftware Full time €90,000 - €120,000

    Job Title:HPC Software Engineer">DescriptionWe are seeking a talented HPC Software Engineer to join our team. The ideal candidate will have expertise in designing and developing high-performance computing solutions using Python.">The role involves collaborating with a globally distributed team to deliver an outstanding HPC experience. This includes working...

  • AI Cloud Engineer

    4 days ago

    Dublin, Dublin City, Ireland beBeeSoftware Full time €90,000 - €120,000

    Job DescriptionWe are seeking a skilled Software Engineer to join our team in Dublin. The successful candidate will contribute to the development, testing, and maintenance of Azure HPC/AI Images.This role offers the opportunity to learn from experts and contribute to the Azure HPC/AI infrastructure that supports scientific research, AI innovation, and...