• Job Description

  Req#: 32553503652

  Senior AI Software Engineer, GenAI Framework (Finance)

  We are seeking AI Software Engineers for NeMo! NVIDIA NeMo is an open-source, scalable, and cloud-native framework designed for researchers and developers working on Large Language Models (LLMs), Multimodal (MM), and Speech AI. NeMo offers end-to-end model training, including data curation, alignment, customization, evaluation, deployment, and tooling to enhance performance and user experience.

  In this critical role, you will enhance NeMo Framework's capabilities by designing and implementing new features and optimizations, defining robust APIs, analyzing and tuning performance, and expanding our toolkits and libraries. You will collaborate with internal teams, users, and the open-source community to develop highly optimized solutions.

  What you'll be doing:

  1. Design and develop the GenAI open-source NeMo Framework and Megatron Core.
  2. Address large-scale AI training and inference challenges across the full model lifecycle, from data curation and preprocessing to training, tuning, and deployment.
  3. Work at the intersection of deep learning applications, libraries, frameworks, and the entire software stack.
  4. Perform performance tuning and optimization of deep learning frameworks and software components.
  5. Research, prototype, and develop scalable AI tools and pipelines.

  What we need to see:

  1. MS, PhD, or equivalent experience in Computer Science, AI, Applied Math, or related field with 5+ years of industry experience.
  2. Experience with AI frameworks (e.g., PyTorch, JAX) and inference/deployment environments (e.g., TRT, ONNX, Triton).
  3. Proficiency in Python programming, software design, debugging, performance analysis, testing, and documentation.
  4. A proven track record of effective collaboration across multiple engineering initiatives and contributions to AI libraries with innovative improvements.
  5. Strong understanding of deep learning fundamentals and their practical applications.

  Ways to stand out from the crowd:

  1. Expertise in large-scale AI training, with a deep understanding of core compute system concepts such as latency/throughput bottlenecks, pipelining, and multiprocessing, along with demonstrated excellence in performance analysis and tuning.
  2. Experience with Generative AI techniques applied to LLM and MM learning (Text, Image, Video, Speech).
  3. Knowledge of GPU/CPU architecture and related numerical software.
  4. Experience with cloud computing (e.g., AI training and inference pipelines on AWS, Azure, GCP, OCI).
  5. Contributions to open source deep learning frameworks.

  NVIDIA is recognized as one of the most desirable employers in the technology industry, with a team of forward-thinking and dedicated professionals. If you are creative and autonomous, we want to hear from you!

  The base salary range is $148,000 - $287,500, determined by location, experience, and comparable roles.

  You will also be eligible for equity and benefits. NVIDIA accepts applications continuously.

  NVIDIA is committed to diversity and equal opportunity, valuing inclusivity in hiring and promotion practices without discrimination based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability, or any other legally protected characteristic.

  #J-18808-Ljbffr

• About the company

Notice