NVIDIA
Senior Software Engineer – AI Compilers for LLM
This job is now closed
Job Description
- Req#: JR1968586
Develop technologies and products involving optimizing compilers, code generators and runtime execution frameworks for accelerating DL training and inference on large scale distributed systems.
Work on compiling a graph intermediate representation (IR) to target specific code and define the interfaces to runtime systems and libraries.
Your contributions will advance state of the art in compiler technology for delivering high performance for acceleration of artificial intelligence workloads across a variety of workloads ranging from inference to training.
Develop both online and offline code generation techniques for use in the deep learning execution environment NVIDIA is developing.
Collaborate with members of the software framework teams and the hardware architecture teams to accelerate the next generation of deep learning software. You will work on integrating the backend in a variety of frameworks.
Masters or PhD or equivalent experience in Computer Science, Computer Engineering, or related field.
6+ years of significant work or research experience in compiler optimizations, synthesis, optimization, code generation, programming models and computer architecture.
Love to work independently, define project scope and goals, and lead your own efforts.
Excellent programming and software design skills, including debugging, performance analysis, and test design. Experience with C/C++is a plus.
Experience with the following technologies is a huge plus:
Deep learning models and algorithms,
Distributed Dataflow computing (e.g. Legate, Ray, Pathways),
Sharding and partitioning,
C++ and Python programming skills,
JAX, PyTorch, TensorFlow
Strong communication skills are required along with the ability to work in a dynamic product oriented team. A history of mentoring junior engineers and interns is a bonus.
Knowledge of CPU and/or GPU architecture. CUDA or OpenCL programming experience desired but not required
NVIDIA's invention of the GPU 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. Today, we are increasingly known as “the AI computing company.” We are seeking a savvy Senior Software Engineer with AI Compiler experience for our Deep Learning Compiler Technology team. Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to speech recognition to natural language processing and artificial intelligence. Join the team that is developing advanced technology for the software which will be used by the entire deep learning community.
What you'll be doing:
What we need to see:
Ways to stand out from the crowd:
With highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology industry's most desirable employers. We have some of the most brilliant and hardworking people in the world working with us and our product lines are growing fast in some of the hottest state of the art fields such as Virtual Reality, Artificial Intelligence, Deep Learning and Autonomous Vehicles.
The base salary range is $176,000 - $333,500. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #deeplearningYou will also be eligible for equity and benefits.
About the company
9637389 Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.