NVIDIA
Senior Product Manager, LLMOps – Human-in-the-loop Tools
This job is now closed
Job Description
- Req#: JR1971392
Define and drive the product vision, metrics, and execution strategy.
Collect and prioritize requirements from internal and external users, author actionable PRD, SRD, SADD documents for Engineering collaboration.
Drive product adoption, continuously monitor product usage and improve it based on customer feedback via web/log analytics, interviews, surveys, NPS, among others.
Design delightful UI/UX experiences alongside Design teams.
Collaborate with the internal Data Factory team to optimize the cost, latency, throughput and quality of human-in-the-loop workflows.
Enable the Guardrails/Red team to make LLMs safe and secure.
Set up the Data Strategy team to collect datasets to train and evaluate LLMs.
Enable the Model Eval team to run human evaluation jobs for generative tasks.
BS or MS in Computer Science, HCI, Design, Operations Research, Economics (or equivalent experience)
8+ years of experience in product management at a technology company, co-founder or related technical role in a startup or equivalent experience
3+ years of experience building crowdsourcing pipelines, optimizing quality, cost, speed.
Collaboration and influencing skills to successfully navigate in a highly matrixed environment. At NVIDIA, your entire company is on your team!
Positive attitude, attention for detail, passion for high-performance and personal growth.
Empathy and deep care for your customers to build products people love.
Pragmatic and data-driven project management skills to navigate software development lifecycle requirements, product release schedules, and customer desires and deliver quality software on schedule.
Strong time management skills – very organized with the ability to multitask and prioritize in a demanding environment.
3+ years of experience working as a product manager on a consumer-grade product with strong viral loops, top notch UI/UX, and gamification mechanics.
3+ years of experience building and shipping AI/ML solutions for enterprises.
A unique mix of design and operations backgrounds applied for a process, which involves 100+ individual contributors, e.g. data labeling factory, content production, ads.
Startup founder experience, who launched multiple 0-1 products to market.
Knowledge of the latest trends around LLMs and Generative AI, Responsible AI, MLOps.
Existing public-facing technical content, research papers or forum contributions on the topic of LLMs and Human-in-the-loop/Crowdsourcing pipelines.
We are looking for a Senior Product Manager to help develop high-impact, high-visibility Large Language Model (LLM) Platform, aka. "NeMo LLM Platform" ( https://www.nvidia.com/en-us/gpu-cloud/nemo-llm-service/ ). You will be focusing on Human-in-the-loop Tools, Services and Workflows, including LLM Data Collection Tool, LLM Data Labeling Tool, LLM Red Teaming Tool, integrations with 3rd party crowdsourcing platforms. This suite of products has top-line visibility and is on a critical path to deliver on the NeMo Foundry strategy as announced recently at GTC 2023.
The Product Management organization is a small, strong, and sought after group both inside and outside of NVIDIA driving the company's Deep Learning and Generative AI strategy. We need a self-starter to continue to grow the Human-in-the-loop Tooling portfolio of products, and work with the customers, who are helping define the future of LLMs. We're looking for the rare blend of technical, operations, and product skills and passion for groundbreaking technology. If this fits, we would love to learn more about you!
What you'll be doing:
What we need to see:
Ways to stand out from the crowd:
NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.You will also be eligible for equity and benefits.
About the company
9637389 Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.