NVIDIA

Senior Data Engineer, LLM MLOps Platform


This job is now closed

PayCompetitive
LocationPune/Maharashtra
Employment typeFull-Time
  • Job Description

      Req#: JR1968523

      NVIDIA is hiring a Senior Data Engineer on our unified LLM MLOps platform by developing ML data pipelines for a wide range of diverse use cases. NVIDIA is in a unique position: we are developing AI-based products across multiple domains. Our vision is to bring to bear the MLOps platform we developed for Autonomous Vehicles and apply it to other use cases: NLP, speech, recommendation systems, computer vision, healthcare. To achieve this, we will embed ourselves into ML teams to help them develop their MLOps pipeline on to a single methodology that uses that unified platform, recognize what is common to all use cases and what is domain-specific and develop MLOps tools and features. The members of that team will realize the MLOps strategy for NVIDIA and understand both MLOps production pipelines and MLOps infrastructure in order to help us create what could be the best and most comprehensive MLOps platform in the world.

      What you'll be doing:

      • Support machine learning teams that deliver some of the most incredible large language model based products at NVIDIA

      • Perform difficult or complex analysis, design and programming involving multi-project leadership and broad responsibility in support of new and existing Data Engineering Projects and production support activities

      • Collaborate with data strategy partners to caters to LLM data analytics requirements

      • Lead and perform the design, development, implementation and maintenance of complex Data Store/ Data Lake/Lake house and Data warehousing systems and data-intensive solutions that are scalable, optimized, and fault-tolerant

      • Apply data modeling skills leveraging solid understanding and experience in Cloud technologies and applications

      • Integrate new sources smoothly; know the pain points in Data integration across SaaS applications and implement the best solution that fits the organization

      • Constantly monitor operations, tune for better performance and utilization

      • Promote Culture of Data Safety: Demonstrates commitment to personal responsibility and value for data safety; communicates data safety concerns; uses and promotes safe data handling behaviors

      What we need to see:

      • You have a Bachelors or Masters in Computer Architecture, Computer Science, Electrical Engineering or equivalent experience.

      • 5+ years of Work Experience in developing production systems.

      • Demonstrated the ability to develop data-first, production machine learning pipelines.

      • Mastery and hands-on experience with Data Engineering technologies and scripting languages

      • Thorough understanding and experience in Data Lake, Lake House and Data Warehousing Architecture

      • Recommend, architect and implement Data Lake/Lake house/ Data Warehouse solution with a set of available cloud tools and programming

      • Hands-on experience and expertise in Advanced SQL, Advanced Python programming, AWS Services (such as S3, Redshift, Glue ETL, IAM, DMS, Appflow, VPC and others), SnowFlake, KAFKA, Airflow, Oracle Cloud and other open source tools

      • Experience in writing reusable complex Python/PySpark scripts for ELT, Business Logic OR APIs

      • Mastery of relational, NoSQL or NewSQL database systems

      • Expertise in working with unstructured, structured, and semi-structured data

      • Experience in designing and implementing tight data security at various levels

      • Experience with DataOps and related set of practices, processes and technologies

      With highly competitive salaries and a comprehensive benefits package, Nvidia is widely considered to be one of the technology industry's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working with us and our engineering teams are growing fast in some of the hottest state of the art fields: Deep Learning, Artificial Intelligence, and Large Language Models. If you're a creative engineer with a real passion for robust and enjoyable user experiences, we want to hear from you.

      NVIDIA is committed to encouraging a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

  • About the company

      9637389 Nvidia Corporation is an American multinational technology company incorporated in Delaware and based in Santa Clara, California.

Notice

Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.

Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.

An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.