NielsenIQ

Software Engineer (Python Web scraping) - T4


PayCompetitive
LocationPune/Maharashtra
Employment typeFull-Time

What's your preference?

Apply with job updates
  • Job Description

      Req#: R25_0009980|IN

      Job Description

      Python Web scraping
      Chennai/Pune

      About the Job

      NIQ Digital Shelf is one of Europe’s fastest-growing companies in the Retail Analytics space. Every day, we collect and process over 60 billion data points from web and mobile sources to power real-time market insights. Our tools help major brands and retailers understand what's happening in their market, how they compare to competitors, and what actions to take.

      We’re now a team of 60+ Scrapers from over 12 nationalities, working together with engineering, data, product, operations, and customer success. As we scale globally, we’re looking for new talent to help push our technology and data collection efforts even further. You’ll join an engineering team that values curiosity, autonomy, and the ability to iterate fast. You’ll also collaborate with people across the business to make sure the right data ends up in the right hands, in the cleanest, smartest way possible.

      What You'll Work On

      • Build and maintain efficient web crawlers to extract structured data from websites (e.g. product listings, prices, reviews).
      • Write robust data pipelines to parse and clean messy web content.
      • Deal with real-world challenges like JavaScript-heavy pages, anti-bot measures, and changing page structures.
      • Work closely with product and operations to adjust scraping strategies when sites change or new data needs emerge.

      Qualifications

      Must Have:

      • 1–3 years of experience working with Python.
      • Comfortable using tools like Scrapy, Python Requests, BeautifulSoup, Playwright/Selenium.
      • You understand how to work with HTTP headers, cookies, session management, and are not afraid of network debugging.
      • You adapt quickly and aren’t scared of messy problems. When something breaks, your instinct is to figure out why and fix it.
      • You enjoy learning, asking questions, and building better tools — not just copying and pasting scripts.

      Nice to Have:

      • Basic exposure to concepts like rotating proxies, user-agent spoofing, or using headless browsers (e.g., with Selenium or Playwright).
      • Some hands-on practice scraping structured websites, while using scrapy of python requests and BeautifulSoup.
      • A basic understanding of HTML structure, XPaths, or CSS selectors.

      Additional Information

      • Enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms.
      • Recharge and revitalize with help of wellness plans made for you and your family.
      • Plan your future with financial wellness tools.
      • Stay relevant and upskill yourself with career development opportunities.

      Our Benefits

      • Flexible working environment
      • Volunteer time off
      • LinkedIn Learning
      • Employee-Assistance-Program (EAP)

      About NIQ

      NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population.

      For more information, visit NIQ.com

      Want to keep up with our latest updates?

      Follow us on: LinkedIn | Instagram | Twitter | Facebook

      Our commitment to Diversity, Equity, and Inclusion

      NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion

  • About the company

      NielsenIQ is the industry leader in global measurement and data analytics, and the most trusted source for retail and consumer intelligence. We deliver the complete truth to retailers, manufacturers, and our partners through our comprehensive data sets and powerful insights. We enable businesses to make critical decisions confidently, accelerating growth and optimizing performance.

Notice

Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.

Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.

An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.