Virtusa

Lead Data Engineer

6 days ago

PayCompetitive
LocationColombo/Western
Employment typeFull-Time

What's your preference?

Apply with job updates
  • Job Description

      Req#: CREQ228248

      · Proficiency in Python, especially for data extraction and automation tasks

      · Strong experience with web scraping frameworks such as Scrapy, BeautifulSoup, or Selenium

      · Hands-on experience building automated data pipelines using tools like Airflow, Luigi, or custom schedulers.

      · Knowledge of web data collection techniques, including handling pagination, AJAX, JavaScript-rendered content, and rate-limiting

      · Familiarity with RESTful APIs and techniques for API-based data ingestion

      · Experience with data storage solutions, such as PostgreSQL, MongoDB, or cloud-based storage (e.g., AWS S3, Google Cloud Storage)

      · Version control proficiency, especially with Git

      · Ability to write clean, modular, and well-documented code

      · Strong debugging and problem-solving skills in data acquisition workflows

      · Nice-to-Haves
      Experience with cloud platforms (AWS, GCP, or Azure) for deploying and managing data pipelines
      Familiarity with containerization tools like Docker
      Knowledge of data quality monitoring and validation techniques
      Exposure to data transformation tools (e.g., dbt)
      Understanding of ethical and legal considerations in web scraping
      Experience working with CI/CD pipelines for data workflows
      Familiarity with data visualization tools (e.g., Tableau, Power BI, or Plotly) for quick insights
      Background in data science or analytics to support downstream use cases

  • About the company

      Virtusa Corporation is an American information technology services company founded in 1996 in Sri Lanka and has its headquarters in Southborough, Massachusetts, United States.

Notice

Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.

Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.

An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.