RGBSI

Senior Data Engineer


PayCompetitive
LocationBangalore/Karnataka
Employment typeFull-Time

This job is now closed

  • Job Description

      Req#: 23-01788

      Responsibilities

      • Build data ingestion and processing pipelines to enable data analytics and data science use-cases in areas of digital commerce, service operations, charging, reliability, finance , capex, warranty, customer service and others.

      • Build modular set of data services using Python, SQL, AWS Glue, lambdas, API Gateway, Kafka, data build tool (dbt), Apache Spark on EMR among others

      • Build automated unit and integration testing pipelines using frameworks like PySpark

      • Create and manage CICD pipelines with Gitlab CI and AWS Code Pipeline/CodeDeploy

      • Automate and schedule jobs using Managed Airflow

      • Build the ODS and reporting schemas and load the data into AWS Redshift or Snowflake

      • Design and build data quality management services with Apache Deequ and data observability tools like Splunk, DataDog , CloudWatch , Montecarlo

      • Provide a variety of query services with REST, Athena/Presto, server sent events

      • Configure and setup the enterprise data lineage and meta data management and data catalog support using tools like Collibra/Alation

      • Assist the data scientist within the data engineering team as well as other software engineering teams with data cleansing, wrangling and feature engineering

      • Ensure green builds for deployment and work with program management and senior leads to burn down planned deliverables in a sprint cycle

  • About the company

      At RGBSI, we deliver total workforce management, engineering, quality lifecycle management, and IT solutions that provide strategic partnership for organizations of all sizes. We leverage our expertise to fill workforce gaps and deliver full range busi...

Notice

Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.

Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.

An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.