What's your preference?
Job Description
- Req#: 25-250063
- Design, build, and maintain data ingestion pipelines using Databricks, Spark, and related tools.
- Implement and optimize Delta Tables for scalable, performant, and reliable data storage.
- Normalize and transform legacy data sources (Excel, SharePoint, on-prem files) into structured formats for analytics.
- Develop curated and reusable data views to support reporting, analytics, and downstream applications.
- Collaborate with business stakeholders to translate requirements into technical data models and pipelines.
- Optimize pipeline performance, monitoring, and cost efficiency in cloud environments.
- 8-10 years of experience in Data Engineering (or equivalent).
- Strong expertise in Databricks, PySpark, and SQL.
- Experience with data ingestion and transformation from unstructured/semi-structured sources (Excel, SharePoint, CSV, APIs).
- Knowledge of data modeling, curation, and normalization techniques.
- Hands-on with cloud data platforms
- Strong problem-solving and collaboration skills; able to work in agile environments.
- Having strong experience in DBT.
Title: Data Engineer
Location: USA (Remote)
Duration: 6 month+ can be extendable
Domain/Industry: Preferably Insurance
Year of Experience: 5-10 Years
Type: Fulltime/Contract
We are looking for a Senior Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along with a problem-solving mindset
Key Responsibilities
Required Skills & ExperienceAbout the company
Thoughtfully providing global companies with superior staffing solutions from our network of experienced professionals.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.