Diverse Lynx
Sr . Data engineer with DataBricks
This job is now closed
Job Description
- Req#: 23-42096
Job DescriptionRole :- Sr . Data engineer with DataBricks
Location : Houston, Texas -USA (Day 1 onsite )
Mandatory Skill's : Python , DataBricks , Azure (ADF, ADO, ADLS,) ,DevOps experience(Terraform, Jenkins, CI/CD)
Job description :
· 7 years or more relevant software development experience with a fairly "Full Stack" profile
· Experience of delivery within a trading environment.
· Experience working in fast- paced project delivery using AGILE methods
· Strong software development skills, knowledge of best practices (SOLID, CI/CD, etc.)
· Python 3
· Creating applications and packages
· Writing reliable unit and end-to-end tests with PyTest
· Data manipulation with Pandas
· Web development with Python
· MS Azure: virtual networks, key vaults and storage, security
· MS DevOps pipelines
· Kubernetes containers
· ReactJS front end development experience
· MS SQL backend development experience
· Experience in developing API's in python using FastAPI
· Hands on in ADF and Azure Databricks
Desirable:
· Knowledge of physical commodities trading markets and organisations (esp. Client/ gas/oil).
· Useful to have Data Engineering experience blended along with core software engineering experience
· Experience of working directly with traders on trader models.
· Python: Bokeh visualization, Tornado web framework, asyncio programming, Azure Python API
· Hashicorp Terraforms (azurerm)
· Kafka Confluent
· Conda package management
· Basic knowledge in numerical calculus, such as multi-dimensional function interpolation, numerical differentiation
· Basic understanding of the WebSockets protocol
· Knowledge of the OAuth2 and web security
· Basic knowledge of modern JavaScript, TypeScript, Node.js
Personal Attributes:
· A determined focus on the user and user experience when problem- solving
· Team player and able to collaborate, proactively communicates and shares understanding and experience within a team
· Clear communicator and able to work in a multicultural/lingual environment
· Uses initiative and owns their deliverables end-to-end
· Brings ideas to the table, is inquisitive and excited by new technology
· Used to working in a flexible, independent manner on a mixture of small unstructured and large structured items
· Provides regular, considered feedback and regularly strives to improve their own ways of working
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
About the company
We provide Consulting Services for our customer’s project and staffing needs. We also provide Data Management for Clinical Trials.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.