What's your preference?
Job Description
- Req#: 7110116
- Architect, design and develop data pipeline for scale and maintainability
- Lead in the design, implementation, and deployment of successful systems and services
- Ensure the quality of architecture and design of systems
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Big Data technologies.
- Perform design and code reviews
- Functionally decompose complex problems into simple, straight-forward solutions
- Cross-training peers and mentoring teammates
- Document HLD/LLD for easy knowledge sharing and future scaling
- Create data tools for analytics, data scientist team members that assist them in building and optimizing our product
- Create data apis for application team members that assist them in building and optimizing our product
- 4+ years of experience in one high performance programming language - Java and/or Python preferred
- 3 Normal & Dimensional modeling experience
- ETL/ELT pipelines loading into data warehouses / data lakes
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience designing and developing microservices
- Good Linux/UNIX systems knowledge
- Experience productionizing Machine Learning models
- Experience with feature engineering, feature stores, and feature pipeline development
- Experience helping data science teams with ML training data preparation and validation
- Knowledge of ML data versioning tools (like DVC, MLflow, etc.)
- Familiarity with data quality and validation frameworks for ML pipelines
- Experience with AWS/Azure cloud technologies and their ML-specific services
- 5 global recharge days, in addition to standard holidays, and a hybrid, flexible approach to work.
- Parental leave for all parents, an annual wellness stipend and volunteer days also provide you with time and resources for self care and to care for others.
- Opportunities throughout the year to learn and celebrate diversity.
- Access to leading AI tools and foundation models, with the freedom to experiment and find creative ways to be more effective in your role
We are looking for a Senior Data Engineer to join our Platform Data Engineering team. The hire will be responsible for building platform level data engineering frameworks and tools. In addition, designing and implementing the data pipelines that feed data into the data warehouse platform across clouds (AWS + Azure).
In this role, you will be able to work independently with minimal guidance. The ideal candidate is an experienced data pipeline builder who enjoys optimizing data systems and building them from the ground up and who is also passionate about developing scalable systems. There will also be opportunities to build data oriented solutions like MDM, data catalogs and architecting for resiliency / scalability in the data pipelines
Responsibilities
About FourKites
FourKites®, the leader in AI-driven supply chain transformation for global enterprises and pioneer of advanced real-time visibility, turns supply chain data into automated action. FourKites’ Intelligent Control Tower™ breaks down enterprise silos by creating a real-time digital twin of orders, shipments, inventory and assets. This comprehensive view, combined with AI-powered digital workers, enables companies to prevent disruptions, automate routine tasks, and optimize performance across their supply chain. FourKites processes over 3.2 million supply chain events daily — from purchase orders to final delivery — helping 1,600+ global brands prevent disruptions, make faster decisions and move from reactive tracking to proactive supply chain orchestration.
Working with us
We provide competitive compensation with stock options, outstanding benefits and a collaborative culture for all employees around the globe, including:About the company
#1 in global supply chain visibility solutions! FourKites' real-time visibility platform is trusted by the world’s most recognized brands.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.