Diverse Lynx
Bigdata Architect
This job is now closed
Job Description
- Req#: 22-177354
- More than 10+ years of technical experience in data migration with design of Big Data systems
- Experience in Data processing in Batch and Real time with design and implementation using Pyspark/Spark Scala.
- Experience in event driven architecture design/solutioning using Kafka.
- Experience in Big Data technologies including SQL and NoSQL (HIVE, Hadoop, Couchbase DB, PostgreSQL) and Snowflake.
- Experience working in large complex transformation or migration programs from initiation to implementation, preferable in travel & transportation hospitality domain
- Experience in Data ingestion from on premise, cloud, structured, semi-structured and unstructured data
- Experience in modeling, design and mapping of data from different systems
- Experience in ODS, Data warehouse, staging, data lake and data mart implementation
- Experience in data architecture on AWS and Azure cloud (S3, SNS, SQS, Lambda, Azure data lake, SQL Data warehouse, DynamoDB)
- 10+ years of Bigdata technologies, handling large amounts of data, hundreds of Terabytes or more
- Experience in legacy technologies Netteza, Oracle, DB2
- Knowledge with data governance and best practices
- Propose and establish framework for necessary contributions from various development and program initiatives
- Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development
- Provide detailed specifications for proposed solutions
- Advanced programming skills with Python, Java, Scala.
- Advanced understanding of software development and collaboration, including experience with tools such as Git.
- Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences.
- Experience is orchestration tools like Airflow, Jenkins
- Experience in Apache Ni-Fi process
- Excellent knowledge in hospitality domain in terms of migration
- Cloud Solution Architect Certification, preferable AWS
- Experience designing, architect Big Data solutions on cloud
- Experience in large scale migration from legacy to cloud implementation
- Experience with Spark streaming/batch, Kafka and Snowflake
Job Description
Job Title: Bigdata Architect
Location: Bethesda, MD/Remote
Duration: Full-time
Job Description:Required Information Details Role Bigdata Architect Required Skill Set Architect with Proven experience in Big Data, Cloud and Relational data store migration Desired Experience Range 10+ years Responsibility /Expectations from the role
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
About the company
We provide Consulting Services for our customer’s project and staffing needs. We also provide Data Management for Clinical Trials.
Notice
Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.
Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at accessibility@talentify.io or 407-000-0000.
Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.
An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report. NYC applicants may request an alternative process or accommodation at aedt@talentify.io or 407-000-0000.