Hadoop developer JD:
Ability to build data models, data lineage, metadata , APIs using Hadoop technologies.
Programming experience in Python (JAVA or Scala is nice to have)
Hands on experience in Python3 for building services and REST APIs on the backend for web applications.
Familiarity with UI development would be preferred (ReactJs)
Experience in building micro-services architecture and Event driven Architecture.
Sound working knowledge on Unix/Linux Platform
Experience with GCP and/or AWS is preferable and advantageous
Knowledge of working with data is advantageous
Hands-on experience building data pipelines using Hadoop components Hive, and Spark SQL.
Familiarity with Databases (NoSQL, SQL) and designing schemas
Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Terraform & Jenkins) and requirements management in JIRA
Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects.
Hands on shell, ELK, Kubernetes, containers