Job requirements: Duties, results & key contributions
Meeting all the technical project requirements and delivering the projects per client specifications and timelines.
Interaction's liaisons within:
Will be interacting and working with the client team Enterprise Architects and Infrastructure Security teams
Be a technical leader for the team; guide technical and architectural designs for the major team initiatives.
Mentor and manage the team. Build data expertise, and partner with data scientists and product engineers to define and standardize business rules and maintain high-fidelity data,Define and partner with other engineers in the development of new tools to enable our customers to understand and access data more efficiently, Work cross-functionally (eg: product managers, engineers, business teams) to support new product and feature launches
6 to 12 Years
Big-Data expertise: Strong experience on Hadoop, Hive, Apache Spark
Experience on Batch and Stream distributed processing framework
Experience on distributed orchestration framework: Airflow, Oozie or AWS Step function
Work experience on resource allocation and performance tuning and query optimization
Good to have skillset on data governance capability on data lake