Job Title :- BIG DATA ARCHITECT
Job Location :- Edison, NJ.
Job Duration :- 1 Year
Job Description :
- 7+ years of hands-on programming expertise in Scala, Java, SQL, Python
- 3+ years of experience with large datasets in Hadoop (Cloudera) and Spark Ecosystem
- Hands-on experience in Hadoop data storage, data stores DAT, and tools (Oozie, Sqoop, Flume etc)
- Well versed in Cloudera (CDH 5.x) to manage security, metadata, lineage, job management, Optimizer, Record Service etc
- Background with Unix/Linux administration is highly desirable.
- Expertise in kafka (distributed logs) and Spark streaming architecture and development
- Experience in design and development of SQL on Hadoop applications (Spark SQL, Impala) and Query Optimization
- Troubleshoot, tune, and accelerate data pipelines, data queries, and real time streaming events.