BIG DATA ENGINEER

Job Title :- Big Data Engineer
Job Location :- Princeton,NJ
Job Duration :- 1 year
Date :August 9th,2018
Full Time, C2H

Job Responsibilities

• Selecting and integrating Big Data tools and frameworks required to provide requested capabilities
• Implementing ETL processes; documenting ETL processes
• Monitoring performance and advising any necessary infrastructure changes
• Defining data retention policies and assist in enforcement
• Formulate techniques for quality data collection to ensure adequacy, accuracy and legitimacy of data
• Devise and implement efficient and secure procedures for data handling and analysis with attention to all technical aspects
• Design and manage the migration of data from legacy systems to new data solutions
• Monitor and analyze information and data systems and evaluate their performance to discover ways of enhancing them (new technologies, upgrades etc.)
• Troubleshoot data-related problems and authorize maintenance or modifications

Required Skills

• Proficient understanding of distributed computing principles
• Management of Hadoop cluster, with all included services
• Ability to solve any ongoing issues with operating the cluster
• Proficiency with Hortonworks HDP ecosystem
• Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with Spark
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
• Knowledge of various ETL techniques and frameworks
• Experience in SyncSort preferred; experience with Flume, SSIS a bonus
• Experience with various messaging systems, such as Kafka.
• Good understanding of Lambda Architecture, along with its advantages and drawbacks
• Experience with Hortonworks HDF (NiFi) a bonus


Want to apply later?

Type your email address below to receive a reminder

ErrorRequired field

Apply to Job

ErrorRequired field
ErrorRequired field
ErrorRequired field
Error
Error
insert_drive_file
insert_drive_file