Role : Big Data Developer III

location : Basking Ridge,NJ

Duration : 12 Months

Rate : $50/hr on C2C (Max)

Job Description :

Job Description-

Big Data developer 

What are the top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis) 

Design and develop ETL data flows using Hive / Pig. 

Loading from disparate data sets. 
Pre-processing using Hive and Pig. 
Translate complex functional and technical requirements into detailed design. 
Perform analysis of data sets and uncover insights. 
Maintain security and data privacy. 
Implement data flow scripts using Unix / hive / pig scripting. 
Propose best practices/standards. 
Work with the System Analystand development manager on a day-to-day basis 
Work with other team members to accomplish key development tasks 
Work with service delivery (support) team on transition and stabilization 

What software tools/skills are needed to perform these daily responsibilities? 

We are looking for a Mid Level Big Data Devloper who will lead and work on the collecting, storing, processing, and analyzing of huge sets of data. 
The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. Y 
ou will also be responsible for integrating them with the architecture used across the company. 
Individual should have expertise and at least 5 years of hands-on experience in Java Enterprise ecosystem (Design, Development, Test, Deploy on Production) is required . 
At least 4 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on Production Hadoop cluster) , demonstrated ability to segment nd organize data from disparate sources and knowledge of data security and encryption models is desirable. 
Experience working with Hadoop/HBase/Hive/MRV1/MRV2 ETL processing with HIVE/Pig scripts is required. 
Demonstrate experience in implementing Unix scripting is required. 
Any experience is health care insurance industry is a plus. 

Must have:

PIG/Hive/Hadoop MR / Unix scripting 

Nice to have? 

Experience with HBase, Talend , NoSQL databases-Experience Apache Spark or other streaming big data processing preferred. 
Previous experience with Insurance industry. 

What are the work hours? (ex. 9am-5pm, day/night shifts, rotating shifts, etc) 

8 hours a day from 9am - 5 pm. 5 days a week.

Required Skills-  Hadoop, pig and hive