Role : Big Data Developer III

location : Basking Ridge,NJ

Duration : 12 Months

Rate : $50/hr on C2C (Max)

Job Description :

Job Description-

Big Data developer

What are the top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis)

Design and develop ETL data flows using Hive / Pig.

Loading from disparate data sets.
Pre-processing using Hive and Pig.
Translate complex functional and technical requirements into detailed design.
Perform analysis of data sets and uncover insights.
Maintain security and data privacy.
Implement data flow scripts using Unix / hive / pig scripting.
Propose best practices/standards.
Work with the System Analystand development manager on a day-to-day basis
Work with other team members to accomplish key development tasks
Work with service delivery (support) team on transition and stabilization

What software tools/skills are needed to perform these daily responsibilities?

We are looking for a Mid Level Big Data Devloper who will lead and work on the collecting, storing, processing, and analyzing of huge sets of data.
The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. Y
ou will also be responsible for integrating them with the architecture used across the company.
Individual should have expertise and at least 5 years of hands-on experience in Java Enterprise ecosystem (Design, Development, Test, Deploy on Production) is required .
At least 4 years of hands-on experience with Hadoop/Hive/MapReduce/Pig/Sqoop/Flume (Design, Development, Test, Deploy on Production Hadoop cluster) , demonstrated ability to segment nd organize data from disparate sources and knowledge of data security and encryption models is desirable.
Experience working with Hadoop/HBase/Hive/MRV1/MRV2 ETL processing with HIVE/Pig scripts is required.
Demonstrate experience in implementing Unix scripting is required.
Any experience is health care insurance industry is a plus.

Must have:

PIG/Hive/Hadoop MR / Unix scripting

Nice to have?

Experience with HBase, Talend , NoSQL databases-Experience Apache Spark or other streaming big data processing preferred.
Previous experience with Insurance industry.

What are the work hours? (ex. 9am-5pm, day/night shifts, rotating shifts, etc)

8 hours a day from 9am - 5 pm. 5 days a week.

Required Skills- Hadoop, pig and hive

Equal Opportunity Employer

Cloud Big Data Technologies is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Big Data Technologies will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Big Data Technologies require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract

Apply Now