Hadoop Developer/Architech

logo

Hadoop Developer/Architech

Cloud Big Data Technologies

icon St Louis, MO, US, 63103

icon21 July 2024

Apply Now

Role : Hadoop Developer/Architech

Location : St. Louis,MO

Duration : 4 Months

Rate : $75/hr On C2C (Max)

Requirted Skills : 

5+ YEARS HANDS ON  HADOOP DEVELOPMENT. EXCELLENT COMMUNICATION SKILLS REQUIRED.

Job Description : 

Reference Implementation using Spring Batch Framework for following activities:

  • Read file based upon a specific format
  • Generate file based upon a specific format, type
  • Parallel processing of incoming and outgoing files
  • Job Scheduling
  • Spring Batch clustering and availability (if master goes down, job picked up by slave… this feature is supported by Spring Batch)
  • Admin Dashboard that comes with Spring Batch

Reference Implementation using Hadoop infrastructure for following activities:

  • Map/Reduce jobs for processing files
  • Exporting data from HDFS(NoSQL) that came as files
  • Reading data from data sources like RDBMS(Postgres) and then aggregation of that based upon a certain criteria and then pushing data into another source
  • Admin Dashboard implementation to view current jobs, configure map/reduce, etc.

Reference Implementation of Messaging using Apache Kafka for following activities:

· Publisher implementation to publish messages to a particular Topic (Kafka Topic)

· Subscriber/Multiple Subscribers implementation to read messages configured for a particular topic

· Guidance on key components like zookeeper and how it internally works and best practices on this

· Troubleshooting techniques to help with Operations

· Message Level Security (Encryption Decryption implementation will be provided by MasterCard)

Reference Implementation of Messaging using Apache Camel for following activities:

  • Reading Writing ISO8583 Messages from IBM WebSphere MQ using Container less Apache Camel Framework
  • Parsing the messages and then integrating with internal API (REST API implementation will be provided by Customer)
  • Reference implementation for writing unit test and BDD (Behavior Driven) for AngularJS code using Jasmin/Karma/Selenium frameworks
  • Code developed by CSA will have unit tests written using JUnit, able to execute success and failure cases.
  • Knowledge transfer will occur as code is being developed and reviewed as part of the code review process.

Equal Opportunity Employer

Cloud Big Data Technologies is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Big Data Technologies will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Big Data Technologies require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract
Apply Now