Role : Hadoop Developer/Architech
Location : St. Louis,MO
Duration : 4 Months
Rate : $75/hr On C2C (Max)
Requirted Skills :
5+ YEARS HANDS ON HADOOP DEVELOPMENT. EXCELLENT COMMUNICATION SKILLS REQUIRED.
Job Description :
Reference Implementation using Spring Batch Framework for following activities:
- Read file based upon a specific format
- Generate file based upon a specific format, type
- Parallel processing of incoming and outgoing files
- Job Scheduling
- Spring Batch clustering and availability (if master goes down, job picked up by slave… this feature is supported by Spring Batch)
- Admin Dashboard that comes with Spring Batch
Reference Implementation using Hadoop infrastructure for following activities:
- Map/Reduce jobs for processing files
- Exporting data from HDFS(NoSQL) that came as files
- Reading data from data sources like RDBMS(Postgres) and then aggregation of that based upon a certain criteria and then pushing data into another source
- Admin Dashboard implementation to view current jobs, configure map/reduce, etc.
Reference Implementation of Messaging using Apache Kafka for following activities:
· Publisher implementation to publish messages to a particular Topic (Kafka Topic)
· Subscriber/Multiple Subscribers implementation to read messages configured for a particular topic
· Guidance on key components like zookeeper and how it internally works and best practices on this
· Troubleshooting techniques to help with Operations
· Message Level Security (Encryption Decryption implementation will be provided by MasterCard)
Reference Implementation of Messaging using Apache Camel for following activities:
- Reading Writing ISO8583 Messages from IBM WebSphere MQ using Container less Apache Camel Framework
- Parsing the messages and then integrating with internal API (REST API implementation will be provided by Customer)
- Reference implementation for writing unit test and BDD (Behavior Driven) for AngularJS code using Jasmin/Karma/Selenium frameworks
- Code developed by CSA will have unit tests written using JUnit, able to execute success and failure cases.
- Knowledge transfer will occur as code is being developed and reviewed as part of the code review process.