Big Data Engineer
Cloud Analytics Technologies LLC
San Jose, CA, US,
95113
22 June 2024
Apply Now
Job Description:
- Participate in design and development of Big Data analytical applications
- Design, support and continuously enhance the project code base, continuous integration pipeline, etc.
- Write complex ETL processes and frameworks for analytics and data management
- Implement large-scale near real-time streaming data processing pipelinesStrong coding experience with Scala, Java, or Python
- In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)
- Understanding of the best practices in data quality and quality engineering
- Experience with version control systems, Git in particular
- Desire and ability for quick learning of new tools and technologies
- Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale