Big Data Engineer

logo

Big Data Engineer

Cloud Analytics Technologies LLC

icon San Jose, CA, US, 95113

icon22 June 2024

Apply Now

Job Description:

  • Participate in design and development of Big Data analytical applications
  • Design, support and continuously enhance the project code base, continuous integration pipeline, etc.
  • Write complex ETL processes and frameworks for analytics and data management
  • Implement large-scale near real-time streaming data processing pipelinesStrong coding experience with Scala, Java, or Python
  • In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, Akka Streams)
  • Understanding of the best practices in data quality and quality engineering
  • Experience with version control systems, Git in particular
  • Desire and ability for quick learning of new tools and technologies
  • Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale