LOCATION: New York City CAN THE POSITION BE REMOTE? • No. Work will be done on-site at
CAN THE POSITION BE REMOTE? • No. Work will be done on-site at
Work will be done on-site at the client location.
CONTRACT LENGTH: • 4 Months
START DATE:• On or before 2/13 CLIENT BRIEFING: Caserta Concepts is looking for 3 candidates with industry experience in the financial services / equites space to join their project team. Below is the proposed CONCEPTUAL solution architecture for the project: Ingestion - Pull: ftp retrieval - Push Enable secure push to AWS S3 bucket (if needed) · Bucket Structure Landing, Archive, Test, Config, Reject, Datalake · ETL Processing o Spark (via Databricks) o Job Control, Job Dependencies, Job Tracking o Metadata catalog o Data processing design patterns · Orchestration, Workflow & Automation · Architecture Components o AWS S3, EC2 o Databricks (Spark, Orchestration, Workflow & Job Scheduling) o AWS Redshift (Data presentation) o Query & UI – TBD, potentially QuickSight, Looker, etc.
CLIENT BRIEFING: Looking for 3 candidates with industry experience in the financial services / equites space to join their project team. Below is the proposed CONCEPTUAL solution architecture for the project: Ingestion - Pull: ftp retrieval - Push Enable secure push to AWS S3 bucket (if needed) · Bucket Structure Landing, Archive, Test, Config, Reject, Datalake · ETL Processing o Spark (via Databricks) o Job Control, Job Dependencies, Job Tracking o Metadata catalog o Data processing design patterns · Orchestration, Workflow & Automation · Architecture Components o AWS S3, EC2 o Databricks (Spark, Orchestration, Workflow & Job Scheduling) o AWS Redshift (Data presentation) o Query & UI – TBD, potentially QuickSight, Looker, etc.
Senior Data Engineer
Responsibilities:
• Perform process analysis, source system analysis, and data profiling
• Translate solution requirements to design
• Define solution processes and data transformations and implement utilizing Spark
• Implement technologies and tools in support of development of the M&A Shareholder Analytics platform Qualifications:
• Must have financial services / equities/data exposure
• Must have minimum 8 years’ experience
Equal Opportunity Employer
Cloud Big Data Technologies is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Big Data Technologies will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Big Data Technologies require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract Apply Now
New York, New York