Data Engineer

Position: AWS Data Engineer

Location: Bloomfield, CT (Onsite)

Duration: FTE/ Direct Hire

Job Description:

Relevant Experience:

• 7-10 years of hands on Pyspark/Databricks development experience.
• Knowledge in Terraform, S3, API Gateway, Lamba, SNS and SQS.
• Should have wide experience in AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL
• Should have CICD experience using tools like GIT, Jenkins etc
• Should have extensive hands-on experience with SPARK and real time analytic frameworks, data streaming & Structured streaming.
• Knowledge in Databricks reporting.
• They need to be experienced in programming language (Python, Pyspark)
• Hands-on experience integrating open-source components into data-analytic solutions
• Working with vendors to enhance tool capabilities to meet enterprise needs
• Willingness to continuously learn & share learnings with others
• Strong troubleshooting and performance tuning skills.
• Experience building multi-tenant, virtualized infrastructure a strong plus

Technical/Functional Skills:

• AWS services such as Glue, EMR, Lambda, Step Functions, CloudTrail, CloudWatch, SNS, SQS, S3, VPC, EC2, RDS, IAM, Node JS, Glue ETL, Sprak Streaming, Data Streaming