100 million Dollar Software Company Needs Data Engineer( Python, SQL, JVM Language)

100 Million Dollar Software Company Needs Data Engineer (Python, SQL, JVM Language)

Job Type: Permanent

Salary: $160,000.00

Description:

A 100 million dollar software company in Manhattan is looking for a talented senior data engineer with at least 2+ years of professional experience.

Candidate Requirements:

1. 2 years of experience with Python
2. 2 years of experience with complex SQL queries
3. 2 years of experience with a JVM language
4. 1 year of Spark experience (Spark Streaming is a plus)
5. Knowledge of Big Data Architectures: Hive/Hadoop, Redis, etc.
6. Experience building out ETL pipelines and a strong understanding of complex SQL
7. Familiarity with AWS cloud services: EC2, EMR, RDS, Redshift, Lambda, Kinesis
8. Topical understanding of data science concepts (Machine Learning)

The system processes 20 terabytes of new data daily. Strong engineering skills are required for this role. The ideal candidate will have 2+ years of experience with the above skill set. The compensation is up to $160k base + 10% bonus, with potential flexibility depending on skills.