Big Data Engineer

Job Responsibilities:

1. Work with tech and product teams to develop new tools and systems to support the growth of the business.
2. Create and optimize our data pipeline architecture.
3. Build data access platform for our data science and tech teams.
4. Design and implement modernized ETL through cloud-based solutions.
5. Design and develop large-scale data structures for business intelligence analytics by using data mining tools.
6. Write reliable software to ingest, transform and distribute data into our internal applications.
7. Support infrastructure and database processes.
8. Add and improve logging and monitoring to current solutions.
9. Provide ad-hoc queries and analysis as needed.

Job Skills:

1. Similar and 5+ years of professional experience, or MS and 3+ years.
2. Strong experience with databases, SQL, writing and debugging.
3. Professional experience with Python development.
4. Working knowledge of bash scripting and/or JavaScript.
5. Experience working with MongoDB, Redis, and PostgreSQL.
6. Experience with cloud-based data solutions (AWS preferred).
7. Experience with automation/configuration management/enterprise schedulers.
8. System monitoring and alerting, dashboarding experience.
9. Working understanding of code and script (Java, Python, JavaScript, bash).