Big Data Engineer

05 Jan 2023

Job Responsibilities:

• Work with tech and product teams to develop new tools and systems to support the growth of the business.
• Create and optimize our data pipeline architecture.
• Build data access platform for our data science and tech teams.
• Design and implement modernized ETL through cloud-based solutions.
• Design and develop large-scale data structures for business intelligence analytics by using data mining tools.
• Write reliable software to ingest, transform and distribute data into our internal applications.
• Support infrastructure and database processes.
• Add and improve logging and monitoring to current solutions.
• Provide ad-hoc queries and analysis as needed.

Job Skills:

• 5+ years of professional experience, or MS and 3+ years.
• Strong experience with databases, SQL, writing and debugging.
• Professional experience with Python development.
• Experience working with MongoDB, Redis, and PostgreSQL.
• Experience with cloud-based data solutions (AWS preferred).
• Experience with automation/configuration management/enterprise schedulers.
• System monitoring and alerting, dashboarding experience.