Job Title: Big Data Engineer
Duration: 13+ months (Hybrid and Contract)
Location: Irving TX (Only local candidates to TX Allowed)
Job Type: W2 and only USC/GC/EAD Required (No Sponsorship or visa transfer allowed)
Job Description:
Grow your career as a Big Data Engineer with an innovative global bank in Irving, TX. Contract role with strong possibility of extension. Will require working a hybrid schedule 2-3 days onsite per week.
Join one of the world's most renowned global banks and trusted brand with over 200 years of continuously evolving financial services worldwide. Will be responsible for the delivery of Data Quality rules. You will work alongside some of the smartest minds in the industry who are excited to share their knowledge and to learn from you.
Contract Duration: 12+ Months
Required Skills & Experience
- 5+ years of working experiences with Starburst/TRINO, Impala, Hive, SparkSQL.
- Good knowledge with Hadoop environment and distribution system.
- Strong data analysis, data evaluation and problem-solving skills.
- Proficiency in SQL and debugging.
- Experiences with writing Python, PySpark.
- Identify and troubleshoot data issues and provide timely resolution.
- Great skills to understand business requirement and convert into tech requirement with action steps.
- Agile experience.
Desired Skills & Experience
- Domain knowledge of data quality/data entitlement.
What You Will Be Doing
- Code & development & enhance SQL Queries.
- Release the SQL to UAT testing and Prod; Job scheduling and running.
- Production support - job monitoring and SQL error debugging.
- Ad hoc python script creation.
- Host meetings and present tech demos.
- Discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions.
- Assist and support analyst team on technical solutions.
- Understand the SQLs syntax/functions across different analytic engine/platform, responsible to convert Starburst/impala SQL to SparkSQL by referring spark documents and provide optimal query.
- Work with team members to ensure efforts within owned tracks of work will meet their needs.
- Communication and documentation.