Sr. Data Engineer (IICS, AWS, Python)

Ideal Skill Set

• Data Engineering with good Data pipelines development experience
• Good Experience in Informatica IICS
• Very good Python and SQL programming
• Good knowledge of AWS technologies.
• Kafka Data Streaming and API experience

PURPOSE:

The Senior Data Engineer will design, code, test, and analyze software programs and applications. This includes researching, designing, documenting, and modifying software specifications throughout the production lifecycle.

POSITION RESPONSIBILITIES:

• Work with Product team to determine requirements and propose approaches to address users' needs
• Analyze requirements to determine approach/proposed solution
• Design and Build Solutions using relevant programming languages
• Thoroughly test solutions using relevant approaches and tools
• Conduct research into software-related issues and products
• Bring out-of-box thinking and solutions to address challenging issues
• Effectively prioritize and execute tasks in a fast-paced environment

EXPERIENCE AND QUALIFICATIONS:

• Strong verbal and written communication skills
• Demonstrate integrity and maturity, and a constructive approach to challenges
• Demonstrate analytical and problem-solving skills, particularly those that apply to Data Warehouse and Big Data environments
• Open minded, solution oriented and a very good team player
• Hands on experience in developing Data Lake and Data Warehouse and Data Marts
• Proficiency in SQL and Scripting (Unix sell scripts, Python)
• Hands on experience in data pipeline development using modern ETL tools specifically on Informatica PowerCenter, Informatica IICS
• Hands on experience in trouble shooting complex ETL and SQL problems
• Hands on experience in designing and building data pipelines in AWS cloud using S3, Lambda, API Gateway, RDS, Redshift, etc.