Company:
Tata Consultancy Services
Location: Atlanta
Closing Date: 03/11/2024
Salary: £125 - £150 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
Must Have Technical/Functional Skills
- Azure SQL Database, Cosmos (No SQL)
- Python, Scala
- Strong Hands-on in T-SQL
- Experience with Azure, REST API
- Creating distributed data pipelines for batch and real-time applications
- Apache Spark
- Azure Data Factory
- Azure Databricks
- Jupyter Notebook
- Azure Synapse Analytics
- Azure Data Lake/Analytics
- Design, develop and build real-time data pipelines from a variety of sources (streaming data, APIs, data warehouse, messages, etc.)
- Leverage the understanding of software architecture and software design patterns to write scalable, maintainable, well-designed and future-proof software
- Manage existing pipelines and create new pipelines from a variety of sources (relational, XML, etc.)
- Actively apply best practices within CI/CD
- Propose and implement solutions for data pipeline stabilization and data quality checks
- Coordinate with other teams to design optimal patterns for data ingest and egress, as well as lead and coordinate data quality initiatives and troubleshooting
- Design and build solutions to track data quality, stabilize data pipelines, etc. to ensure reliable operations
- Ensure best practices are followed across architecture, codebase and configuration
- Eliminate waste
- Deliver on time
- Ability to establish clear goals and responsibilities to achieve a high level of performance.
- Ability to evaluate different options proactively and solve problems in an innovative way. Develop new solutions or combine existing methods to create new approaches.
- Comfortable working with external product teams to establish optimal data integration patterns/solutions.
Share this job
Tata Consultancy Services