Big Data Lead

Databricks Architect:

1. 10-12 years of experience in building solutions using Databricks on Azure or on Big Data, SQL Data, and other sources.
2. In-depth understanding of Databricks Architecture including Lakehouse, Performance tuning, Compute and Storage.
3. 1-2 Migration project level experience from Hadoop ecosystem to Azure Databricks & related DBs along with data integration job migration.
4. Good knowledge and proven practical experience in migrating relational databases from on-prem to cloud or to build cloud-based data lake using either Big Data / Azure Synapse / Databricks / Snowflake.
5. Experience in building data platforms using Azure services like Azure Data Factory, ADLS Gen2, Databricks, Azure IaaS/PaaS database and Azure Synapse data warehouse/analytical systems.
6. Worked on both development and maintenance projects and followed operational processes.
7. Hands-on experience on selecting and integrating any data-related tools and frameworks required to provide requested capabilities.
8. Responsible for end-to-end data platform design and architecture for Databricks on Azure.
9. Extensive experience writing and tuning SQL queries.
10. In-depth knowledge in data virtualization using DataIQ.
11. 3+ years programming in one or more languages (PySpark, Python, Java, Scala).
12. Excellent written and verbal communication skills.
13. Experience with Agile process methodology and CI/CD.
14. Hands-on experience in ETL/ELT tools like FiveTran, Talend, and Informatica Power Centre.
15. Certification on cloud or Databricks (related to Data) would be preferred.
16. Knowledge of Hadoop ecosystem will be an added advantage.