Company:
Big Island Motors
Location: Santa Clara
Closing Date: 29/10/2024
Salary: £150 - £200 Per Annum
Hours: Full Time
Type: Permanent
Job Requirements / Description
Databricks Architect:
- 10-12 years of experience in building solutions using Databricks on Azure or on Big Data, SQL Data, and other sources.
- In-depth understanding of Databricks Architecture including Lakehouse, Performance tuning, Compute and Storage.
- 1-2 Migration project level experience from Hadoop ecosystem to Azure Databricks & related DBs along with data integration job migration.
- Good knowledge and proven practical experience in migrating relational databases from on-prem to cloud or to build cloud-based data lake using either Big Data / Azure Synapse / Databricks / Snowflake.
- Experience in building data platforms using Azure services like Azure Data Factory, ADLS Gen2, Databricks, Azure IaaS/PaaS database and Azure Synapse data warehouse/analytical systems.
- Worked on both development and maintenance projects and followed operational processes.
- Hands-on experience on selecting and integrating any data-related tools and frameworks required to provide requested capabilities.
- Responsible for end-to-end data platform design and architecture for Databricks on Azure.
- Extensive experience writing and tuning SQL queries.
- In-depth knowledge in data virtualization using DataIQ.
- 3+ years programming in one or more languages (PySpark, Python, Java, Scala).
- Excellent written and verbal communication skills.
- Experience with Agile process methodology and CI/CD.
- Hands-on experience in ETL/ELT tools like FiveTran, Talend, and Informatica Power Centre.
- Certification on cloud or Databricks (related to Data) would be preferred.
- Knowledge of Hadoop ecosystem will be an added advantage.
Share this job
Big Island Motors