P-180
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
The Database Platform is responsible for provisioning and managing the thousands of databases that underpin the majority of Databricks services. The team combines an open source distributed SQL engine with proprietary, AI backed services to ensure high availability, scalability, and performance of all databases across the three major cloud platforms. This is a mission-critical service which is held to the highest standards regarding operational rigor and performance.
We're looking for a dedicated Engineering Leader to lead our data plane teams. This role requires driving innovation in a mission-critical environment, while also nurturing and ensuring the operational excellence of multiple teams.
You will report directly to the Director of Engineering.
The main responsibilities include:
- You will lead multiple database storage engine and infrastructure teams.
- You will build a data plane that can scale to thousands of databases across multiple clouds.
- You will oversee sustained recruitment of top-tier talent, promoting a synergistic team structure, and collaborate with internal and external stakeholders.
The impact you will have:
- You will lead the development of mission-critical services and infrastructure.
- You will improve Databricks reliability, performance, and efficiency.
- You will grow a world-class team of software engineers working on query optimization.
- You will evolve organizational structure to align with long-term projects, build "5 ingredient" teams with good communication architecture.
- You will manage technical debt, including long-term technical architecture decisions, and balance product roadmap.
What we look for:
- 5+ years experience working in a related system with an emphasis on storage technologies and database internals.
- Experience with database systems, storage systems, distributed systems, language design, query optimization, and performance.
- Can ensure the team builds high quality and reliable infrastructure services; experience being responsible for testing, quality, and service level agreements of a product; previous experience leading teams in a complex technical domain, such as on distributed data systems or database internals.
- Comfortable managing multiple teams in multiple locations.
- BS in Computer Science (Masters or higher level of education preferred).