.png)
At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.
The Lakeflow Platform team is at the heart of this mission, powering ETL workloads on the Databricks Lakehouse. We operate one of the world's largest data engineering platforms, processing exabytes of data and running millions of daily workloads for tens of thousands of customers. Our work ensures that data engineers across the globe have the tools they need for high-performance, reliable, and scalable data processing.
We are looking for a visionary Engineering Leader to drive the Lakeflow Platform team forward. This role involves building the next generation of Apache Spark ETL features, pushing the boundaries of performance, reliability, and usability. You'll be instrumental in shaping the technical strategy and fostering a culture of excellence within the team.
Key Responsibilities:
- Lead and inspire an engineering team to develop cutting-edge ETL features for the Databricks Lakeflow product.
- Oversee the recruitment of top-tier talent and invest in the professional growth of current team members.
- Implement processes that translate product vision into actionable strategies aligned with organizational goals.
- Build software that is not only high-quality but also easy to operate and maintain.
- Manage technical debt and make long-term architectural decisions that balance innovation with product roadmaps.
What We’re Looking For:
- 3+ years of experience managing high-performing engineering teams.
- 3+ years of experience building data infrastructure or large-scale distributed systems.
- A passion for database systems, distributed systems, storage architecture, or performance optimization.
- Strong collaboration skills, with experience working alongside product managers and directly engaging with customers to understand their needs.
- A track record of building high-quality, reliable infrastructure services, with responsibility for testing, quality assurance, and meeting SLA requirements.
- Proven expertise in hiring, mentoring, and growing engineers to meet and exceed high performance standards.
Pay Range Transparency
Databricks is committed to fair and equitable compensation practices. The pay range(s) for this role is listed below and represents base salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. Based on the factors above, Databricks utilizes the full width of the range. The total compensation package for this position may also include eligibility for annual performance bonus, equity, and the benefits listed above. For more information regarding which range your location is in visit our page here.
Local Pay Range
$192,000—$260,000 USD
About Databricks
Databricks is the data and AI company. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.
Benefits
At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. For specific details on the benefits offered in your region, please visit https://www.mybenefitsnow.com/databricks.
Our Commitment to Diversity and Inclusion
At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.
Compliance
If access to export-controlled technology or source code is required for performance of job duties, it is within Employer's discretion whether to apply for a U.S. government license for such positions, and Employer may decline to proceed with an applicant on this basis alone.
Databricks San Francisco, California, USA Office
160 Spear Street, San Francisco, CA, United States, 94105
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
