Get the job you really want.

Top Lead Data Engineer Jobs in San Francisco, CA

YesterdaySaved
In-Office
San Francisco Bay Area, CA
167K-276K Annually
Expert/Leader
167K-276K Annually
Expert/Leader
Cloud • Software
The Lead Data Engineer will design and deploy AI/ML systems, automate data pipelines, and collaborate with multiple teams to support Salesforce's marketing goals.
Top Skills: AirflowAWSCi/CdDbtGoogle Big QueryPythonRedshiftSnowflake
Reposted 2 Days AgoSaved
In-Office
San Francisco Bay Area, CA
Mid level
Mid level
Artificial Intelligence • Information Technology • Software
Design and maintain high-scale data infrastructure, build ETL pipelines, integrate data sources, optimize performance, and collaborate with data scientists.
Top Skills: AirflowAWSBigQueryClickhouseDagsterDbtGCPPrefectPythonRedshiftSnowflakeSQL
4 Days AgoSaved
In-Office
San Francisco Bay Area, CA
208K-260K Annually
Senior level
208K-260K Annually
Senior level
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills: DatabricksPysparkPythonSQL
Reposted 13 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
150-200 Annually
Mid level
150-200 Annually
Mid level
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills: Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Reposted 13 Days AgoSaved
Hybrid
San Francisco Bay Area, CA
93K-133K Annually
Senior level
93K-133K Annually
Senior level
Information Technology
The Senior Lead Data Engineer will architect and maintain ELT pipelines, manage data infrastructure, optimize SQL queries, and mentor teammates.
Top Skills: Apache AirflowHadoopPythonSpark SqlSQLUnix
5 Days AgoSaved
Remote
San Francisco Bay Area, CA
180K-200K Annually
Senior level
180K-200K Annually
Senior level
HR Tech • Payments • Software • Financial Services
As Lead Data Engineer, you will design and build Benepass's data infrastructure, partner with teams to deliver data capabilities, and set the vision for data engineering. You'll ensure data governance and manage pipelines in an AWS environment while preparing for future team growth.
Top Skills: AirflowAWSDagsterDbtKafkaKinesisPythonRdsRedshiftS3SQL
Reposted 14 Days AgoSaved
Remote or Hybrid
San Francisco Bay Area, CA
175K-195K Annually
Senior level
175K-195K Annually
Senior level
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lead Data & AI Engineer responsible for architecting and implementing intelligent analytics for a surveillance cloud platform, requiring strong skills in data pipelines, AI model management, and modern cloud technologies.
Top Skills: DockerGCPGoGrpcIcebergK8SPythonSparkTerraformTriton
Reposted 9 Days AgoSaved
Remote
San Francisco Bay Area, CA
170K-190K Annually
Senior level
170K-190K Annually
Senior level
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills: AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Reposted 19 Days AgoSaved
In-Office
San Francisco Bay Area, CA
105K-208K Annually
Mid level
105K-208K Annually
Mid level
Consulting
The Lead Data Engineer is responsible for designing, developing, and maintaining ETL pipelines to manage financial data, ensuring compliance and business intelligence.
Top Skills: AWSAzureETLJavaPythonSnowflake
Reposted YesterdaySaved
In-Office
San Francisco Bay Area, CA
158K-335K Annually
Senior level
158K-335K Annually
Senior level
Cloud • Software
Seeking a Software Engineer with 7+ years in backend development to own and operate large-scale distributed services using technologies such as Java, Python, and Apache projects.
Top Skills: AWSC++GCPHbaseHiveJavaKafkaMapreducePrestoPythonSparkYarn
Reposted 2 Days AgoSaved
In-Office
San Francisco Bay Area, CA
184K-276K Annually
Senior level
184K-276K Annually
Senior level
Cloud • Software
As a Lead Software Engineer, you will modernize the core data ecosystem, manage data pipelines, and oversee system design and architectural solutions.
Top Skills: AirflowAWSDbtDockerEcsGitGithub ActionsGoIamInformaticaJavaJenkinsKubernetesLambdaPythonS3SnowflakeTerraform
Reposted 17 Days AgoSaved
Remote
San Francisco Bay Area, CA
Expert/Leader
Expert/Leader
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills: Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
New

Cut your apply time in half.

Use ourAI Assistantto automatically fill your job applications.

Use For Free
Application Tracker Preview
Reposted 5 Days AgoSaved
In-Office
San Francisco Bay Area, CA
175K-205K Annually
Senior level
175K-205K Annually
Senior level
Fintech • Financial Services
The Lead Data Engineer will onboard customers to the data warehouse, analyze data use cases, and implement improvements using modern cloud-native technologies. Responsibilities include collaborating with various teams, ensuring data quality, and automating processes for efficient analytics and infrastructure designs.
Top Skills: AWSKafkaPrestoSnowflakeSparkTableau
20 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
185K-225K Annually
Senior level
185K-225K Annually
Senior level
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills: AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Reposted 7 Days AgoSaved
Easy Apply
In-Office
San Francisco Bay Area, CA
Easy Apply
200K-265K Annually
Senior level
200K-265K Annually
Senior level
Artificial Intelligence • Software • Generative AI
Lead Glean's engineering team in building and scaling enterprise data management systems, collaborating on product initiatives and delivering robust solutions.
Top Skills: AIBackend ServicesDistributed Systems
Reposted 21 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
130K-190K Annually
Senior level
130K-190K Annually
Senior level
Healthtech
The Lead Data Engineer will own the data platform, ensuring data quality, optimizing infrastructure, mentoring engineers, and collaborating with teams to create scalable data solutions.
Top Skills: AWSAzureDatabricksDbtGCPPalantir FoundryPysparkPythonSnowflake
22 Days AgoSaved
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
147K-160K Annually
Senior level
147K-160K Annually
Senior level
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills: AWSAzureETLGCPHadoopPythonSparkSQL
Reposted 2 Days AgoSaved
San Francisco Bay Area, CA
144K-299K Annually
Senior level
144K-299K Annually
Senior level
AdTech • Digital Media • Information Technology • Other
Lead fullstack applications and data systems for Yahoo Search, overseeing technical direction, coach engineers, ensure code quality, and collaborate on scalable solutions.
Top Skills: AirflowAWSBigQueryDbt-CoreGCPHTTPJavaPythonRest
4 Days AgoSaved
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Fintech • Software
The Lead, Data Engineer leads the data engineering team, designing scalable data solutions, mentoring staff, and ensuring data quality while collaborating with stakeholders to meet business goals.
Top Skills: Data ArchitecturesData EngineeringData GovernanceData PipelinesSnowpro Core Certification
Reposted 15 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
135K-150K Annually
Senior level
135K-150K Annually
Senior level
Software • Energy
Lead the design and development of data integration solutions and APIs, ensuring performance and security. Oversee software lifecycle, mentor juniors, and contribute to code reviews while resolving complex technical issues.
Top Skills: AWSAws LambdaDockerHibernateJavaJavaScriptJmsJunitKubernetesLinuxMavenMockitoMySQLRdbmsRestSoapSpring BatchSpring BootSpring IntegrationTestng
Reposted 11 Days AgoSaved
Remote
San Francisco Bay Area, CA
156K-209K Annually
Senior level
156K-209K Annually
Senior level
Artificial Intelligence • Cybersecurity
Design, build, and maintain scalable data infrastructure in the cloud using AWS services and Infrastructure as Code to ensure data reliability and performance.
Top Skills: AWSCi/CdDmsDockerGitKubernetesPythonRedshiftS3Terraform
22 Days AgoSaved
In-Office
San Francisco Bay Area, CA
200K-240K Annually
Senior level
200K-240K Annually
Senior level
Artificial Intelligence • Software • Analytics • Financial Services
Lead the backend API team, architect large-scale data systems, ensure reliable API performance, mentor engineers, and drive engineering best practices.
Top Skills: AWSClickhouseNode.js
Reposted 13 Days AgoSaved
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Fintech • Software • Financial Services
Lead Data Engineer responsible for architecting, scaling, and optimizing data pipelines to support Tidal's ETF platform, ensuring high-performance data delivery and collaboration with cross-functional teams.
Top Skills: AirflowAWSDbtGitGitKafkaKinesisPrefectPythonRedshiftSnowflakeSQL
Reposted 15 Days AgoSaved
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Marketing Tech • Design
The Lead Data/ML Engineer will design and maintain scalable data pipelines and AI systems, ensuring data reliability and collaboration with product teams.
Top Skills: PythonSnowflakeTemporal
Reposted 3 Days AgoSaved
In-Office or Remote
San Francisco Bay Area, CA
Mid level
Mid level
Software
The Senior Data Engineer will build and deploy data pipelines, develop warehouse architectures, and design analytics solutions for the team.
Top Skills: AirflowAWSBigQueryDbtDockerGitMeltanoMongoDBMySQLOraclePostgresPythonRedshiftSnowflakeSQLSQL ServerSuperset
All Filters
New Jobs
Job Category
Experience
Industry
Company Name
Company Size

Sign up now Access later

Create Free Account