Get the job you really want.

Top Lead Data Engineer Jobs in San Francisco, CA

Reposted 7 Days Ago
Hybrid
San Francisco Bay Area, CA
166K-265K Annually
Senior level
166K-265K Annually
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Lead Data Engineer will design, develop, and improve software for personalized offers, manage projects, and mentor junior team members.
Top Skills: ClouderaHiveImpalaJavaKafkaLinuxNifiOoziePostgresScalaShell ScriptingSparkSqoopUnix
2 Days Ago
In-Office
San Francisco Bay Area, CA
158K-276K Annually
Senior level
158K-276K Annually
Senior level
Cloud • Software
The Data Engineer will build automated data pipelines, manage data warehouse plans, and support data collection and analysis for Marketing teams.
Top Skills: AirflowAWSBashETLPythonSalesforceSQL
Reposted 2 Days Ago
In-Office
San Francisco Bay Area, CA
215K-265K
Senior level
215K-265K
Senior level
Digital Media • Other
The Lead Data Engineer will develop data infrastructure, manage event structures, design storage architecture, and mentor engineers for better data practices.
Top Skills: AirflowAmplitudeBigQueryDagsterMixpanelRedshiftSnowflakeSQL
2 Hours Ago
Remote or Hybrid
San Francisco Bay Area, CA
176K-201K Annually
Mid level
176K-201K Annually
Mid level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead software engineer responsible for prototyping new features in data and cloud security, managing diverse tech projects, and collaborating across teams.
Top Skills: AtlasAWSAws AthenaC++DatabricksDatahubDockerGoGCPJavaKubernetesLangchainLanggraphMcpAzureNoSQLOpenmetadataPythonRdbmsRustSnowflakeSQL
Reposted 10 Days Ago
Hybrid
San Francisco Bay Area, CA
170K-240K
Senior level
170K-240K
Senior level
Artificial Intelligence • Big Data • Machine Learning • Software
Lead the design and development of data pipelines, collaborate with cross-functional teams, and mentor other data engineers while optimizing large-scale data systems.
Top Skills: AirflowApache BeamSparkBigQueryDataflowGCPJavaKotlinPostgresPython
Reposted 2 Days Ago
In-Office or Remote
San Francisco Bay Area, CA
213K-258K
Senior level
213K-258K
Senior level
Software • Telehealth
The Lead Data Engineer will design, implement, and manage data architecture, provide technical leadership, and optimize data systems aligned with business goals.
Top Skills: Azure Data FactoryAzure Data LakeAzure Synapse AnalyticsMicrosoft FabricPythonSparkSQL
Reposted Yesterday
In-Office or Remote
San Francisco Bay Area, CA
169K-271K Annually
Expert/Leader
169K-271K Annually
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the data engineering team at Atlassian, architect solutions, build scalable data pipelines, and maintain data quality for impactful business decisions.
Top Skills: AirflowAWSDatabricksFlinkHiveKafkaRedshiftSparkSQL
6 Days Ago
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence
Lead the design and implementation of a modern data architecture, manage ETL pipelines, ensure data quality, and collaborate with cross-functional teams.
Top Skills: AirflowAWSClickhouseDagsterFlinkKafkaPostgresPythonSpark StreamingSQLStartree
Reposted 10 Days Ago
Remote
San Francisco Bay Area, CA
150K-200K Annually
Senior level
150K-200K Annually
Senior level
Financial Services
Lead the design and development of scalable data solutions and architectures, collaborating with cross-functional teams and mentoring junior members.
Top Skills: AirflowAnsibleAWSC#C/C++JavaJavaScriptKafkaMongoDBNumpyPandasPostgresPythonRedisRedshiftRubyScipySnowflakeSQL ServerTypescript
20 Days Ago
In-Office
San Francisco Bay Area, CA
195K-282K
Senior level
195K-282K
Senior level
Fintech • Information Technology • Payments
Lead the development of enterprise-level data pipelines, oversee the data lifecycle, ensure data security, and mentor junior engineers.
Top Skills: Agentic AiApache AirflowSparkAWSAzureDatabricksDockerGenaiGrafanaHadoopHdfsHiveJ2EeJavaJenkinsKafkaKubernetesLlmsMavenMcpMicroservicesNlpNosql Databases (Hbase)PrestoPrometheusPythonRest ApisS3ScalaTrinoVector Dbs
Reposted 2 Days Ago
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
164K-226K Annually
Senior level
164K-226K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Senior Data Platform Engineer, you will develop tools for data quality checks, enhance data lineage framework, and improve data infrastructure performance.
Top Skills: AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
Reposted 7 Days Ago
In-Office or Remote
San Francisco Bay Area, CA
136K-218K Annually
Senior level
136K-218K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will build data solutions, design data models, and improve data quality while collaborating with various teams.
Top Skills: AirflowAws AthenaAws EmrAws RedshiftHiveJavaKafkaPythonSpark
New

Track Smarter, Apply Better.

Ditch the spreadsheets. Organize your job search with our freeApplication Tracker.

Use For Free
Application Tracker Preview
Reposted 7 Days Ago
Remote or Hybrid
San Francisco Bay Area, CA
240K-274K Annually
Senior level
240K-274K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
As a Distinguished Data Engineer at Capital One, you'll drive adoption of technology, collaborate on data challenges, mentor talent, and influence stakeholders.
Top Skills: AirflowAws GlueDatabricksGoJavaKafkaKinesisPythonSnowflakeSparkSQL
3 Days Ago
In-Office
San Francisco Bay Area, CA
158K-276K Annually
Senior level
158K-276K Annually
Senior level
Cloud • Software
Lead the development of scalable data pipelines and distributed systems, automate financial operations, and collaborate with cross-functional teams.
Top Skills: AirflowAWSDbtGCPPythonSparkSQLTableauTrino
23 Days Ago
Remote
San Francisco Bay Area, CA
160K-240K Annually
Senior level
160K-240K Annually
Senior level
Web3
Design and implement data systems, optimize data warehousing, ensure data governance, and integrate on-chain and off-chain data as a Lead Data Engineer at Mysten Labs.
Top Skills: PythonRustSQL
Reposted 23 Days Ago
Remote
San Francisco Bay Area, CA
150K-180K
Senior level
150K-180K
Senior level
eCommerce • Retail
The Lead Data Engineer will oversee data pipeline design, lead a team, and collaborate with various departments to optimize data systems and support analytics and machine learning.
Top Skills: Apache AirflowSparkAzure Data FactoryAzure DevopsAzure SynapseBigQueryDatabricksDelta LakeGitGithub ActionsJenkinsMicrosoft FabricMlflowPower BIPrefectPythonSnowflakeSQLWeights & Biases
3 Days Ago
Remote
San Francisco Bay Area, CA
131K-164K Annually
Senior level
131K-164K Annually
Senior level
Automotive • Digital Media • eCommerce • Information Technology • Marketing Tech
As a Lead Sr. Data Engineer, you will build scalable data pipelines, work on Big Data applications, and mentor team members while ensuring high performance and reliability.
Top Skills: AWSJenkinsKafkaPythonRest ApisScalaSparkTensorFlow
Reposted 3 Days Ago
Remote
San Francisco Bay Area, CA
156K-209K
Senior level
156K-209K
Senior level
Artificial Intelligence • Cybersecurity
Design, build, and maintain scalable data infrastructure in the cloud using AWS services and Infrastructure as Code to ensure data reliability and performance.
Top Skills: AWSCi/CdDmsDockerGitKubernetesPythonRedshiftS3Terraform
Reposted 5 Days Ago
Remote
San Francisco Bay Area, CA
140K-200K Annually
Senior level
140K-200K Annually
Senior level
Information Technology • Security • Cybersecurity
Develop and enhance high-volume data pipelines with ML capabilities, while collaborating with engineering teams to integrate data science into products and applications.
Top Skills: AWSDockerElasticKubernetesMachine LearningNatural Language ProcessingPostgresPythonSQL
Reposted 7 Days Ago
Remote or Hybrid
San Francisco Bay Area, CA
175K-234K Annually
Senior level
175K-234K Annually
Senior level
Artificial Intelligence • Automotive • Machine Learning • Transportation
Lead and mentor a team of engineers to build and maintain scalable data processing pipelines for autonomous vehicle data. Manage project timelines and ensure quality code delivery. Collaborate with stakeholders on design and usage objectives.
Top Skills: Aws (EksEtl)LambdaPython
Reposted 20 Hours Ago
In-Office
San Francisco Bay Area, CA
140K-200K Annually
Mid level
140K-200K Annually
Mid level
Artificial Intelligence • Information Technology • Machine Learning
As a Forward Deployed Engineer, you will design scalable data pipelines, optimize code for data processing, and collaborate with AI teams to meet their data needs.
Top Skills: Python
Reposted 25 Days Ago
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
142K-197K Annually
Mid level
142K-197K Annually
Mid level
Artificial Intelligence • Fintech • Machine Learning • Social Impact • Software
As a Data Platform Engineer, you'll build and maintain tools for data curation, enhance ETL frameworks, manage data catalogs, and collaborate across teams to improve data solutions.
Top Skills: AirflowAWSDatabricksDbtDockerKafkaKubernetesPostgresPythonSparkSQL
Reposted 5 Days Ago
In-Office
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence • Marketing Tech • Software • Big Data Analytics
As a Senior Data Engineer, you will build scalable ETL pipelines, optimize data storage, collaborate on ML integrations, and ensure data integrity and quality.
Top Skills: SparkAWSAzureCloudFormationDockerFlinkGCPHadoopKafkaKubernetesPythonSQLTerraform
Reposted 24 Days Ago
In-Office
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence • Machine Learning • Generative AI
Lead the development of core data infrastructure, manage data teams, and collaborate across departments to support business operations.
Top Skills: SparkKafkaPythonS3SQL
Reposted 5 Days Ago
Remote
San Francisco Bay Area, CA
Mid level
Mid level
Artificial Intelligence • Big Data • Big Data Analytics
Design and implement scalable data orchestration and processes, optimize data operations, and support building various platform areas.
Top Skills: AWSDatabricksJavaPythonSnowflake

Top San Francisco Companies Hiring Lead Data Engineers

See All
Atlassian Thumbnail
Software • Security • Productivity • Information Technology • Cloud • Automation • App development
Fully Remote
11000 Employees
Capital One Thumbnail
Software • Payments • Machine Learning • Fintech • Financial Services
14 Offices
55000 Employees
Salesforce Thumbnail
Software • Cloud
23 Offices
72000 Employees
Labelbox Thumbnail
Machine Learning • Information Technology • Artificial Intelligence
San Francisco, CA
115 Employees
Genies Thumbnail
Other • Digital Media
Los Angeles, CA
132 Employees
DoseSpot Thumbnail
Telehealth • Software
Dedham, MA
95 Employees

Popular Job Searches

All Filters

Total selected (1)

Job Category

Skills
New Jobs
Job Category
Search Area
Experience
Industry
Show more
Show less
Company Name
Company Size

Sign up now Access later

Create Free Account