Get the job you really want.
Be the first applicant
Apply to jobs posted less than 24 hours ago to maximize your visibility.
Use the Date Posted filter to view jobs posted within the last 24 hours.

Top Lead Data Engineer Jobs in San Francisco, CA

13 Days Ago
Remote
Hybrid
San Francisco Bay Area, CA
151K-323K Annually
Senior level
151K-323K Annually
Senior level
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
The Lead Data Engineer will manage data pipelines, mentor teams, improve tooling, and lead cloud-based infrastructure solutions using AWS and various data technologies.
Top Skills: AirflowAWSCodefreshDatabricksDockerEmrGitGlueJIRAKafkaKubernetesLambdaPysparkPythonRedshiftS3SQLTerraform
21 Days Ago
Remote
Hybrid
San Francisco Bay Area, CA
176K-201K Annually
Senior level
176K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the development of data management tools by collaborating across Agile teams, utilizing cloud technologies, and mentoring engineers to support large-scale applications in a remote environment.
Top Skills: AWSCassandraEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMongodbMySQLPythonRedshiftScalaSnowflakeSparkSQLUnix
17 Days Ago
San Francisco Bay Area, CA
166K-265K Annually
Senior level
166K-265K Annually
Senior level
Payments
The Lead Data Engineer designs, develops, and maintains software solutions while mentoring junior team members and participating in agile practices.
Top Skills: ClouderaHiveImpalaJavaKafkaLinuxNifiOoziePostgresScalaSparkSqoopUnix
19 Days Ago
San Francisco Bay Area, CA
Senior level
Senior level
Fintech • Information Technology • Payments
Lead a data engineering team to build scalable systems for data processing and analysis, mentoring engineers and ensuring project delivery on time.
Top Skills: Big DataGraph DatabasesHadoop StackJavaKafkaPythonRestful ApisScala
13 Days Ago
San Francisco Bay Area, CA
168K-221K Annually
Senior level
168K-221K Annually
Senior level
Healthtech
As a Lead Data Engineer, you will design and develop scalable data solutions, mentor engineers, and enhance data performance and reliability while ensuring governance and security in a cross-functional role.
Top Skills: DatabricksKafkaKinesisPysparkScalaSnowflakeSparkSQL
5 Days Ago
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Mobile • Software
Lead the development and management of financial data initiatives, collaborating with leadership and teams to enhance data utilization and reporting.
Top Skills: AWSConfluenceDatabricksGitlabJIRAPower BIPysparkPythonSpark
Reposted 9 Days Ago
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Productivity • Security • Software • Business Intelligence • Cybersecurity
As a Lead Data Engineer, you'll architect and maintain data pipelines, ensuring their reliability and scalability, while collaborating closely with AI and data teams.
Top Skills: AirbyteCi/Cd ToolsFivetranMySQLPythonSnowflakeSQL
49 Minutes Ago
Easy Apply
Hybrid
San Francisco Bay Area, CA
Easy Apply
Senior level
Senior level
Fintech • Mobile • Software • Financial Services
The Staff Data Engineer will lead the Data Engineering group, focusing on building data pipelines, architectures, and analytics while mentoring the team and ensuring data integrity.
Top Skills: AirflowAWSGitlabPostgresPythonSnowflakeSQL

Featured Jobs

Reposted 2 Days Ago
Hybrid
San Francisco Bay Area, CA
167K-209K Annually
Senior level
167K-209K Annually
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Senior Data Engineer at Crunchyroll, you'll design and optimize data services and pipelines, support operational data analysis, and drive automation. Collaborate with teams to enhance systems efficiency and mentor junior engineers.
Top Skills: Apache KafkaAWSAws GlueCloud FormationDatabricksDbtDynamoDBJavaKinesisPythonRdsRedshiftSnowflakeSQLTerraform
Reposted 18 Days Ago
Hybrid
San Francisco Bay Area, CA
150K-240K Annually
Senior level
150K-240K Annually
Senior level
Artificial Intelligence • Big Data • Machine Learning • Software
The Lead Data Engineer will design and build data pipelines using various technologies, working closely with data science and engineering teams to manage large datasets and build applications for data orchestration and monitoring.
Top Skills: AirflowApache BeamSparkBigQueryCassandraDataflowGCPJavaKotlinPostgresPythonScylla
5 Days Ago
Remote
San Francisco Bay Area, CA
136K-218K Annually
Senior level
136K-218K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll design data models, build scalable data pipelines, and improve data quality, collaborating across teams.
Top Skills: AirflowSparkAthenaAws Data ServicesEmrFlinkHiveJavaKafkaPythonRedshiftSparkSQL
21 Days Ago
San Francisco Bay Area, CA
140K-205K Annually
Senior level
140K-205K Annually
Senior level
Information Technology • Legal Tech
The Lead Data Engineer will design, implement, and maintain scalable data pipelines and architecture while ensuring data governance and compliance. Responsibilities include collaborating with stakeholders, optimizing data processing, and supporting AI initiatives.
Top Skills: Auto LoaderDatabricksDelta Live TablesDelta SharingHadoopHivePysparkPythonSnowflakeSparkSQLUnity Catalog
Yesterday
Easy Apply
Remote
Hybrid
San Francisco Bay Area, CA
Easy Apply
Senior level
Senior level
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Data Engineer at Bombora, you'll develop ETL pipelines, cloud-native data systems, and collaborate with teams to implement best practices.
Top Skills: AirflowBigQueryDataflowGCPKubernetesPub/SubPythonSQL
Reposted Yesterday
Easy Apply
Remote
San Francisco Bay Area, CA
Easy Apply
Mid level
Mid level
Artificial Intelligence • Healthtech • Telehealth
As a Data Engineer II, you will maintain and expand a data platform, ensuring its reliability and stability. Your responsibilities include building and operating data infrastructure, maintaining CI/CD pipelines, and collaborating with stakeholders for data requirements. You'll leverage tools like Airflow, dbt, and AWS to optimize data processing and documentation.
Top Skills: AirflowAWSCircleCIDatadogDbtGitPythonSnowflakeSQLTerraform
13 Days Ago
Remote
San Francisco Bay Area, CA
169K-271K Annually
Senior level
169K-271K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian's Data Engineering Team in building scalable data solutions, ensuring operational data quality, architecting data systems, and mentoring engineers.
Top Skills: AirflowAWSDatabricksFlinkHiveKafkaRedshiftSparkSQL
16 Days Ago
Remote
San Francisco Bay Area, CA
Senior level
Senior level
Machine Learning • Software
The Staff/Lead Data Engineer will build and manage data pipelines, ensuring data availability and quality while using technologies such as Apache Airflow and Spark.
Top Skills: Apache AirflowAWSDockerElk StackGCPGrafanaKafkaKubernetesPythonSparkSQL
Reposted 2 Days Ago
Remote
San Francisco Bay Area, CA
97K-140K Annually
Mid level
97K-140K Annually
Mid level
Automotive • Big Data • Insurance • Software • Transportation
Design, build, and maintain data infrastructure. Optimize ETL/ELT pipelines, ensure data quality, and develop data models for analytics.
Top Skills: Apache AirflowAWSBigQueryDbtFastapiFlaskGitPysparkPythonRedshiftSnowflakeSQL
2 Days Ago
Remote
Hybrid
San Francisco Bay Area, CA
Senior level
Senior level
Artificial Intelligence • Healthtech • Information Technology • Natural Language Processing • Software • Analytics • Generative AI
The Staff Data Engineer will design and optimize data infrastructure, support multiple teams, and ensure data quality and integrity across projects.
Top Skills: AirflowAWSDynamoDBEc2ElasticsearchEmrGitKafkaMongoDBPostgresPythonRdsSparkSQLTerraform
Reposted 9 Days Ago
Easy Apply
Remote
Hybrid
San Francisco Bay Area, CA
Easy Apply
Senior level
Senior level
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Senior Data Engineer, you will develop and maintain ETL pipelines, design scalable systems, troubleshoot production issues, and mentor team members while ensuring best practices are followed.
Top Skills: AirflowBigQueryDataflowGoogle Cloud PlatformKubernetesPub/SubPythonSQL
5 Days Ago
Remote
Hybrid
San Francisco Bay Area, CA
72K-141K Annually
Senior level
72K-141K Annually
Senior level
Cloud • Insurance • Professional Services • Analytics • Cybersecurity
The role involves designing, developing, and integrating data applications on Google Cloud Platform, leading data pipelines, enhancing data models, and ensuring quality standards in an Agile environment.
Top Skills: SparkAWSBigQueryCloud ComposerCloud StorageConcourseDataflowDataprepDataprocGitGoogle Cloud PlatformInformatica IicsPub/SubPythonSQL
21 Days Ago
Hybrid
San Francisco Bay Area, CA
206K-216K Annually
Senior level
206K-216K Annually
Senior level
Artificial Intelligence • Cloud • Internet of Things • Machine Learning • Analytics • Industrial
As a Senior Data Engineer, you will write clean code for large scale geospatial data, build high performance data pipelines, and develop APIs for machine learning models.
Top Skills: Apache AirflowDatabricksPython
Reposted 14 Days Ago
Remote
San Francisco Bay Area, CA
Senior level
Senior level
AdTech • Digital Media • Marketing Tech • Professional Services
As a Senior Data Engineer, you will lead data engineering projects, collaborate with teams, mentor engineers, and enhance the data infrastructure with new technologies.
Top Skills: AirflowDatabricksDbtHadoopHiveLookerOlapPrefectPythonSnowflakeSparkSQLTableau
10 Days Ago
San Francisco Bay Area, CA
195K-282K Annually
Expert/Leader
195K-282K Annually
Expert/Leader
Fintech • Information Technology • Payments
Lead the design and architecture of scalable data engineering platforms, oversee the data lifecycle, develop synthetic data solutions, and guide a high-performing team in Machine Learning and Data Engineering.
Top Skills: AWSAzureData EngineeringDatabricksDockerGenaiGrafanaJavaKubernetesMachine LearningPrometheusRestS3ScalaSQL
14 Days Ago
Remote
San Francisco Bay Area, CA
Junior
Junior
Big Data • Fitness • Healthtech • Software • Analytics • Energy
As a Data Engineer at Arcadia, you will design and develop data pipelines, support data integrations, and contribute to team processes while working within a Scrum setup.
Top Skills: Cloud ArchitectureNoSQLSparkSQL
Reposted 14 Days Ago
Easy Apply
Remote
Hybrid
San Francisco Bay Area, CA
Easy Apply
Senior level
Senior level
Artificial Intelligence • Marketing Tech • Software
As a Principal Data Engineer, you'll guide the direction of the Data Warehouse, architect, implement, and optimize ingestion pipelines, and collaborate across teams to ensure data-driven decision-making. You'll also mentor colleagues and ensure compliance with regulatory standards while managing high-volume data systems.

Top San Francisco Companies Hiring Lead Data Engineers

See All
Bombora Thumbnail
Software • Sales • Marketing Tech • Information Technology • Big Data • AdTech
2 Offices
152 Employees
Crunchyroll Thumbnail
News + Entertainment • Mobile • Gaming • eCommerce • Digital Media
11 Offices
1197 Employees
IMO Health Thumbnail
Software • Natural Language Processing • Information Technology • Healthtech • Generative AI • Artificial Intelligence • Analytics
3 Offices
320 Employees
Spring Health Thumbnail
Telehealth • Healthtech • Artificial Intelligence
New York, NY
1300 Employees
Agero Thumbnail
Transportation • Software • Insurance • Big Data • Automotive
Medford, MA
3500 Employees
SoFi Thumbnail
Software • Mobile • Fintech • Financial Services
7 Offices
4500 Employees

Popular Job Searches

All Filters

Total selected (1)

Job Category

Skills
Date Posted
Job Category
Search Area
Experience
Industry
Show more
Show less
Company Name
Company Size

Sign up now Access later

Create Free Account