Get the job you really want.
Maximum of 25 job preferences reached.
Top Lead Data Engineer Jobs in San Francisco, CA
Cloud • Software
The Lead Data Engineer will design and deploy AI/ML systems, automate data pipelines, and collaborate with multiple teams to support Salesforce's marketing goals.
Top Skills:
AirflowAWSCi/CdDbtGoogle Big QueryPythonRedshiftSnowflake
Artificial Intelligence • Information Technology • Software
Design and maintain high-scale data infrastructure, build ETL pipelines, integrate data sources, optimize performance, and collaborate with data scientists.
Top Skills:
AirflowAWSBigQueryClickhouseDagsterDbtGCPPrefectPythonRedshiftSnowflakeSQL
Information Technology • Consulting
As a Lead Data Engineer, you will design and maintain data platforms, oversee data ingestion pipelines, enforce standards, collaborate on solutions, and ensure best practices in healthcare data operations.
Top Skills:
DatabricksPysparkPythonSQL
Information Technology
The Lead Data Engineer/Architect designs and implements GCP solutions, focusing on data pipelines, architecture, and leadership in a client-facing role.
Top Skills:
Apache BeamBigQueryCi/CdCloud ComposerCloud FunctionsCloud StorageDataflowGoogle Cloud PlatformPub/SubPythonSQLTerraform
Information Technology
The Senior Lead Data Engineer will architect and maintain ELT pipelines, manage data infrastructure, optimize SQL queries, and mentor teammates.
Top Skills:
Apache AirflowHadoopPythonSpark SqlSQLUnix
HR Tech • Payments • Software • Financial Services
As Lead Data Engineer, you will design and build Benepass's data infrastructure, partner with teams to deliver data capabilities, and set the vision for data engineering. You'll ensure data governance and manage pipelines in an AWS environment while preparing for future team growth.
Top Skills:
AirflowAWSDagsterDbtKafkaKinesisPythonRdsRedshiftS3SQL
Artificial Intelligence • Other • Security • Software • Analytics • Big Data Analytics
Lead Data & AI Engineer responsible for architecting and implementing intelligent analytics for a surveillance cloud platform, requiring strong skills in data pipelines, AI model management, and modern cloud technologies.
Top Skills:
DockerGCPGoGrpcIcebergK8SPythonSparkTerraformTriton
Artificial Intelligence • Healthtech • Machine Learning • Biotech
The Lead Data Engineer will manage the AI Data Platform, scale data pipelines, ensure data quality, and lead technical strategy for data initiatives.
Top Skills:
AirflowAWSAzureCloudFormationDagsterDaskDockerGCPKubernetesPrefectPythonSparkSQLTerraform
Reposted 19 Days AgoSaved
Consulting
The Lead Data Engineer is responsible for designing, developing, and maintaining ETL pipelines to manage financial data, ensuring compliance and business intelligence.
Top Skills:
AWSAzureETLJavaPythonSnowflake
Cloud • Software
Seeking a Software Engineer with 7+ years in backend development to own and operate large-scale distributed services using technologies such as Java, Python, and Apache projects.
Top Skills:
AWSC++GCPHbaseHiveJavaKafkaMapreducePrestoPythonSparkYarn
Cloud • Software
As a Lead Software Engineer, you will modernize the core data ecosystem, manage data pipelines, and oversee system design and architectural solutions.
Top Skills:
AirflowAWSDbtDockerEcsGitGithub ActionsGoIamInformaticaJavaJenkinsKubernetesLambdaPythonS3SnowflakeTerraform
Information Technology • Consulting
As a Lead Data Engineer, you'll optimize data workflows, manage data engineering projects, mentor junior engineers, and ensure robust data solutions meet business needs.
Top Skills:
Apache AirflowSparkAws RedshiftAzure Synapse AnalyticsDatabricksGoogle Bigquery
New
Cut your apply time in half.
Use ourAI Assistantto automatically fill your job applications.
Use For Free
Fintech • Financial Services
The Lead Data Engineer will onboard customers to the data warehouse, analyze data use cases, and implement improvements using modern cloud-native technologies. Responsibilities include collaborating with various teams, ensuring data quality, and automating processes for efficient analytics and infrastructure designs.
Top Skills:
AWSKafkaPrestoSnowflakeSparkTableau
Blockchain • Fintech • Social Media • Cryptocurrency • NFT • Web3
The Lead Data Engineer will design and build scalable data pipelines and infrastructure for trading analytics, overseeing data architecture and collaborating with cross-functional teams.
Top Skills:
AirflowAWSAzureBigQueryDagsterDbtFlinkGCPGraphQLKafkaKinesisPrefectPythonRedshiftSnowflakeSQLTemporal
Artificial Intelligence • Software • Generative AI
Lead Glean's engineering team in building and scaling enterprise data management systems, collaborating on product initiatives and delivering robust solutions.
Top Skills:
AIBackend ServicesDistributed Systems
Healthtech
The Lead Data Engineer will own the data platform, ensuring data quality, optimizing infrastructure, mentoring engineers, and collaborating with teams to create scalable data solutions.
Top Skills:
AWSAzureDatabricksDbtGCPPalantir FoundryPysparkPythonSnowflake
Software
Lead the data strategy at Edmentum by designing scalable data pipelines, optimizing data systems, and mentoring junior engineers while ensuring compliance with data governance policies.
Top Skills:
AWSAzureETLGCPHadoopPythonSparkSQL
AdTech • Digital Media • Information Technology • Other
Lead fullstack applications and data systems for Yahoo Search, overseeing technical direction, coach engineers, ensure code quality, and collaborate on scalable solutions.
Top Skills:
AirflowAWSBigQueryDbt-CoreGCPHTTPJavaPythonRest
Fintech • Software
The Lead, Data Engineer leads the data engineering team, designing scalable data solutions, mentoring staff, and ensuring data quality while collaborating with stakeholders to meet business goals.
Top Skills:
Data ArchitecturesData EngineeringData GovernanceData PipelinesSnowpro Core Certification
Software • Energy
Lead the design and development of data integration solutions and APIs, ensuring performance and security. Oversee software lifecycle, mentor juniors, and contribute to code reviews while resolving complex technical issues.
Top Skills:
AWSAws LambdaDockerHibernateJavaJavaScriptJmsJunitKubernetesLinuxMavenMockitoMySQLRdbmsRestSoapSpring BatchSpring BootSpring IntegrationTestng
Artificial Intelligence • Cybersecurity
Design, build, and maintain scalable data infrastructure in the cloud using AWS services and Infrastructure as Code to ensure data reliability and performance.
Top Skills:
AWSCi/CdDmsDockerGitKubernetesPythonRedshiftS3Terraform
Artificial Intelligence • Software • Analytics • Financial Services
Lead the backend API team, architect large-scale data systems, ensure reliable API performance, mentor engineers, and drive engineering best practices.
Top Skills:
AWSClickhouseNode.js
Fintech • Software • Financial Services
Lead Data Engineer responsible for architecting, scaling, and optimizing data pipelines to support Tidal's ETF platform, ensuring high-performance data delivery and collaboration with cross-functional teams.
Top Skills:
AirflowAWSDbtGitGitKafkaKinesisPrefectPythonRedshiftSnowflakeSQL
Marketing Tech • Design
The Lead Data/ML Engineer will design and maintain scalable data pipelines and AI systems, ensuring data reliability and collaboration with product teams.
Top Skills:
PythonSnowflakeTemporal
Software
The Senior Data Engineer will build and deploy data pipelines, develop warehouse architectures, and design analytics solutions for the team.
Top Skills:
AirflowAWSBigQueryDbtDockerGitMeltanoMongoDBMySQLOraclePostgresPythonRedshiftSnowflakeSQLSQL ServerSuperset
Top San Francisco Companies Hiring Lead Data Engineers
See AllPopular Job Searches
All Filters
Total selected ()
No Results
No Results






.png)







.png)



















