Get the job you really want.
Be the first applicant
Apply to jobs posted less than 24 hours ago to maximize your visibility.
Use the Date Posted filter to view jobs posted within the last 24 hours.
Be the first applicant
Apply to jobs posted less than 24 hours ago to maximize your visibility.
Use the Date Posted filter to view jobs posted within the last 24 hours.
Top Lead Data Engineer Jobs in San Francisco, CA
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
The Lead Data Engineer will manage data pipelines, mentor teams, improve tooling, and lead cloud-based infrastructure solutions using AWS and various data technologies.
Top Skills:
AirflowAWSCodefreshDatabricksDockerEmrGitGlueJIRAKafkaKubernetesLambdaPysparkPythonRedshiftS3SQLTerraform
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the development of data management tools by collaborating across Agile teams, utilizing cloud technologies, and mentoring engineers to support large-scale applications in a remote environment.
Top Skills:
AWSCassandraEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMongodbMySQLPythonRedshiftScalaSnowflakeSparkSQLUnix
Payments
The Lead Data Engineer designs, develops, and maintains software solutions while mentoring junior team members and participating in agile practices.
Top Skills:
ClouderaHiveImpalaJavaKafkaLinuxNifiOoziePostgresScalaSparkSqoopUnix
Fintech • Information Technology • Payments
Lead a data engineering team to build scalable systems for data processing and analysis, mentoring engineers and ensuring project delivery on time.
Top Skills:
Big DataGraph DatabasesHadoop StackJavaKafkaPythonRestful ApisScala
Healthtech
As a Lead Data Engineer, you will design and develop scalable data solutions, mentor engineers, and enhance data performance and reliability while ensuring governance and security in a cross-functional role.
Top Skills:
DatabricksKafkaKinesisPysparkScalaSnowflakeSparkSQL
Mobile • Software
Lead the development and management of financial data initiatives, collaborating with leadership and teams to enhance data utilization and reporting.
Top Skills:
AWSConfluenceDatabricksGitlabJIRAPower BIPysparkPythonSpark
Productivity • Security • Software • Business Intelligence • Cybersecurity
As a Lead Data Engineer, you'll architect and maintain data pipelines, ensuring their reliability and scalability, while collaborating closely with AI and data teams.
Top Skills:
AirbyteCi/Cd ToolsFivetranMySQLPythonSnowflakeSQL
Fintech • Mobile • Software • Financial Services
The Staff Data Engineer will lead the Data Engineering group, focusing on building data pipelines, architectures, and analytics while mentoring the team and ensuring data integrity.
Top Skills:
AirflowAWSGitlabPostgresPythonSnowflakeSQL
Featured Jobs
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Senior Data Engineer at Crunchyroll, you'll design and optimize data services and pipelines, support operational data analysis, and drive automation. Collaborate with teams to enhance systems efficiency and mentor junior engineers.
Top Skills:
Apache KafkaAWSAws GlueCloud FormationDatabricksDbtDynamoDBJavaKinesisPythonRdsRedshiftSnowflakeSQLTerraform
Artificial Intelligence • Big Data • Machine Learning • Software
The Lead Data Engineer will design and build data pipelines using various technologies, working closely with data science and engineering teams to manage large datasets and build applications for data orchestration and monitoring.
Top Skills:
AirflowApache BeamSparkBigQueryCassandraDataflowGCPJavaKotlinPostgresPythonScylla
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll design data models, build scalable data pipelines, and improve data quality, collaborating across teams.
Top Skills:
AirflowSparkAthenaAws Data ServicesEmrFlinkHiveJavaKafkaPythonRedshiftSparkSQL
Information Technology • Legal Tech
The Lead Data Engineer will design, implement, and maintain scalable data pipelines and architecture while ensuring data governance and compliance. Responsibilities include collaborating with stakeholders, optimizing data processing, and supporting AI initiatives.
Top Skills:
Auto LoaderDatabricksDelta Live TablesDelta SharingHadoopHivePysparkPythonSnowflakeSparkSQLUnity Catalog
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Data Engineer at Bombora, you'll develop ETL pipelines, cloud-native data systems, and collaborate with teams to implement best practices.
Top Skills:
AirflowBigQueryDataflowGCPKubernetesPub/SubPythonSQL
Artificial Intelligence • Healthtech • Telehealth
As a Data Engineer II, you will maintain and expand a data platform, ensuring its reliability and stability. Your responsibilities include building and operating data infrastructure, maintaining CI/CD pipelines, and collaborating with stakeholders for data requirements. You'll leverage tools like Airflow, dbt, and AWS to optimize data processing and documentation.
Top Skills:
AirflowAWSCircleCIDatadogDbtGitPythonSnowflakeSQLTerraform
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian's Data Engineering Team in building scalable data solutions, ensuring operational data quality, architecting data systems, and mentoring engineers.
Top Skills:
AirflowAWSDatabricksFlinkHiveKafkaRedshiftSparkSQL
Machine Learning • Software
The Staff/Lead Data Engineer will build and manage data pipelines, ensuring data availability and quality while using technologies such as Apache Airflow and Spark.
Top Skills:
Apache AirflowAWSDockerElk StackGCPGrafanaKafkaKubernetesPythonSparkSQL
Automotive • Big Data • Insurance • Software • Transportation
Design, build, and maintain data infrastructure. Optimize ETL/ELT pipelines, ensure data quality, and develop data models for analytics.
Top Skills:
Apache AirflowAWSBigQueryDbtFastapiFlaskGitPysparkPythonRedshiftSnowflakeSQL
Artificial Intelligence • Healthtech • Information Technology • Natural Language Processing • Software • Analytics • Generative AI
The Staff Data Engineer will design and optimize data infrastructure, support multiple teams, and ensure data quality and integrity across projects.
Top Skills:
AirflowAWSDynamoDBEc2ElasticsearchEmrGitKafkaMongoDBPostgresPythonRdsSparkSQLTerraform
Reposted 9 Days Ago
Easy Apply
Easy Apply
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Senior Data Engineer, you will develop and maintain ETL pipelines, design scalable systems, troubleshoot production issues, and mentor team members while ensuring best practices are followed.
Top Skills:
AirflowBigQueryDataflowGoogle Cloud PlatformKubernetesPub/SubPythonSQL
Cloud • Insurance • Professional Services • Analytics • Cybersecurity
The role involves designing, developing, and integrating data applications on Google Cloud Platform, leading data pipelines, enhancing data models, and ensuring quality standards in an Agile environment.
Top Skills:
SparkAWSBigQueryCloud ComposerCloud StorageConcourseDataflowDataprepDataprocGitGoogle Cloud PlatformInformatica IicsPub/SubPythonSQL
Artificial Intelligence • Cloud • Internet of Things • Machine Learning • Analytics • Industrial
As a Senior Data Engineer, you will write clean code for large scale geospatial data, build high performance data pipelines, and develop APIs for machine learning models.
Top Skills:
Apache AirflowDatabricksPython
AdTech • Digital Media • Marketing Tech • Professional Services
As a Senior Data Engineer, you will lead data engineering projects, collaborate with teams, mentor engineers, and enhance the data infrastructure with new technologies.
Top Skills:
AirflowDatabricksDbtHadoopHiveLookerOlapPrefectPythonSnowflakeSparkSQLTableau
Fintech • Information Technology • Payments
Lead the design and architecture of scalable data engineering platforms, oversee the data lifecycle, develop synthetic data solutions, and guide a high-performing team in Machine Learning and Data Engineering.
Top Skills:
AWSAzureData EngineeringDatabricksDockerGenaiGrafanaJavaKubernetesMachine LearningPrometheusRestS3ScalaSQL
Big Data • Fitness • Healthtech • Software • Analytics • Energy
As a Data Engineer at Arcadia, you will design and develop data pipelines, support data integrations, and contribute to team processes while working within a Scrum setup.
Top Skills:
Cloud ArchitectureNoSQLSparkSQL
Reposted 14 Days Ago
Easy Apply
Easy Apply
Artificial Intelligence • Marketing Tech • Software
As a Principal Data Engineer, you'll guide the direction of the Data Warehouse, architect, implement, and optimize ingestion pipelines, and collaborate across teams to ensure data-driven decision-making. You'll also mentor colleagues and ensure compliance with regulatory standards while managing high-volume data systems.
Top San Francisco Companies Hiring Lead Data Engineers
See AllPopular Job Searches
Top San Francisco Companies Hiring Lead Data Engineers
See AllPopular Job Searches
All Filters
Total selected ()
Total selected (1)
Job Category
No Results
No Results
No Results