Hayden AI Logo

Hayden AI

Senior Software Engineer - Data Engineering

Job Posted 6 Days Ago Posted 6 Days Ago
San Francisco, CA
Senior level
San Francisco, CA
Senior level
The Senior Software Engineer will design and operate data infrastructure, build ETL pipelines, and develop dashboards for data analytics across various stakeholders.
The summary above was generated by AI

About Us

At Hayden AI, we are on a mission to harness the power of computer vision to transform the way transit systems and other government agencies address real-world challenges.

From bus lane and bus stop enforcement to transportation optimization technologies and beyond, our innovative mobile perception system empowers our clients to accelerate transit, enhance street safety, and drive toward a sustainable future.


What the Job Involves

Hayden AI seeks a data generalist to support a diverse set of stakeholders with Data and Analytics needs. We are a small team, and this is a great opportunity for someone who wants to deliver a big impact: you will operate on the intersection of Data Infrastructure, Data Engineering, Analytics, Data Science, and ML Ops. You will work with transit agencies, the customer success team, finance, product, company executives, and, last but not least, engineers. You will enable all of them to get their data questions answered in a timely manner with a high accuracy. 

Responsibilities

  • Design, build, and operate cloud-based data warehouse / data lake that enables large scale data analytics. 

  • Operate the ETL pipelines that merge the data from multiple sources into a centralized data warehouse. 

  • Build derived canonical datasets from the raw data to simplify and speed up analytical queries and make analytics accessible to less technical audiences. 

  • Be the voice of the data: identify product issues using anomaly detection in various data sets, and bring it to the attention of respective stakeholders. 

  • Build dashboards that track various metrics and KPIs that the company relies on. 

  • Participate actively in the team's software development process, including design reviews, code reviews, and brainstorming sessions. Keep software development documents accurate and updated.

  • Proactively remove roadblocks and escalate issues when encountered.

Qualifications

  • Experience with data warehouse systems, such as Amazon Redshift, Google BigQuery, or Snowflake. From schema design to performance optimizations, and everything in between. 

  • Broad knowledge of database technologies, including SQL and NoSQL (e.g. PostgreSQL, InfluxDb, Redis, DynamoDB, etc). You do not need to know all of them, but you should be comfortable in some. 

  • Experience with ETL and orchestrations, such as Airbyte, DBT, Flyte, and/or Airflow.

  • Experience with Business Intelligence tooling, such as Tableau or Looker. 

  • 5+ years of Software / Data Engineering experience, including hands-on coding ability in modern programming languages. We use Python and Go, but you don’t have to be an expert in both. 

  • BS or MS in Computer Science, Electrical Engineering, or a related field.

  • Excellent communication, verbal and written.

Bonus

  • Experience with CI/CD automation Test Driven Development.

  • Experience with the AWS ecosystem to the extent that is needed to operate the above mentioned tools.

  • Experience with geospatial, image, and video datasets. 

  • Prior experience working in startups, and desire to do that again!

Top Skills

Airbyte
Airflow
Amazon Redshift
Dbt
DynamoDB
Flyte
Go
Google Bigquery
Influxdb
Looker
NoSQL
Postgres
Python
Redis
Snowflake
SQL
Tableau
HQ

Hayden AI Oakland, California, USA Office

492 B 9th Street, Oakland, CA, United States, 94607

Similar Jobs

6 Days Ago
Hybrid
San Mateo, CA, USA
273K-338K Annually
Senior level
273K-338K Annually
Senior level
Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
As a Senior/Principal Data Engineer, lead data projects, design pipelines, establish data operations standards, and collaborate with teams to enhance analytics capabilities.
Top Skills: AirflowAWSAzureDagsterGCPGitopsGoogle Cloud ComposerLuigiPysparkScalaSQL
4 Days Ago
Remote
3 Locations
120K-160K Annually
Senior level
120K-160K Annually
Senior level
Fintech
Develops and maintains data solutions using ETL frameworks, collaborates on software projects, and ensures code quality in a fast-paced environment.
Top Skills: EltETLGitKafkaNoSQLPythonScalaSparkSQL
10 Days Ago
Hybrid
Redwood City, CA, USA
155K-225K Annually
Senior level
155K-225K Annually
Senior level
AdTech • Cloud • Machine Learning • Mobile • Retail
Develop an ML-based advertising platform, optimize data infrastructure, enhance system performance, mentor team, and lead high-impact projects.
Top Skills: AWSAzureC#C++GoGCPJavaNoSQLPythonSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account