AllTrails Logo

AllTrails

Senior Data Engineer (Remote)

Job Posted 12 Days Ago Posted 12 Days Ago
Remote
Hiring Remotely in San Francisco, CA
Senior level
Remote
Hiring Remotely in San Francisco, CA
Senior level
The Senior Data Engineer will lead data engineering projects, build data pipelines, ensure data quality, and support machine learning initiatives while collaborating across teams.
The summary above was generated by AI

About AllTrails


AllTrails is the most trusted and used outdoors platform in the world. We help people explore the outdoors with hand-curated trail maps along with photos, reviews, and user recordings crowdsourced from our community of millions of registered hikers, mountain bikers, and trail runners in 150 countries. AllTrails is frequently ranked as a top-5 Health and Fitness app and has been downloaded by over 75 million people worldwide.


Every day, we solve incredibly hard problems so that we can get more people outside having healthy, authentic experiences and a deeper appreciation of the outdoors. Join us!  


This is a U.S.-based remote position. San Francisco Bay Area employees are highly encouraged to come into the office one day a week.

What You’ll Be Doing:

  • Work cross-functionally to ensure data scientists have access to clean, reliable, and secure data, the backbone for new algorithmic product features
  • Build, deploy, and orchestrate large-scale batch and stream data pipelines to transform and move data to/from our data warehouse and other systems
  • Deliver scalable, testable, maintainable, and high-quality code
  • Investigate, test-for, monitor, and alert on inconsistencies in our data, data systems, or processing costs
  • Create tools to improve data and model discoverability and documentation
  • Ensure data collection and storage adheres to GDPR and other privacy and legal compliance requirements
  • Uphold best data-quality standards and practices, promoting such knowledge throughout the organization
  • Deploy and build systems that enable machine learning and artificial intelligence product solutions
  • Mentoring others on best industry practices

Requirements:

  • Minimum of 6 years of experience working in data engineering
  • Expertise both in using SQL and Python for data cleansing, transformation, modeling, pipelining, etc.
  • Proficient in working with other stakeholders and converting requirements into detailed technical specifications; owning and leading projects from inception to completion
  • Proficiency in working with high volume datasets in SQL-based warehouses such as BigQuery
  • Proficiency with parallelized python-based data processing frameworks such as Google Dataflow (Apache Beam), Apache Spark, etc.
  • Experience using ELT tools like Dataform or dbt
  • Professional experience maintaining data systems in GCP and AWS
  • Deep understanding of data modeling, access, storage, caching, replication, and optimization techniques
  • Experienced with orchestrating data pipelines and Kubernetes-based jobs with Apache Airflow
  • Understanding of the software development lifecycle and CI/CD
  • Monitoring and metrics-gathering (e.g. Datadog, NewRelic, Cloudwatch, etc)
  • Willingness to participate in a weekly on-call support rotation - currently the rotation is monthly
  • Proficiency with git and working collaboratively in a shared codebase
  • Excellent documentation skills
  • Self motivation and a deep sense of pride in your work
  • Passion for the outdoors
  • Comfort with ambiguity, and an instinct for moving quickly
  • Humility, empathy and open-mindedness - no egos

Bonus Points:

  • Experience working in a multi-cloud environment
  • Experience with GIS, H3, or other mapping technologies
  • Experience with Amplitude
  • Experience with infrastructure-as-code, such as Terraform
  • Experience with machine learning frameworks and platforms such as VertexAI, SageMaker, MLFlow, or related frameworks

What We Offer:

  • A competitive and equitable compensation plan. This is a full-time, salaried position that includes equity
  • Physical & mental well-being including health, dental and vision benefits
  • Trail Days: No meetings first Friday of each month to go test the app and explore new trails!
  • Unlimited PTO
  • Flexible parental leave 
  • Remote employee equipment stipend to create a great remote work environment
  • Annual continuing education stipend
  • Discounts on subscription and merchandise for you and your friends & family
  • An authentic investment in you as a human being and your career as a professional

Nature celebrates you just the way you are and so do we! At AllTrails we’re passionate about nurturing an inclusive workplace that values diversity. It’s no secret that companies that are diverse in background, age, gender identity, race, sexual orientation, physical or mental ability, ethnicity, and perspective are proven to be more successful. We’re focused on creating an environment where everyone can do their best work and thrive.


AllTrails participates in the E-Verify program for all remote locations.

By submitting my application, I acknowledge and agree to AllTrails' Job Applicant Privacy Notice.

Top Skills

Apache Airflow
Apache Beam
Spark
AWS
Cloudwatch
Datadog
Dataform
Dbt
GCP
Git
Google Dataflow
Kubernetes
Mlflow
Newrelic
Python
Sagemaker
SQL
Terraform
Vertexai
HQ

AllTrails San Francisco, California, USA Office

530 Bush Street, 9th Floor, San Francisco, CA, United States, 94108

Similar Jobs

11 Days Ago
Remote
Hybrid
United States
117K-217K Annually
Senior level
117K-217K Annually
Senior level
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
As a Senior Data Engineer at SailPoint, you will design and build scalable data solutions, lead projects, and contribute to AI/ML product development.
Top Skills: AirflowAWSCloudbeesDbtFeastJenkinsKafkaPythonQlikShell/BashSnowflakeSQLTableau
17 Days Ago
Easy Apply
Remote
Hybrid
3 Locations
Easy Apply
Senior level
Senior level
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Senior Data Engineer, you will develop and maintain ETL pipelines, design scalable systems, troubleshoot production issues, and mentor team members while ensuring best practices are followed.
Top Skills: AirflowBigQueryDataflowGoogle Cloud PlatformKubernetesPub/SubPythonSQL
Yesterday
Remote
US
125K-145K Annually
Senior level
125K-145K Annually
Senior level
Software
The Senior Data Engineer will build and maintain data infrastructure, drive decision support analytics, and lead various data-focused projects to enhance data processes and integrity.
Top Skills: AirflowAnsibleAws AthenaAws Data PipelinesAws Data ZoneAws GlueAws Glue StudioDockerFivetranPythonRedshiftS3Terraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account