Lumos Logo

Lumos

Lead Data Engineer

Job Posted 7 Days Ago Reposted 7 Days Ago
Remote
Senior level
Remote
Senior level
As a Lead Data Engineer, you'll architect and maintain data pipelines, ensuring their reliability and scalability, while collaborating closely with AI and data teams.
The summary above was generated by AI

Imagine having an enterprise-grade AppStore at work — one that ensures you can easily search, request, and gain access to any app you need, precisely when you need it. No more long waiting times with outstanding IT requests. Lumos is solving the app and access management challenges for organizations of all sizes through a unified platform. Our fast-growing startup is pioneering the way to untangle the complex web of app and access management by building the critical infrastructure that defines relationships between app, identities and data.

 

Why Lumos?

  • Jump on a Rocketship: Since launching out of stealth mode just over 2 years ago, our team has grown from 20 to ~100 people and our customer base has 10x’ed with companies like GitHub, MongoDB and Major League Baseball!
  • Build with Renowned Investor Backing: Andreessen Horowitz (a16z) backed us since the beginning and we've raised over $65m from Scale, Neo, Greg Brockman (President at OpenAI), Phil Venables (CISO at Google), and others.
  • Thrive in a Unique Culture: You’ll join an early-stage company where you have actual influence on the trajectory of the company. We deeply care about our people and the philosophy we live by - check out our values here.

Lumos is making it a joy for companies to manage their apps and identities ✨. By integrating usage, spend, compliance, and access data, we provide a level of clarity and insight previously unimaginable. To deliver a best-in-class product, Lumos depends on state-of-the-art data pipelines that power our analytics and AI-driven solutions.

We are seeking a Lead Data Engineer to expand and enhance our existing data infrastructure, built around MySQL, Fivetran, Airbyte, and Snowflake. In this role, you will design and implement production-ready data pipelines with a strong emphasis on reliability, testing, and scalability. Your work will ensure that our AI products and in-product analytics perform flawlessly at scale, driving value for our customers.


✨ Your Responsibilities

  • Your mission is to architect, build, and maintain cutting-edge data pipelines that empower our AI products, in-product analytics, and internal reporting.
  • You will ensure the scalability, reliability, and quality of our analytics data infrastructure, enabling the seamless integration of usage, spend, compliance, and access data to drive business insights and deliver exceptional value to our customers.
  • By focusing on testing, automation, and best-in-class engineering practices, you will play a pivotal role in transforming complex data into actionable intelligence, fueling Lumos' growth and innovation.

🙌 What We Value

  • Extensive experience designing and implementing medallion architectures (bronze, silver, gold layers) or similar data warehouse paradigms. Skilled in optimizing data pipelines for both batch and real-time processing.
  • Proficiency in deploying data pipelines using CI/CD tools and integrating automated data quality checks, version control, and deployment automation to ensure reliable and repeatable data processes.
  • Expertise in advanced SQL, ETL processes, and data transformation techniques. Strong programming skills in Python.
  • Demonstrated ability to work closely with AI engineers, data scientists, product engineers, product managers, and other stakeholders to ensure that data pipelines meet the needs of all teams.

💰 Pay Range

  • $175,000 - $220,000. Note that this range is a good faith estimate of likely pay for this role; upon hire, the pay may differ due to skill and/or level of experience.



💸 Benefits and Perks:
  • 💯 Remote work culture (+/-4 hours Pacific Time)
  • ⛑ Medical, Vision, & Dental coverage covered by Lumos
  • 🛩 Company and team bonding trips throughout the year fully covered by Lumos
  • 💻 Optimal WFH setup to set you up for success
  • 🌴 Unlimited PTO, with minimum time off to make sure you are rested and able to be at your best
  • 👶🏽 Up to 16 weeks for expecting parents
  • 💰 Wellness stipend to keep you awesome and healthy
  • 🏦 401k matching plan 

Top Skills

Airbyte
Ci/Cd Tools
Fivetran
MySQL
Python
Snowflake
SQL
HQ

Lumos San Francisco, California, USA Office

2632 Laguna Street, San Francisco, California, United States, 94123

Similar Jobs

12 Days Ago
Remote
Hybrid
5 Locations
151K-323K Annually
Senior level
151K-323K Annually
Senior level
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
The Lead Data Engineer will manage data pipelines, mentor teams, improve tooling, and lead cloud-based infrastructure solutions using AWS and various data technologies.
Top Skills: AirflowAWSCodefreshDatabricksDockerEmrGitGlueJIRAKafkaKubernetesLambdaPysparkPythonRedshiftS3SQLTerraform
20 Days Ago
Remote
Hybrid
2 Locations
176K-201K Annually
Senior level
176K-201K Annually
Senior level
Fintech • Machine Learning • Payments • Software • Financial Services
Lead the development of data management tools by collaborating across Agile teams, utilizing cloud technologies, and mentoring engineers to support large-scale applications in a remote environment.
Top Skills: AWSCassandraEmrGCPGurobiHadoopHiveJavaKafkaLinuxMapreduceAzureMongodbMySQLPythonRedshiftScalaSnowflakeSparkSQLUnix
3 Days Ago
Remote
USA
Senior level
Senior level
Mobile • Software
Lead the development and management of financial data initiatives, collaborating with leadership and teams to enhance data utilization and reporting.
Top Skills: AWSConfluenceDatabricksGitlabJIRAPower BIPysparkPythonSpark

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account