Lambda Logo

Lambda

Software Engineer - Compute

Job Posted 7 Days Ago Reposted 7 Days Ago
Be an Early Applicant
San Francisco, CA
170K-230K Annually
Mid level
San Francisco, CA
170K-230K Annually
Mid level
Develop and improve a critical internal testing system for AI testloads across large GPU compute clusters, focusing on code quality, scalability, and collaboration.
The summary above was generated by AI

In 2012, Lambda started with a crew of AI engineers publishing research at top machine-learning conferences. We began as an AI company built by AI engineers. That hasn't changed. Today, we're on a mission to be the world's top AI computing platform. We equip engineers with the tools to deploy AI that is fast, secure, affordable, and built to scale. Whether they need powerhouse GPU hardware on-site or the flexibility of cloud-based solutions, we've got the horsepower to make it happen. Lambda’s AI Cloud has been adopted by the world’s leading companies and research institutions including Anyscale, Rakuten, The AI Institute, and multiple enterprises with over a trillion dollars of market capitalization. Our goal is to make computation as effortless and ubiquitous as electricity.


If you'd like to build the world's best deep learning cloud, join us. 

*Note: This position requires presence in our San Francisco office location 4 days per week; Lambda’s designated work from home day is currently Tuesday.

What You’ll Do 

  • Join a functional sub-team of Compute at Lambda which is responsible for the development of a critical internal testing system that manages AI testloads across large GPU compute clusters.

  • Improve code quality, internal validation, and support for new topologies in the testing system.

  • Work on scalability challenges, enabling the testing system to support very large-scale clusters.

  • Transition communication mechanisms from SSH to node agents, exploring ZeroMQ or Redis streams.

  • Fix bugs and operational blockers to enable smoother handoff to non-engineering teams.

  • Contribute to the implementation efforts, and collaborate with the team  on high-level architecture or strategic direction.

  • Work closely with the HPC-Ops and other internal consumers of the testing system.

You 

  • Have strong proficiency in Python, backed by 3-5 years of professional software development experience, ideally leaning towards 5 years.

  • Solid understanding of Go, with the capability to develop efficient and maintainable code.

  • Have hands-on experience with containers (Docker preferred).

  • Have familiarity with Kubernetes (K8s is a plus but not required).

  • Are comfortable working with Linux-based systems in a distributed environment.

  • Have experience working with large, complex codebases and improving their maintainability.

  • Have learned from past large-scale technical mistakes and grown from them.

  • Can take ownership of an internal tool and drive it forward.

  • Are eager to learn on the job, especially regarding the testing system’s architecture.

  • Are adaptable and enjoy working in fast-moving, high-impact environments.

  • Communicate well with cross-functional teams and collaborate effectively on large-scale engineering efforts.

Nice to Have 

  • Experience with Slurm or Kubernetes-based cluster management.

  • Familiarity with high-performance computing (HPC).

  • Understanding of GPU compute environments (CUDA knowledge is not required).

  • Interest in validating AI workloads in customer environments for debugging or preventative maintenance.

Salary Range Information 

Based on market data and other factors, the annual salary range for this position is $170,000-$230,000. However, a salary higher or lower than this range may be appropriate for a candidate whose qualifications differ meaningfully from those listed in the job description.

About Lambda

  • Founded in 2012, ~350 employees (2024) and growing fast

  • We offer generous cash & equity compensation

  • Our investors include Andra Capital, SGW, Andrej Karpathy, ARK Invest, Fincadia Advisors, G Squared, In-Q-Tel (IQT), KHK & Partners, NVIDIA, Pegatron, Supermicro, Wistron, Wiwynn, US Innovative Technology, Gradient Ventures, Mercato Partners, SVB, 1517, Crescent Cove.

  • We are experiencing extremely high demand for our systems, with quarter over quarter, year over year profitability

  • Our research papers have been accepted into top machine learning and graphics conferences, including NeurIPS, ICCV, SIGGRAPH, and TOG

  • Health, dental, and vision coverage for you and your dependents

  • Commuter/Work from home stipends for select roles

  • 401k Plan with 2% company match (USA employees)

  • Flexible Paid Time Off Plan that we all actually use

A Final Note:

You do not need to match all of the listed expectations to apply for this position. We are committed to building a team with a variety of backgrounds, experiences, and skills.

Equal Opportunity Employer

Lambda is an Equal Opportunity employer. Applicants are considered without regard to race, color, religion, creed, national origin, age, sex, gender, marital status, sexual orientation and identity, genetic information, veteran status, citizenship, or any other factors prohibited by local, state, or federal law.

Top Skills

Docker
Go
Kubernetes
Linux
Python
HQ

Lambda San Francisco, California, USA Office

San Francisco, CA, United States, 94107

Similar Jobs

10 Days Ago
Hybrid
San Mateo, CA, USA
284K-332K Annually
Senior level
284K-332K Annually
Senior level
Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
As a Principal Software Engineer, you will develop features for the Kubernetes control plane, manage Roblox’s Edge Data Centers, and enhance automation and reliability in production systems.
Top Skills: GoKubernetes
10 Days Ago
Hybrid
San Mateo, CA, USA
234K-284K Annually
Senior level
234K-284K Annually
Senior level
Computer Vision • Gaming • Software • Virtual Reality • Web3 • Metaverse
The software engineer will develop features for the Kubernetes-based control plane, support scalable data centers, and enhance the Edge Computing Platform.
Top Skills: GoKubernetes
3 Days Ago
3 Locations
Senior level
Senior level
Software
As a Backend Software Engineer, you will develop high-performance distributed systems, design scalable storage solutions, and optimize system performance while collaborating with cross-functional teams.
Top Skills: Apache ArrowAWSAzureClickhouseDockerDruidFlinkGCPGoInfluxdbJavaKafkaKubernetesParquetRustSparkTerraformTimescaledb

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account