Codeium Logo

Codeium

Software Engineer, High Performance ML

Job Posted 2 Days Ago Posted 2 Days Ago
Be an Early Applicant
Mountain View, CA
Mid level
Mountain View, CA
Mid level
Develop high-performance ML systems and infrastructure to enhance LLM capabilities. Improve training software, build indexing for large data sets, and contribute to petabyte-scale data pipelines. Requires strong software engineering, analytical skills, and knowledge of GPU architecture and AI tools.
The summary above was generated by AI

We're looking for a high performance ML-focused software engineer to join us on our mission to build AI superpowers for developers. We serve one of the largest scale and most demanding LLM applications in the world.

About Codeium

Featured on the Forbes AI 50 list, Codeium has risen to become a leader in the AI developer tools space in just over a year, giving hundreds of thousands of users around the world code autocomplete, in-editor chat assistants, and more. our IDE extensions span 70+ programming languages and 40+ editors. Our state-of-the-art proprietary language models and custom inference stack allow us to deliver the best experience possible to our users. We've achieved substantial revenue and enterprise traction as proof of the quality and usefulness of our tools.

We're one of the fastest growing AI startups, focused on product, revenue, and customer experience. We work hard, and we operate with a high degree of trust, agency, and ownership.

What you'll do

  • Develop custom LLM serving systems and corresponding datacenter infrastructure to deliver high model quality at very low latency and cost.

  • Improve our LLM training software both in terms of model architecture changes that improve model quality or increase iteration speed and reliability.

  • Build indexing systems capable of serving queries instantly from many terabytes of data within customer deployments.

  • Contribute to infrastructure for petabyte-scale data pipelines to accelerate our ML research work.

About you

  • Strong software engineering skills. There are no pure research scientists at the company.

  • Excellent quantitative, analytical and estimation skills.

  • Strong grasp of computer and networking architecture, particularly with GPU hardware and HPC networks.

  • Familiarity with AI-powered developer tools like Codeium, Copilot, ChatGPT, and others is a strong plus.

What we believe

  • Our best work is done in person. The team goes in 5 days a week into our office in downtown Mountain View, CA (within walking distance of the Caltrain station). 

  • Research is in service of a better product. While we read many papers, we won't have time to write them. The best AI researchers have excellent software engineering skills and know that infrastructure and evaluation work are critical.

Top Skills

Gpu
Hpc
Machine Learning
Python
HQ

Codeium Mountain View, California, USA Office

321 Castro St, 200, Mountain View, California, United States, 94041

Similar Jobs

23 Hours Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
Senior level
Senior level
Cloud • Software
As a Lead Software Engineer II focused on Machine Learning, you will design and optimize algorithms for anomaly detection in real-time data processing, utilizing AI/ML technologies. This role involves collaborating with a team to build scalable ML pipelines, training models, and assessing algorithm performance across large datasets.
Top Skills: FlinkKafkaPythonPyTorchSklearnTensorFlowXgboost
2 Days Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
Mid level
Mid level
Cloud • Software
As a Senior Software Engineer I in Machine Learning, you will develop and optimize anomaly detection algorithms for a scalable stream processing platform, utilizing AI/ML technologies to analyze vast datasets and provide actionable insights while collaborating with a skilled engineering team.
Top Skills: FlinkKafkaPythonPyTorchSklearnTensorFlowXgboost
6 Days Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
Senior level
Senior level
Cloud • Software
As a Principal Engineer on the AI Ops team, you will design and implement large-scale machine learning pipelines, leveraging Java and Python along with tools like Apache Spark and TensorFlow to enhance digital experiences across networks.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account