Software Engineer, Distributed Systems

Sorry, this job was removed at 04:34 p.m. (PST) on Monday, Dec 16, 2024
Be an Early Applicant
San Francisco, CA
Internship
Big Data • Cloud • Software • Database
Airbyte wants to give your infrastructure superpowers to collect and move data seamlessly, whatever the tools you use.
The Role

Airbyte is the open-source standard for EL(T). We enable data teams to replicate data from applications, APIs, and databases to data warehouses, lakes, and other destinations. We believe only an open-source approach can solve the problem of data integration, as it enables us to cover the long tail of integrations while enabling teams to adapt pre-built connectors to their needs.

So far, we've built over 350 connectors and have had 60,000+ companies replicating data with us. We've raised $181M from some of the world's top investors (Benchmark, Accel, Altimeter, Coatue, Y Combinator, etc.) and believe in product-led growth, where we build something awesome and let our product bring the users, rather than an outbound sales engine with cold calls.

We’re committed to providing as much context to our current employees and candidates. The Airbyte company handbook, core values, methodology, strategy, and roadmap are open to all.

Airbyte is onsite in our Embarcadero office weekly. Within each job description, you'll see how many days that team is onsite. If you find this role exciting, we encourage you to apply even if you think you don’t meet all requirements.

 

Opportunity

Airbyte is taking a big swing to make data available and actionable to everyone, everywhere. Our product manages the extract and load of data, so that developers and data practitioners can focus on building products, not moving data. As an engineer at Airbyte, you'll be part of the team that solves all the data movement challenges that a developer has ever faced, for the last time. 

You'll be solving product and technical challenges that you have never seen before but will draw on your past expertise in building products that move and use data at scale. For example, our data pipelines need to be resilient to huge unpredictability in data (size variance record to record, 1MB syncs, and 1PB syncs). We are building systems that drive down  the effort of connector creation and maintenance so that we can power a fleet of 1000s integrations.

As an Open-Source product, you will be reasoning about how to deploy the product into a diverse set of environments while maintaining a great product experience in all of them. The product that you build will meet every developer's data movement needs.

We have positions open at multiple levels fo this role. The “What You'll Need” section describes the minimum level that we have open. We have positions that will challenge a seasoned engineer at any level.

What You'll Do

  • Pioneer a new framework and pattern for extracting from and loading data into databases and data warehouses. 
  • Build core technologies to manage a fleet of high-volume of data connectors.
  • Craft a platform that orchestrates fast, reliable, and observable data movement across all connectors.
  • Drive step function improvements in performance & reliability at scale.
  • Build leverage: a week-long task this year should take ten minutes next year
  • Shape the roadmap for the team.
  • Write high-leverage code.

What You'll Need

  • 6+ years of software engineering experience.
  • 2+ years of Java experience
  • Deep knowledge of some part of an ETL stack (e.g. Postgres, Snowflake, dbt, Kafka, Spark)
  • Experience in profiling and optimizing high-performance applications
  • You have an insatiable desire to ship.
  • You take a user-centric approach to building products and developer tools
  • You enjoy building leverage through abstractions and tooling that multiply output
  • Ability to influence without authority and work with engineers junior and senior
  • A passion for continuous learning and improvement (both at a personal and team level)
  • Excellent written & verbal communication skills
  • Belief in our values

Location

  • San Francisco Office, 3x/week

Salary for this job

  • $183,000- $250,000 +  a generous equity package, and benefits listed below for US Market.


We Provide 

The benefits listed below are for US-based employees.

  • Relocation - should you apply to a San Francisco based role, Airbyte will assist with U.S. relocation to make this a seamless transition and compensate you well.
  • Unlimited Paid Time Off - we need you at your best at all times. Our expected minimum time off of 25 PTO days per year lets you schedule your work around your life.
  • Parental leave (for new parents) - we offer 16 weeks of paid parental leave for all new parents so you have time to adjust to the new life (and work) schedule introduced by your new bundle of joy.
  • Sponsored Travel - Airbyte has a partially distributed team and we recognize the value of in-person time. We sponsor annual company-wide retreats, team offsites, and Travel With Purpose in between to allow you to collaborate with your team in person on a regular basis.
  • Open book policy - we will pay for books you purchase for your professional and career development. 
  • Continuous learning/training policy - we sponsor you for the conferences and training programs you feel would add to your development in the company. 
  • Competitive benefits package for US-based employees, including:
  • Blue Shield or Kaiser Medical Insurance 
    • Airbyte covers 100% for both employees and dependents
  • Dental (including child & adult ortho) & Vision Insurance
    • Airbyte covers 100% for both employees and dependents
  • Life and AD&D Insurance
    • Airbyte covers 100% for employees
  • Short-term Disability Insurance 
    • Airbyte covers 100% for employees 
  • Long-term Disability Insurance
    • Airbyte covers 100% for employees
  • Healthcare insurance stipend for those outside the US whose countries do not provide it for free.
  • 401k for US-based employees.
  • FSA (flexible spending account)
  • Work Visas We currently sponsor H1B Transfers, TN Visas, and Green Cards. All other Visa requests will be discussed on a case by case basis to determine if we can sponsor.



Airbyte is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, national origin, ancestry, age, physical or mental disability, pregnancy, genetic information, sex, sexual orientation, gender identity or expression, marital status, familial status, domestic violence victim status, veteran or military status, or any other legally recognized protected basis under federal, state or local laws. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records. 


Airbyte is committed to providing reasonable accommodations for qualified individuals with disabilities in our job application procedures. Please let us know if you need assistance or accommodation due to a disability.

The Company
San Francisco, CA
92 Employees
Hybrid Workplace
Year Founded: 2020

What We Do

We want to become the data integration (ELT, reverse-ETL, event streaming, etc.) standard that most companies use in the future. This implies that our open-source technology will support both ingestion to warehouses from any tool, database or SaaS, and distribution of data to any SaaS tools.

On top of that, we will build data quality monitoring, privacy compliance (GDPR, CCPA, HIPAA, etc.), and enterprise features (role access/management, SSO, etc.).

You should be able to build your own ELT platform internally, while having complete control over your data and costs (not indexed on MTUs). If any integration that you need is missing, we will make it super easy for you to build it and to use our orchestration and scheduling features for it.

We will stay at parity with the incumbent’s features (Fivetran, StitchData) at first (see our [high-level roadmap](https://go.airbyte.com/roadmap)), as our differentiation is on:

- open source, enabling you to add your own integration very easily and customize any pre-built one;
- data privacy and control; and
- volume-based pricing

Why Work With Us

Airbyte is Hybrid and based in Silicon Valley. We’re fully transparent as a company. Our company handbook, culture & values, strategy and roadmap are open to all. https://handbook.airbyte.com/

Gallery

Gallery

Similar Jobs

Alchemy Logo Alchemy

Staff Software Engineer (Distributed Systems)

Blockchain • Information Technology • Software • Cryptocurrency • Web3
Easy Apply
Hybrid
2 Locations
200 Employees

Verkada Inc Logo Verkada Inc

Software Engineer - Engineering Productivity

Cloud • Hardware • Security • Software
San Mateo, CA, USA
2000 Employees
130K-280K Annually

Databricks Logo Databricks

Senior Software Engineer - Distributed Data Systems

Big Data • Machine Learning • Software • Analytics • Big Data Analytics
Mountain View, CA, USA
2200 Employees
166K-225K Annually

Databricks Logo Databricks

Staff Software Engineer - Distributed Data Systems

Big Data • Machine Learning • Software • Analytics • Big Data Analytics
San Francisco, CA, USA
2200 Employees
192K-260K Annually

Similar Companies Hiring

Hedra Thumbnail
Software • News + Entertainment • Marketing Tech • Generative AI • Enterprise Web • Digital Media • Consumer Web
San Francisco, CA
14 Employees
RunPod Thumbnail
Software • Infrastructure as a Service (IaaS) • Cloud • Artificial Intelligence
San Francisco, CA
53 Employees
Altana Thumbnail
Software • Machine Learning • Artificial Intelligence
San Francisco, CA
200 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account