Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business’ most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization.
Obsidian proudly offers the industry's most comprehensive and powerful SaaS defense solution. We are committed to solving the challenge of SaaS Security for our customers as efficiently and effectively as possible.
We’re a passionate team optimizing for impact by solving some of the biggest challenges in cybersecurity today. We listen closely to our customers, iterate quickly, and (over) deliver to delight them. Working at Obsidian means contributing to an industry-leading cybersecurity product in an environment where customer satisfaction, privacy, and data ethics are paramount.
Obsidian is seeking an experienced Staff Data Engineer to build and extend our highly flexible, modern data stack built on dbt, DuckDB, Dagster, and Databricks. Our security engineers and researchers continuously ship new insights based on thousands of data sources and complex transformations with minimal friction.
This expert engineer is expected to have deep technical knowledge in data architecture, data semantics and software library design.
Who You Are:
- You’re a software engineer who is experienced in solving data problems with rigorous data semantics.
- You enjoy building and architecting frameworks that are extensible and scalable.
- You pride yourself in building highly performant data pipelines.
What You'll Do:
- Architect and build computational frameworks exposing a new generation of data processing primitives, tackling:
- customer-facing problems involving time travel, change detection, change attribution, and graph analysis.
- incremental workloads enabling efficient processing of data-heavy security analyses.
- Develop and maintain data pipelines for the acquisition, storage, and processing of heterogeneous data types, generating new features and feeding real-time machine learning models.
- Work with security engineers and researchers to help solve cybersecurity questions.
Required skills/experience:
- Expert level knowledge of Python and SQL.
- Extensive knowledge of data engineering fundamentals; stream / batch processing, functional techniques, dimensional modeling, feature engineering.
- Experience with data transformation frameworks such as dbt or SQLMesh is a strong plus.
- Excellent knowledge of open table formats such as Delta Lake and Iceberg, and compute frameworks such as Spark.
- Extensive experience with relational databases. Experience with graph processing or graph databases is a plus.
- Experience with orchestrators such as Dagster, Prefect, or Airflow. Familiarity with Kubernetes is a strong plus.
Pay Transparancy
Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location, as well as the knowledge, skills and experience of the candidate. In addition to a competitive base salary, this position is eligible for equity awards and may be eligible for incentive compensation based on factors such as experience, skills, and location.
At Obsidian, we are proud to be an equal-opportunity employer. We value diversity and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of identity and legal authorization. If you have a need that requires accommodation, please contact accommodations@obsidiansecurity.com
Information collected and processed as part of any job applications you choose to submit is subject to Obsidian’s Applicant Privacy Policy.
Base Salary Range
$179,000—$228,000 USD
Employee Benefits:
Our competitive benefits packages are designed to support our employees' well-being, both at work and at home.
- Competitive compensation with equity and 401k
- Comprehensive healthcare with dental and vision coverage
- Flexible paid time off and paid holiday time off
- 12 weeks of new parent or family leave
- Personal and professional development resources
Top Skills
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
