Craft.co Logo

Craft.co

Sr. Data Engineer (US)

Job Posted 16 Days Ago Posted 16 Days Ago
Remote
160K Annually
Senior level
Remote
160K Annually
Senior level
As a Senior Data Engineer, you'll build and optimize data pipelines, manage diverse datasets, and incorporate emerging technologies, ensuring reliable data strategies. You'll collaborate within a team to enhance data processing systems and apply machine learning techniques.
The summary above was generated by AI

About Craft:

Craft is the leader in supplier risk intelligence, enabling enterprises to discover, evaluate, and continuously monitor their suppliers at scale. Our unique, proprietary data platform tracks real-time signals on millions of companies globally, delivering best-in-class monitoring and insight into global supply chains. Our customers include Fortune 500 companies, government agencies, SMEs, and global service platforms. Through our configurable Software-as-a-Service portal, our customers can monitor any company they work with and execute critical actions in real-time. We’ve developed distribution partnerships with some of the largest integrators and software platforms globally.

We are a post-Series B high-growth technology company backed by top-tier investors in Silicon Valley and Europe, headquartered in San Francisco with hubs in Seattle and London. We support remote and hybrid work, with team members across North America, Canada, and Europe.

We're looking for innovative and driven people passionate about building the future of Enterprise Intelligence to join our growing team!

About the Role:

Craft is looking for an experienced and motivated senior-level Data Engineer to join one of our teams responsible for a key product within the organization. As a core member of this team you will have a great say in how solutions are engineered and delivered. Craft gives engineers a lot of responsibility and authority, which is matched by our investment in their growth and development.

We’re growing quickly and looking to hire data engineers for multiple teams. We’re always looking for folks with strong data engineering experience, Python coding experience, Pandas expertise, and solid software engineering practices. In addition to those skills, we’re looking for two different categories of data engineers. If you feel that your experience aligns with one or both of the categories below, we have a place for you!

  1. Someone who has experience with data lakes and data warehousing, graph databases and knowledge graphs

  2. Someone who has experience with streaming and batching of data from data partners and building data pipelines for transactional use, as well as experience with API development, FastAPI, and asyncio.

This is a remote role, but we have a strong preference for candidates based in Eastern or Central time zones due to the current team members’ time zones.

What You’ll Do:

  • Building and optimizing data pipelines (batch and streaming).

  • Extracting, analyzing and modeling rich and diverse datasets of structured and unstructured data.

  • Designing software that is easily testable and maintainable.

  • Support in setting data strategies and our vision.

  • Keep track of emerging technologies and trends in the Data Engineering world, incorporating modern tooling and best practices at Craft.

  • Work on extendable data processing systems that allows to add and scale pipelines.

  • Applying machine learning techniques such as anomaly detection, clustering, regression classification, and summarization to extract value from our data sets.

Who You Are:

  • 4+ years of experience in Data Engineering.

  • 4+ years of experience with Python.

  • Experience in developing, maintaining, and ensuring the reliability, scalability, fault tolerance, and observability of data pipelines in a production environment.

  • Strong knowledge of SDLC and solid software engineering practices.

  • Knowledge and experience with Amazon Web Services (AWS) and Databricks (nice to have).

  • Demonstrated curiosity through asking questions, digging into new technologies, and always trying to grow.

  • Strong problem solving and the ability to communicate ideas effectively.

  • Familiar with infrastructure-as-code approach.

  • Self-starter, independent, likes to take initiative.

  • Have fundamental knowledge of data engineering techniques: ETL/ELT, batch and streaming, DWH, Data Lakes, distributed processing.

  • Familiarity with at least some technologies in our current tech stack:

    • Python, PySpark, Pandas, SQL (PostgreSQL), ElasticSearch, Airflow, Docker

    • Databricks, AWS (S3, Batch, Athena, RDS, DynamoDB, Glue, ECS, Amazon Neptune)

    • CircleCI, GitHub, Terraform

What We Offer:

  • Competitive salary starting at $160,000 USD/ year. This starting number can be increased based on levels of expertise, location, cost of living, taxes, market experience, etc.

  • Equity at a well-funded, fast-growing startup

  • Unlimited vacation time so you can take what you need, when you need it

  • 99% covered health + dental + vision insurance for employees and dependents

  • 401K through Empower with options to invest how you want it

A Note to Candidates:

We are an equal opportunity employer who values and encourages diversity, equity and belonging at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, caste, or disability status.

Don’t meet every requirement? Studies have shown that women, communities of color and historically underrepresented talent are less likely to apply to jobs unless they meet every single qualification. At Craft, we are dedicated to building a diverse, inclusive and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we strongly encourage you to apply. You may be just the right candidate for this or other roles!


#BI-Remote

Top Skills

Airflow
AWS
CircleCI
Databricks
Docker
Elasticsearch
Git
Pandas
Postgres
Pyspark
Python
SQL
Terraform
HQ

Craft.co San Francisco, California, USA Office

41 Sutter Street, San Francisco, CA, United States, 94104

Similar Jobs

7 Days Ago
Easy Apply
Remote
Hybrid
3 Locations
Easy Apply
Senior level
Senior level
AdTech • Big Data • Information Technology • Marketing Tech • Sales • Software
As a Senior Data Engineer, you will develop and maintain ETL pipelines, design scalable systems, troubleshoot production issues, and mentor team members while ensuring best practices are followed.
Top Skills: AirflowBigQueryDataflowGoogle Cloud PlatformKubernetesPub/SubPythonSQL
6 Days Ago
Remote
Hybrid
US
Senior level
Senior level
Cloud • Insurance • Payments • Software • App development • Big Data Analytics
As a Senior Data Engineer, you'll develop and optimize scalable data solutions, enhance infrastructure, automate ETL workflows, and support BI initiatives.
Top Skills: BigQueryCloud StorageDataflowLookerPower BIPub/SubPythonSQLTableauTerraform
5 Hours Ago
Remote
USA
Senior level
Senior level
Software
As a Senior Data Engineer, you will develop and maintain data pipelines, collaborate with stakeholders, and deliver solutions in an agile environment.
Top Skills: AWSIacPythonSnowflakeTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account