Shift5 Logo

Shift5

Data Engineer

Job Posted 3 Days Ago Reposted 3 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
As a Data Engineer, you will design and build data processing pipelines, collaborate across teams, and ensure data accuracy and integrity while developing scalable applications.
The summary above was generated by AI

Shift5 is the observability platform for onboard operational technology (OT). We’re a rapidly growing scale-up that specializes in cybersecurity, predictive maintenance, and compliance for operational technology (OT) systems across defense, aerospace, and rail. We are a collaborative, passionate, and driven cadre of dynamic, multidisciplinary experts and we’re focused on helping our customer’s fleets run smarter and safer by accessing and democratizing the volumes of onboard OT data generated by transportation and freight fleets, and defense fleets and weapon systems. Come join us. 

Our Values:

  • Embrace Truth and Integrity: Base decisions on data, foster open dialogue, and uphold unwavering integrity.
  • User-Centric Focus: Prioritize user needs to guide our actions and resource allocation.
  • Collaborative & Adaptable: Collaborate for excellence, learning from failures and driving iterative improvements, recognizing every decision's significance.

Shift5 is seeking a Data Engineer to join our growing team. In this role, your primary responsibilities will be to:

  • Interpret requirements and design specifications and take ownership of building features from the ground up.
  • Write clean, well-documented, scalable, extensible, testable code to ensure application quality and maintainability.
  • Work cross-functionally across Shift5 engineering teams to build applications that integrate cleanly across other Shift5 componentry.
  • Design, build, and maintain data processing, storage, and integration pipelines.
  • Build robust and scalable data products for various stakeholders including data scientists, transportation engineers, and executives that drive insights and decision making.
  • Create solutions that utilize AWS cloud services that are efficient, reliable, cost-effective, dynamically scalable, and observable.
  • Collaborate with data scientists and engineers to create semantic data models to represent complex vehicular systems.
  • Perform analysis on complex data sets to create data ontologies, verify data quality/integrity, and ensure accuracy of data after passing through data pipelines.

You’ll operate in a team-based environment with engineers, product managers, program managers and designers to conceive, implement and shape major features. Engineers are key contributors in shaping this design process and you’ll be a major factor in generating high-impact products that literally save lives. This role resides in our Product Engineering team and reports to our Director, Software Engineering.

Shift5 is a rapidly growing data and cybersecurity scale-up. We specialize in capturing and analyzing vehicular bus data in real time, providing anomaly detection and operational intelligence required to act. Our insights provide real-time alerting and historical trends to assure mission readiness and cyber survivability, and our innovative technology enables military systems to deter adversaries, protect warfighters, and maintain their competitive edge. We are a collaborative, passionate and driven cadre of cyber security experts. Our engineers are multidisciplinary, and our team is dynamic. We’re a growing company focused on helping our customer’s fleets run smarter and safer by capitalizing on mountains of data resting right about the wheels. Come join us!

Qualifications:

Required : 

  • 5+ years software/data engineering.
  • 3+ years experience with a major programming language (GoLang, Java, Python)
  • 3+ years experience with of relational database experience (PostgreSQL, MySQL, Oracle, etc.).
  • 3+ years experience with Big Data (Hadoop, Spark) and Data Modeling.
  • 2+ years experience with containerization and cloud services: Docker, Kubernetes, cloud monitoring tools.
  • Proven experience building complex data applications from scratch including requirements gathering, design, planning, and implementation.
  • Familiar with modern data stack components including data ingestion, transformation, and orchestration.
  • Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos.
  • Demonstrated delivery of scalable, observable, supportable, reliable data processing applications.
  • Deep understanding of software engineering practices and concepts.
  • Experience with end-to-end feature design and ownership.
  • Comfortable working in a fast-paced environment.
  • Ability to efficiently multitask and accommodate change of priorities on demand.

Preferred : 

  • Active US Government TS clearance (and willingness to maintain) or an ability to obtain one. US Citizenship.
  • MS in Computer Science, Cybersecurity, Cyber Intelligence, or equivalent.
  • Experience and understanding of data lakes/warehouses (e.g. Snowflake, Databricks, Redshift).
  • Proficiency with CI/CD, source control, design reviews, and integrating observable practices.
  • Strong verbal and written skills.
  • Excellent analytical and problem-solving abilities.
  • Ability to work effectively in a team and with cross-functional groups.

Compensation & Benefits:

  • Base Salary: $150,000-$200,000
  • Bonus program and equity in a fast-growing startup
  • Competitive medical, dental, and vision coverage for employees and their families
  • Health Savings Account with annual employer contributions
  • Employer-paid Life and Disability Insurance 
  • Uncapped paid time off policy
  • Flexible work & remote work policy
  • Tax-deferred public transit benefits with Metro SmartBenefits (DC/MD/VA) 

We are committed to building an inclusive culture of belonging that embraces the diversity of our people and represents the communities in which we work and the customers we serve. We know the happiest and highest performing teams include people with diverse perspectives and ways of solving problems. We strive to attract and retain talent from all backgrounds and create workplaces where everyone feels empowered to bring their full, authentic selves to work.  

Shift5 is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sexual orientation, gender identity, national origin, disability, age, marital status, ancestry, projected veteran status, or any other protected group or class.

Privacy Policy and Notice for Shift5, Inc. Job Applicants, Employees & Contractors


Top Skills

Apache Airflow
Benthos
Databricks
Docker
Go
Hadoop
Java
Kubernetes
MySQL
Oracle
Postgres
Python
Redshift
Snowflake
Spark

Similar Jobs

2 Hours Ago
Remote
San Francisco, CA, USA
116K-187K Annually
Mid level
116K-187K Annually
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you'll build data models and pipelines, optimize data storage and retrieval, and work collaboratively to enhance data-driven solutions.
Top Skills: AirflowAWSPythonSparkSpark-SqlSQL
14 Hours Ago
Remote
Hybrid
Colorado, USA
Senior level
Senior level
Information Technology • Software • Analytics • Business Intelligence • Consulting
As a Data Engineer, you'll create data models, ETL scripts, and API connections, automating data processes and performing debugging in a fast-paced Agile environment.
Top Skills: Amazon RedshiftAPIsETLNice CxonePythonRestSnowflakeSQL
23 Hours Ago
Remote
United States
99K-127K Annually
Mid level
99K-127K Annually
Mid level
Cloud • Hardware • Healthtech • Information Technology • Mobile • Other • Infrastructure as a Service (IaaS)
The QA Data Engineer will develop and maintain QA processes to enhance data quality in data-driven applications, focusing on validation, verification, and performance testing.
Top Skills: MS OfficeMs TeamsNoSQLPythonScalaSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account