Plume Design, Inc Logo

Plume Design, Inc

Senior Data Engineer

Job Posted 7 Days Ago Posted 7 Days Ago
Palo Alto, CA
Senior level
Palo Alto, CA
Senior level
As a Senior Data Engineer, you will architect Spark data pipelines, collaborate with teams, enhance data quality, and mentor juniors.
The summary above was generated by AI

Life at Plume

At Plume, we believe that technology isn't about moving faster, it's about making life’s moments better. Which is why we’ve built the world's first, and only, open and hardware-independent service delivery platform for smart homes, small businesses, enterprises, and beyond. Our SaaS platform uses WiFi, advanced AI, and machine learning to create the future of connected spaces—and human experiences—at massive scale.

We now deliver services to over 50 million locations globally and have managed over 2.5 billion devices on our platform. We’re expanding rapidly, pioneering a new category, and we achieved our Series F funding in just four years. Our customers include many of the world's largest Communications Service Providers (CSPs) who look to Plume to help them evolve their smart home offerings while gleaning insights from their own data. 

With a bias for action and a love for being trailblazers, the team at Plume embodies a combination of relentless curiosity and imaginative innovation. We challenge ourselves to think in ways that other companies don't, work to do what should be done (rather than what can), and if we can’t do it exceptionally well, we don’t do it. It’s how we've assembled a team of world-class builders, thinkers, and doers. And it’s how we’re reinventing what’s possible every day.

As a Senior Data Engineer on Plume’s Data Products team, you will play an integral role in shaping the data platform that powers the gamut of Plume’s next generation of products and analytics. You will work with a modern data tech stack and collaborate with cross-platform teams to solve challenging problems on a daily basis.

What you will do:

  • Architect and productionize Spark data pipelines supporting data-oriented products, machine learning, and analytics.
  • Work with cross-functional teams to design end-to-end system architectures and data flows.
  • Adhere to data protection requirements including data access, retention, residency, and de-identification
  • Maintain up-to-date documentation of data warehouse schemas
  • Systematically enhance data quality, availability, and observability
  • Analyze and solve performance, cost, and scale challenges
  • Refactor code as needed to improve performance and simplify operations
  • Provide production support in triaging and fixing issues relating to data quality and availability
  • Mentor junior team members and new hires

What You’ll Bring

  • Education Requirements: BS/MS/PhD in Computer Science, Electrical Engineering or related technical field
  • 6+ years of software development experience with a proven track record of building, scaling, and supporting production data pipelines
  • Intermediate proficiency in writing clean, idiomatic code in Scala or Python
  • Intermediate proficiency in writing SQL in data warehousing technologies
  • Good understanding of distributed data processing technologies (e.g. Apache Spark) and handling data at petabyte scale
  • Good understanding of data warehousing concepts
  • Good analytical and problem-solving skills
  • Good oral and written communication skills

Kindly note that this is a HYBRID position, with a requirement to work in the office 3 days a week. We’re looking for candidates who are within a commutable distance. At this time, we are unable to provide relocation assistance.

Total Compensation package would include: anticipated salary range of $127,000 - $149,000  + bonus + equity + benefits.  Benefits include: a 401k plan and a company match, basic life insurance plus unparalleled health, dental, vision and other benefits and perks. Please see here for more details.

An employee’s base salary and its position within the range may depend on a number of factors including job related knowledge, education, skills, experience and other business related considerations. Published ranges are provided in good faith at the time of posting. 

About Plume

As the creator of the only open, hardware-independent, cloud-controlled experience platform for CSPs and their subscribers, Plume partners with over 350 CSP customers, including some of the world’s largest such as Comcast, Charter, Liberty Global, and J:COM. 

Using OpenSync, the most widely supported open-source, silicon-to-cloud framework for smart spaces, Plume’s software-defined network allows CSPs to decouple their service offerings from hardware and rapidly curate and deliver new services over a multi-vendor, open-platform architecture.  

Backed by investors such as Insight Partners and SoftBank Vision Fund 2, Plume is now valued at $2.6B, having added over $500M in funding in 2021 alone.

Plume is an equal opportunity workplace that maintains a continuing policy of nondiscrimination in all employment practices and decisions, ensuring equal employment opportunities for all qualified individuals without regard to race, color, creed, religion, sex, national origin, age, physical or mental disability, sexual orientation, gender identity, marital status, pregnancy, childbirth or related individual conditions, medical conditions (as defined by state law), military or veteran status, or any other characteristic protected by federal, state or local law.

Top Skills

Spark
Data Warehousing Technologies
Python
Scala
Spark
SQL
HQ

Plume Design, Inc Palo Alto, California, USA Office

325 Lytton Ave,, Palo Alto, CA, United States, 94301

Similar Jobs

6 Hours Ago
Hybrid
San Francisco, CA, USA
167K-209K Annually
Senior level
167K-209K Annually
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Senior Data Engineer at Crunchyroll, you'll design and optimize data services and pipelines, support operational data analysis, and drive automation. Collaborate with teams to enhance systems efficiency and mentor junior engineers.
Top Skills: Apache KafkaAWSAws GlueCloud FormationDatabricksDbtDynamoDBJavaKinesisPythonRdsRedshiftSnowflakeSQLTerraform
9 Days Ago
Remote
Los Angeles, CA, USA
100K-220K Annually
Senior level
100K-220K Annually
Senior level
Information Technology • Software • Consulting
The Sr. Data Engineer will transform on-premise Python applications to cloud-native implementations in a regulated financial environment, collaborating with stakeholders and building data pipelines.
Top Skills: AWSEmrLambdaOraclePostgresPysparkPythonRdsRedshiftSQL
2 Days Ago
Remote
San Francisco, CA, USA
136K-218K Annually
Senior level
136K-218K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll design data models, build scalable data pipelines, and improve data quality, collaborating across teams.
Top Skills: AirflowSparkAthenaAws Data ServicesEmrFlinkHiveJavaKafkaPythonRedshiftSparkSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account