Big Data DevOps Lead

Posted 4 Days Ago
Easy Apply
Be an Early Applicant
Hiring Remotely in San Francisco
Remote
Hybrid
Senior level
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Role
The Senior or Lead Big Data DevOps Engineer will manage and optimize Big Data infrastructure across cloud environments. Responsibilities include enhancing efficiency, driving cross-team initiatives, managing architecture efforts, ensuring system reliability, and supporting operational tools and practices.
Summary Generated by Built In

Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.


Main Responsibilities:
• Driving improvement of the efficiency of Big Data infrastructure.

  • Coordinating cross-team infrastructure and Big Data initiatives.
  • Leading Big Data – related architecture and design efforts.
  • Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
  • Building and supporting tools for operational tasks.
    • Evaluating, designing, deploying monitoring tools.
  • Design and implementation of DR/BC practices and procedures.
  • On-call support of production systems.


Requirements:
• 7+ years of experience working with Hadoop, preferably Open Source.

  • 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
  • Experience setting up and running Hadoop clusters of 1000+ nodes.
  • Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
  • Experience running and troubleshooting Kafka.
  • Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.
    • Proficiency in shell scripting.


Nice to have:
• Experience with Prometheus.

  • Experience managing Showflake.
    • Solid knowledge of Graphite and Grafana.
  • Python or Perl scripting skills.
  • Experience with installing and managing Aerospike.
  • DBA experience with one of: PostgreSQL, MySQL, MariaDB.

Top Skills

Hadoop
Perl
Python
The Company
San Francisco, CA
1,650 Employees
Hybrid Workplace
Year Founded: 2007

What We Do

 Zeta Global (NYSE: ZETA) is the Data-Powered Marketing Cloud that leverages advanced artificial intelligence (AI) and trillions of consumer signals to make it easier for marketers to acquire, grow, and retain customers more efficiently.

Through the Zeta Marketing Platform (ZMP), our vision is to make sophisticated marketing simple by unifying identity, intelligence, and omnichannel activation into a single platform – powered by one of the industry’s largest proprietary databases and AI.

Our enterprise customers across multiple verticals are empowered to personalize experiences with consumers at an individual level across every channel, delivering better results for marketing programs. Zeta was founded in 2007 by David A. Steinberg and John Sculley and is headquartered in New York City with offices around the world. To learn more, go to www.zetaglobal.com.

Why Work With Us

Zeta is deeply committed to enriching our people’s wellbeing and growth throughout their career journeys. Our autonomous environment gives our teammates the freedom and space to grow, be creative, and come up with innovative solutions to reinvent consumer experiences and impact brand growth.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Zeta Global Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

Typical time on-site: Flexible
San Francisco, CA

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account