Easy Apply
Easy Apply
As a Big Data DevOps Lead, you will improve Big Data infrastructure efficiency, lead architecture efforts, and provide on-call support for production systems.
Summary:
As a Senior or Lead Big Data DevOps Engineer, you will be working with a team responsible for setting up, scaling, and maintaining Big Data infrastructure and tools in private and public cloud environments.
Main Responsibilities:
• Driving improvement of the efficiency of Big Data infrastructure.
- Coordinating cross-team infrastructure and Big Data initiatives.
- Leading Big Data – related architecture and design efforts.
- Ensuring availability, efficiency, and reliability of the Big Data infrastructure.
- Building and supporting tools for operational tasks.
• Evaluating, designing, deploying monitoring tools. - Design and implementation of DR/BC practices and procedures.
- On-call support of production systems.
Requirements:
• 7+ years of experience working with Hadoop, preferably Open Source.
- 3+ years of leading Big Data, DevOps, SRE, DBA, or development team.
- Experience setting up and running Hadoop clusters of 1000+ nodes.
- Solid knowledge of NoSQL databases, preferably Cassandra or ScyllaDB.
- Experience running and troubleshooting Kafka.
- Working knowledge of at least one of: Terraform, Ansible, SaltStack, Puppet.
• Proficiency in shell scripting.
Nice to have:
• Experience with Prometheus.
- Experience managing Showflake.
• Solid knowledge of Graphite and Grafana. - Python or Perl scripting skills.
- Experience with installing and managing Aerospike.
- DBA experience with one of: PostgreSQL, MySQL, MariaDB.
Top Skills
Aerospike
Ansible
Cassandra
Grafana
Graphite
Hadoop
Kafka
Mariadb
MySQL
NoSQL
Perl
Postgres
Prometheus
Puppet
Python
Saltstack
Scylladb
Shell Scripting
Showflake
Terraform
Zeta Global San Francisco, California, USA Office
201 California Street, Suite 950, San Francisco, CA, United States, 94111
Similar Jobs at Zeta Global
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Analyst will collaborate with clients to drive marketing performance through data insights, utilizing advanced analytics and machine learning techniques.
Top Skills:
PythonSQLTableau
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Business Systems Analyst leads project scoping and documentation, defining solutions for client implementations while ensuring communication among teams and stakeholders. Strong database architecture, CRM, and marketing knowledge is essential for success in this role.
Top Skills:
CdpCRMDatabase MarketingEmail MarketingMS OfficeRestful ApisWeb-Services
AdTech • Artificial Intelligence • Marketing Tech • Software • Analytics
The Senior Software Engineer will design and maintain data infrastructure, coordinate with analysts on ETL processes, and collaborate on data products while ensuring data quality and availability.
Top Skills:
AirflowAWSFastapiHivePythonSnowflakeSpark
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
