Enhance a Python-based ingestion framework for operational metadata and build connectors for major systems in data and ML stacks.
At Acryl Data, we bring clarity to data by enabling delightful search and discovery, data observability, and federated governance across your entire data ecosystem.
Acryl Data is well funded by top tier VCs (8VC, LinkedIn), and is dedicated to building and serving a thriving open source community and product.
In this role, you will
- Enhance the Python based ingestion framework to support ingesting usage statistics, lineage and operational metadata from systems like Snowflake, Redshift, Kafka, & more!
- Build connectors for major systems in the modern data and ML stacks
- Enable the ingestion framework to run in a cloud native environment
Requirements:
- Minimum 4 years of engineering experience
- Expertise in Python
- Familiarity with tools in the modern data and ML ecosystem
- Knowledge of distributed systems
- Ability to design for scale and fault tolerance
Top Skills
Kafka
Python
Redshift
Snowflake
Acryl Data Mountain View, California, USA Office
148 Castro St., Mountain View, CA, United States, 94041
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
You will redesign and build lab environments, support development for CrowdStrike's Next-Gen SIEM, and collaborate with various engineering teams, maintaining security controls and documentation.
Top Skills:
Active DirectoryAWSAzureCloudFormationDhcpDnsGitGroup PolicyHumio Query LanguageIisMicrosoft ExchangePowershellPythonTerraform
Machine Learning • Payments • Security • Software • Financial Services
The Senior Software Engineer designs and develops software solutions, writes code, and ensures maintainability while leading a team in delivering high-quality tech solutions.
Top Skills:
Cobol,Jcl,Vsam,Db2,Easytrieve,Zos,Rest Apis
Fintech • Information Technology • Payments • Software • Financial Services
As a Software Engineer, you will enhance existing trading protocols, improve system performance, and collaborate with cross-functional teams in a financial tech environment.
Top Skills:
AeronAkkaDockerGrpcKafkaKubernetesRabbitMQScalaTcp/IpZio
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
