Data Engineer

Verana Health, a digital health company that delivers quality drug lifecycle and medical practice insights from an exclusive real-world data network, recently secured a $150 million Series E led by Johnson & Johnson Innovation – JJDC, Inc. (JJDC) and Novo Growth, the growth-stage investment arm of Novo Holdings. 

Existing Verana Health investors GV (formerly Google Ventures), Casdin Capital, and Brook Byers also joined the round, as well as notable new investors, including the Merck Global Health Innovation Fund, THVC, and Breyer Capital.

We are driven to create quality real-world data in ophthalmology, neurology and urology to accelerate quality insights across the drug lifecycle and within medical practices. Additionally, we are driven to advance the quality of care and quality of life for patients. DRIVE defines our internal purpose and is the galvanizing force that helps ground us in a shared corporate culture. DRIVE is: Diversity, Responsibility, Integrity, Voice-of-Customer and End-Results. Click here to read more about our culture and values. 

 Our headquarters are located in San Francisco, and priority will be given to those candidates matching the qualifications and located in San Francisco who are interested in being in office. We have additional offices in Knoxville, TN and New York City with employees working remotely in AZ, CA, CO, CT, FL, GA, IL, LA, MA, MN, NC, NJ, NY, OH, OR, PA, TN, TX, UT , VA, WA, WI. All employees are required to have permanent residency in one of these states. 

Candidates based in the Bay Area, New York City, and Knoxville, Tennessee will be give priority consideration. For these locations, the position will follow a hybrid work model, with 3 days per week in office and the remaining days working from home. 

*Applicants must be authorized to work for any employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Job Title: Data Engineer

Job Intro:

The Data Engineering team is dedicated to build the end to end engineering platform at Verana Health using cloud based solutions that are engineered for scale, availability and high performance in a distributed data processing environment.

Job Duties and Responsibilities:

We are looking for a self-starter to join our Data Engineering team. You will work in a fast-paced environment where you will get an opportunity to build and contribute to the full lifecycle development and maintenance of the data engineering platform at Verana Health.

With the Data Engineering team you will get an opportunity to - 

• Design and implement data engineering solutions that is scalable, reliable and secure on the Cloud environment
• Understand and translate Verana Health’s business needs into data engineering solutions 
• Build large scale data pipelines that can handle big data sets using distributed data processing techniques that supports the efforts of the data science and data application teams
• Partner with cross-functional stakeholder including Product managers, Architects, Data Quality engineers, Application and Quantitative Science end users to deliver engineering solutions
• Contribute to defining data governance across the Verana Health data platform

Basic Requirements:

• A minimum of a BS degree in computer science, software engineering, or related scientific discipline is desired
• 2+ years of experience with Databricks, experience with Databricks is vital to this role 
• 3+ Advanced SQL coding and query optimization experience including the ability to write analytical and nested queries
• 3+ years of experience in building scalable ETL/ ELT Data Pipelines on Databricks and AWS (EMR)
• 3+ years of work experience in building scalable and robust data engineering solutions
• Strong understanding of Object Oriented programming and proficiency with programming in Python (TDD) and Pyspark to build scalable algorithms
• 3+ years of experience in distributed computing and big data processing using the Apache Spark framework
  • including Spark optimization technique, Delta tables, unity catalog, Delta Sharing, Delta live tables(DLT)  and incremental data processing 
• Experience with Delta lake, Unity Catalog
• 2+ Experience of orchestrating data pipelines using Apache Airflow/ MWAA
• Understanding and experience of AWS Services that include ADX, EC2, S3
• 3+ years of experience with data modeling techniques for structured/ unstructured datasets
• Experience with relational/columnar databases - Redshift, RDS and interactive querying services - Athena/ Redshift Spectrum
• Passion towards healthcare and improving patient outcomes
• Demonstrate analytical thinking with strong problem solving skills
• Stay on top of emerging technologies and posses willingness to learn

Bonus:

• Experience with Agile environment
• Experience operating in a CI/CD environment
• Experience building HTTP/REST APIs using popular frameworks
• Healthcare experience

Benefits:

• We provide 100% health, vision, and dental coverage for employees 
• 401K Match
• Flexible vacation plans 
• $700 learning and wellness annual stipend 
• $25/wk in Doordash credit 
• Headspace meditation app access

Final note:

You do not need to match every listed expectation to apply for this position. Here at Verana, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.