The Baldwin Group Logo

The Baldwin Group

Director, Data Engineering and Platform - The Baldwin Group

Job Posted 6 Days Ago Posted 6 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
The Director of Data Engineering is responsible for leading a team to design and maintain data infrastructure, focusing on strategy, collaboration, and technology implementation to support business objectives.
The summary above was generated by AI

The Director of Data Engineering will be responsible for overseeing the design, development, and maintenance of our data infrastructure. This role will lead a team of data engineers and platform administrators and collaborate with cross-functional teams to ensure the efficient and effective orchestration use of data across the organization. The ideal candidate will have a strong technical background, excellent leadership skills, and a passion for data-driven decision-making.

Primary Responsibilities:

Responsibilities include managing the Data Engineering team and all associated people, processes, and technology responsible for building new data capabilities and maturing our data platform. The Director will act as platform owner for our enterprise data lake and data platform. They will work closely with leaders and data architect to support and implement scalable and sustainable, data-driven solutions. The right person for the job will apply their knowledge of data strategies, modern data architectures, and data technologies to provide thought leadership and inform decisions solving real-world problems faced by our company.

Additional Key Responsibilities:

Leadership and Management:

  • Provide input into data the data strategy and thought leadership on data engineering best practices.
  • Develop and implement the data engineering strategy, aligning it with the data strategy and overall business objectives.
  • Lead and manage the data engineering team, providing mentorship, guidance, and career development opportunities.
  • Foster a collaborative and innovative team environment.
  • Set clear goals and performance expectations for the team.

Data Engineering:

  • Design, build, and maintain scalable and reliable data pipelines, ETL processes, and data orchestration.
  • Design, build and maintain scalable and reliable data Lakehouse with harmonized data marts.
  • Drive the adoption of best practices in data engineering, including coding standards, testing, and documentation.
  • Develop and implement quality controls and departmental standards to ensure quality standards, organizational expectations, and regulatory requirements.

Collaboration and Communication:

  • Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions that support business goals.
  • Manage relationships with external vendors and partners, ensuring the effective use of third-party tools and services.
  • Partner with Data Management to clarify requirements, coordinate testing, and ensure data is properly governed.
  • Present findings and recommendations to senior leadership and other stakeholders.
  • Develop and maintain relationships with key stakeholders, acting as a trusted advisor and subject matter expert on data and analytics.

Technology and Tools:

  • Stay current with industry trends and emerging technologies, evaluating their potential impact on the organization.
  • Evaluate and implement new analytics tools and platforms as needed.
  • Provides solutions that may set precedent or have significant impact.
  • Ensure the efficient use of existing analytics tools and resources.

Project Management:

  • Monitor and optimize the performance of data systems, identifying and addressing bottlenecks and inefficiencies.
  • Develop and manage the data engineering budget, ensuring the efficient allocation of resources.
  • Manage portfolio of engineering projects ensuring adherence to deadlines/commitments.
  • Prioritize projects based on business impact and resource availability.
  • Monitor project progress and address any issues that arise.

Qualifications:

  • Bachelor's degree in a related field (e.g. Computer Science, Information Systems, Statistics, etc.)

  • 10+ years of experience in data engineering or a related field, with at least 5 years in a leadership role.

  • Strong proficiency in programming languages such as Python, Java, or Scala.

  • Extensive experience with data warehousing solutions (e.g., Databricks, Snowflake) and ETL tools (e.g., Fivetran, Apache Airflow, MuleSoft).

  • Deep understanding of database systems, data modeling, and data architecture.

  • Experience with cloud platforms (e.g., AWS, Azure) and big data technologies (e.g., Hadoop, Spark).

  • Proven track record of successfully leading and scaling data engineering teams.

  • Strong leadership skills, with the ability to manage and motivate a team of data professionals

  • Experience working with cross-functional teams and leading projects from inception to deployment

  • Excellent problem-solving skills and the ability to think strategically.

  • Strong communication and interpersonal skills, with the ability to collaborate effectively with technical and non-technical stakeholders.

  • Experience with data governance, data privacy, and regulatory compliance is a plus.

  • Presentation: must demonstrate clear, concise articulation of proposed actions, illustrating opportunity, alternatives, recommendation, and associated economics

Special Working Conditions:

Fast paced, multi-tasking environment.

Remote position with minimal travel required for quarterly meetings.

Important Notice:

This position description is intended to describe the level of work required of the person performing in the role and is not a contract.  The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be modified to reasonably accommodate physically or mentally challenged colleagues.

#LI-JK1

Click here for some insight into our culture!

The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.

Top Skills

Apache Airflow
AWS
Azure
Databricks
Fivetran
Hadoop
Java
Mulesoft
Python
Scala
Snowflake
Spark

Similar Jobs

36 Minutes Ago
Remote
Hybrid
Tampa, FL, USA
Mid level
Mid level
Information Technology • Productivity • Software • Infrastructure as a Service (IaaS)
The Sales Compensation Analyst manages sales incentive plans, ensures accurate commission calculations, and collaborates with Sales Ops and HR on compensation matters.
Top Skills: ExcelSalesforceSpiff
4 Hours Ago
Easy Apply
Remote
United States
Easy Apply
Junior
Junior
Healthtech • Software
As an Analytics Engineer II, you will build ETL processes, ensure data quality, and collaborate with cross-functional teams to support healthcare analytics needs.
Top Skills: AWSDbtPysparkPythonSparkSQL
5 Hours Ago
Easy Apply
Remote
United States
Easy Apply
125K-145K Annually
Mid level
125K-145K Annually
Mid level
Healthtech • Insurance • Other • Sales • Software
The Analytics Engineer II will design and maintain ELT data pipelines, automate data processes, ensure data quality, and mentor junior engineers, collaborating across teams to drive actionable insights.
Top Skills: BigQueryDataformDbtGCPHexMetabasePower BIPythonSQLTableau

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account