Director, Data Engineering

Director of Data Engineering

Overview:

Shift4 is expanding globally and building out our data engineering team, seeking an experienced Director of Data Engineering with a minimum of 10 years of overall experience, 3 years of management to spearhead our data architecture, pipeline development, and data lake / data warehousing efforts. This role involves not just technical expertise but also leadership in guiding data strategies that empower our business decisions and initiatives.

Responsibilities:

• Data Architecture: Design, implement, and manage our data infrastructure, ensuring scalability, efficiency, and security. This includes defining data schemas, data pipelines, and data storage solutions.
• Leadership & Mentorship:
• Lead a team of ~10 data engineers, setting standards for data handling, integration, and warehousing.
• Mentor junior team members, fostering a culture of continuous learning and improvement.
• Pipeline Development:
• Develop robust ETL (Extract, Transform, Load) processes to ingest, process, and transform data from various sources.
• Optimize data flow and storage for speed, scalability, and reliability.
• Data Quality and Governance:
• Establish and enforce data quality standards and governance policies.
• Implement data validation processes to ensure data integrity.
• Analytics and Reporting:
• Collaborate with data scientists and analysts to tailor data solutions that meet analytical requirements.
• Support the creation of BI tools, dashboards, and reports by providing clean, structured data.
• Innovation:
• Research and recommend new technologies and tools to improve data management and processing.
• Drive the adoption of best practices in data engineering, like data lake architectures, streaming data, and real-time analytics.
• Project Management:
• Oversee data-related projects from conception to completion, including planning, execution, and delivery.
• Ensure project timelines, quality, and objectives are met.
• Cross-functional Collaboration: Work closely with business stakeholders, product
  managers, and other engineering teams to align data strategy with business goals.

Qualifications:

• Education: Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or related field or experience in lieu of a degree may be considered. 
• At least 10 years of experience in data engineering or a similar discipline.
• At least 3 years of experience in managing data engineers or a similar discipline.
• Experienced conducting 1:1s, fostering growth plans, and managing engineering velocity.
• Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark).
• Strong coding skills in languages like Python, Java, Scala, Node JS, Golang, etc…
• Experience with cloud services (AWS, Azure, Google Cloud) for data solutions.
• Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Familiarity with data modeling, ETL tools, and data pipeline orchestration tools (e.g., Airflow, Luigi).
• Understanding of machine learning pipelines and feature engineering is a plus.
• Excellent analytical and problem-solving skills.
• Strong communication skills to effectively articulate complex data concepts to non-technical stakeholders.
• Certifications: AWS Certified Big Data - Specialty, Google Professional Data Engineer, or similar.