The Baldwin Group Logo

The Baldwin Group

Senior Data Engineer - IT Growth Services

Job Posted 18 Days Ago Posted 18 Days Ago
Remote
2 Locations
Senior level
Remote
2 Locations
Senior level
The Senior Data Engineer designs and maintains data infrastructure on AWS, collaborates with teams, ensures data quality, and mentors junior engineers.
The summary above was generated by AI

The Baldwin Group is an award-winning entrepreneur-led and inspired insurance brokerage firm delivering expertly crafted Commercial Insurance and Risk Management, Private Insurance and Risk Management, Employee Benefits and Benefit Administration, Asset and Income Protection, and Risk Mitigation strategies to clients wherever their passions and businesses take them throughout the U.S. and abroad. The Baldwin Group has award-winning industry expertise, colleagues, competencies, insurers, and most importantly, a highly differentiated culture that our clients consider an invaluable expansion of their business. The Baldwin Group (NASDAQ: BWIN), takes a holistic and tailored approach to insurance and risk management.

Position Summary:

The Senior Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports the organization's data needs on AWS Cloud. This role involves working closely with data scientists, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for performance. The ideal candidate will have extensive experience in data engineering, data orchestration, strong problem-solving skills, and the ability to lead and mentor junior team members.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL processes to ingest, process, and store large volumes of data from various sources.
  • Build and optimize data architectures, including data warehouses, data lakes, and databases, to support analytics and business intelligence efforts.
  • Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions that meet those needs.
  • Ensure data quality, integrity, and security by implementing best practices for data governance and management.
  • Monitor and troubleshoot data pipelines and infrastructure to ensure high availability and performance.
  • Support/Lead aspects of SDLC and deployment of code and/or cloud infrastructure components.
  • Implement and maintain data integration solutions, including APIs and data connectors, to facilitate data exchange between systems.
  • Lead and mentor junior data engineers, providing guidance and support in their professional development.
  • Stay current with emerging data engineering technologies and best practices and recommend improvements to existing systems.
  • Document data engineering processes, architectures, and workflows to ensure knowledge sharing and continuity.

Qualifications:

  • Bachelor’s or Master’s degree in Computer Science, Information Systems, Data Engineering, or a related field.
  • Minimum of 7 years of experience in data engineering, with a focus on building and maintaining data pipelines and architectures.
  • Experience with Databricks on AWS and its ecosystem, including Delta Lake, Databricks SQL, and Databricks Workflows.
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong experience with data processing frameworks and tools such as Apache Spark, Hadoop, or similar.
  • Experience with ETL tools (e.g., Fivetran, Apache Airflow, MuleSoft).
  • Experience with Infrastructure as Code (IaC) tools such as Terraform.
  • Proficiency in SQL and experience with relational databases (e.g., SQL Server, MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Experience with cloud-based data platforms (AWS) and their data services (e.g., Redshift).
  • Knowledge of data warehousing concepts and experience with data modeling and schema design.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills, with the ability to convey complex technical concepts to non-technical stakeholders.
  • Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Relevant certifications (e.g., AWS Certified Data Analytics, Databricks) are a plus.
  • Presentation: must demonstrate clear, concise articulation of proposed actions, illustrating opportunity, alternatives, recommendation, and associated economics

Special Working Conditions:

Fast paced, multi-tasking environment.

Remote position with minimal travel required for quarterly meetings.

Important Notice:This position description is intended to describe the level of work required of the person performing in the role and is not a contract.  The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be modified to reasonably accommodate physically or mentally challenged colleagues.

#LI-JK1

Click here for some insight into our culture!

The Baldwin Group will not accept unsolicited resumes from any source other than directly from a candidate who applies on our career site. Any unsolicited resumes sent to The Baldwin Group, including unsolicited resumes sent via any source from an Agency, will not be considered and are not subject to any fees for any placement resulting from the receipt of an unsolicited resume.

Top Skills

Apache Airflow
Spark
AWS
Cassandra
Databricks
Databricks Sql
Databricks Workflows
Delta Lake
Docker
Fivetran
Hadoop
Java
Kubernetes
MongoDB
Mulesoft
MySQL
Postgres
Python
Redshift
Scala
SQL
SQL Server
Terraform

Similar Jobs

6 Hours Ago
Easy Apply
Remote
Hybrid
US
Easy Apply
Senior level
Senior level
Marketing Tech • Social Media • Software • Analytics • Business Intelligence
Lead development of statistical models and data analysis to support go-to-market strategies, translating data insights into actionable strategies for stakeholders.
Top Skills: AWSAzureGCPPythonSQLTableau
8 Hours Ago
Remote
Hybrid
7 Locations
195K-343K Annually
Senior level
195K-343K Annually
Senior level
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Machine Learning Modeler focuses on validating ML models for financial services, developing tools for scalability and governance, and ensuring compliance with regulations. Strong software engineering and communication skills are essential, alongside experience in model risk management.
Top Skills: Automated TestingLlmMachine LearningModel GovernancePythonSQLXgboost
Yesterday
Remote
San Francisco, CA, USA
169K-271K Annually
Senior level
169K-271K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead Atlassian's Data Engineering Team in building scalable data solutions, ensuring operational data quality, architecting data systems, and mentoring engineers.
Top Skills: AirflowAWSDatabricksFlinkHiveKafkaRedshiftSparkSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account