- Location
- Louisville - West Market, United States of America · Louisville - Eastpoint · Louisville - Lily
- Workplace
- Hybrid
- Type
- Full-time
- Department
- Engineering
- Experience
- 5+ years
- Source
- Workday
Description
Company:
MarshDescription:
We are seeking a Data Engineer to join our Applications Development team at Marsh. This is a hybrid role that has a requirement of working at least three days a week in the office. As a Data Engineer at Marsh, you will conceptualize and implement the setup and management of the data platform built Databricks services across different regions.
We will count on you to:
- Collaborate with stakeholders to understand data requirements and translate them into technical specifications
- Design, develop, and implement data pipelines and ETL processes, ensuring thorough unit testing to validate functionality and performance.
- Implement data quality checks and validation processes to ensure the accuracy and integrity of data throughout the pipeline
- Coordinate with cross-functional teams to ensure alignment on project goals, timelines, and deliverables
- Continuously monitor data workflows and pipelines for performance, reliability, and efficiency, implementing improvements as necessary
- Create and maintain comprehensive documentation for data processes, architecture, and workflows to ensure knowledge sharing and compliance
What you need to have:
- Bachelor’s degree in computer science, Data Science, Information Technology, or a related field
- Proficiency in programming languages such as Python and SQL, along with experience in data modeling and database design
- 5+ years of experience working as a Data Engineer and possess a strong understanding of ETL and ELT concepts
- Experience with API integration and Data ingestion from various sources, ensuring seamless data flow between systems
- Experience with data testing (functional and automated) including proper documentation procedures and automation principles
What makes you stand out:
- Familiarity with data processing frameworks, particularly Apache Spark.
- Experience working with cloud platforms such as AWS or Azure
- Experience with AI integration on test environments
- Ability to manage QA Engineers and guide through SCRUM calls
- Familiarity with data warehousing solutions and technologies, including Databricks and Snowflake.
Why join our team:
- We help you be your best through professional development opportunities, interesting work and supportive leaders.
- We foster a vibrant and inclusive culture where you can work with talented colleagues to create new solutions and have impact for colleagues, clients and communities.
- Our scale enables us to provide a range of career opportunities, as well as benefits and rewards to enhance your well-being.