(AME4852) AWS Senior Data Engineer

POSITION IS LOCATED IN TORRANCE, CA

Responsibilities:
We are looking for an experienced Senior Data Engineer with strong hands-on expertise in AWS data engineering, ETL/ELT development, data warehousing, and large-scale data processing. The candidate will design, develop, and optimize scalable data pipelines while ensuring data quality, reliability, performance, and cost efficiency.

Must Have experience:

• 7+ years of experience in data engineering, database design, ETL processes, and data warehousing.
• 5+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, RDS, Spectrum and Airflow)
• 5+ in programming languages such as Python, Pyspark, or Scala.
• 2+ years of experience with CI/CD tools and DevOps practices for automated build, deployment, and release of data pipelines.
• 2+ years of hands-on experience with AWS IAM and AWS Lake Formation, including IAM roles/policies, access controls, and data lake security/governance.
• Strong knowledge of data storage and processing technologies, including databases and data lakes based distributed computing frameworks (e.g., Hadoop, Spark).
• Experience with Informatica IDMC / Informatica Cloud.
• Experience with Agentic AI or Generative AI use cases in Data Engineering.

What will this person be working on:

Develop and Maintain Data Integration Solutions:

• Design and implement data integration workflows using AWS Glue/EMR,AWS MWAA(Airflow), Lambda, Redshift.
• Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing large datasets.
• Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.

Ensure Data Quality and Integrity:

• Validate and cleanse data to maintain high data quality.
• Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines.

Optimize Data Integration Processes:

• Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.
• Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance.
• Regularly review and refine integration processes to improve efficiency.

Support Business Intelligence and Analytics.

• Translate business requirements into technical specifications and production-ready data pipelines.
• Ensure timely availability of integrated data for business intelligence and analytics.
• Collaborate with data analysts and business stakeholders to meet their data requirements.
• Maintain technical documentation and ensure compliance with data governance, security, and regulatory standards.

The hiring range for this position is $81.00 to $88.00 per hour, which factors in various geographic regions. The base pay rate actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors.