Hiring.Camp

Senior AWS Data Lake Architect

Semtech

·

Today

Location
IND - Hyderabad, India
Type
Full-time
Department
Engineering
Seniority
Senior
Source
Workday

Description

Responsibilities:


  • Architect, design, and implement scalable, secure AWS data lake solutions (Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, Amazon Kinesis/MSK), including reference architecture, data zoning, partitioning strategy, and schema/catalog management (25%).
  • Lead the design and deployment of AI/ML-ready data pipelines, including feature stores and model training pipelines, and integrate with Amazon SageMaker and Amazon Bedrock to support generative AI and machine learning use cases (20%).
  • Partner with data science and AI engineering teams to operationalize AI solutions in production, including model deployment pipelines, MLOps integration, and inference data flows (15%).
  • Establish and enforce data governance, security, and compliance standards, including IAM, KMS encryption, Lake Formation permissions, and audit logging (15%).
  • Drive cost optimization and performance tuning across storage, compute, and query layers, and evaluate new AWS services and architectural patterns (15%).
  • Provide technical leadership and mentorship to data engineers, own technical documentation and architecture decision records, and support operational handoffs for production issues (10%).

 

Minimum Qualifications:

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or related field required; Master’s degree preferred
  • 8+ years’ experience in data engineering or data architecture required; 5+ years specifically architecting solutions on AWS required
  • Hands-on experience designing and operating AWS data lake architectures, including Amazon S3, AWS Lake Formation, AWS Glue, Amazon EMR, Amazon Redshift, Amazon Athena, and Amazon Kinesis/MSK
  • Demonstrated experience deploying or supporting AI/ML solutions in production, including integration with Amazon SageMaker and Amazon Bedrock
  • Proficiency in Python and/or Scala/Spark for large-scale data processing
  • Strong understanding of data governance, security, and compliance best practices in cloud environments

 

Desired Qualifications

  • AWS Certified Data Engineer – Associate (DEA-C01) or equivalent AWS certification (e.g., AWS Certified Solutions Architect – Professional)
  • Experience with modern lakehouse formats such as Apache Iceberg, Delta Lake, or Apache Hudi
  • Experience architecting generative AI solutions on AWS using Amazon Bedrock, including foundation model access, agents, and knowledge bases
  • Exposure to infrastructure-as-code (Terraform, AWS CloudFormation, or AWS CDK) for provisioning data platform resources
  • Experience operating in regulated or large-scale enterprise environments with strict data governance requirements

Skills

PythonScalaAWSTerraformMachine LearningSparkData ScienceData EngineeringEMRComplianceAWS Certified

Similar Jobs

30

Senior Data Support Engineer – AWS, SQL & ETL

Recruteaction·North York, Waterloo·Hybrid

1d ago

Senior Consultant, AWS Data & AI

Ingrammicro·Madrid, Spain +3·Hybrid

1d ago

AWS Glue Data Engineer(Redshift+Pyspark+Kinesis) - Senior Associate

Crm Experienced Careers Site·Hyderabad, Telangana

1d ago

Senior Data Engineer AWS

Devoteam·Nantes, Pays de la Loire·Hybrid

3d ago

Senior Data Engineer (Snowflake, AWS, Big Data)

Cba·Eveleigh, New South Wales

3d ago

Senior Data Engineer (Databricks/AWS)

Citi Bank·5900 HURONTARIO STREET MISSISSAUGA, Canada·Hybrid

4d ago

Senior Data Engineer (Databricks/AWS)

Citi Bank·Mississauga, Ontario

4d ago

[Jpb-32670] Senior Data Engineer AWS L4, Brasil

Ciandt·São Paulo, Brazil·Remote

1w ago

Senior Data & Reporting Engineer (SQL/Python/AWS)

The Citco Group Limited·Manila, National Capital Region·Onsite

1w ago

(AME4852) AWS Senior Data Engineer

Config·Torrance, California

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Piteşti, Arges·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Sibiu, Sibiu County·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Romania·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Romania·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Cluj-Napoca, Cluj County·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Romania·Hybrid

1w ago

Senior Data Engineer (Snowflake & AWS)

Endava·Bucharest, București·Hybrid

1w ago

Senior Data Platform Engineer AWS, Spark

Experian·Nottingham, England·Hybrid

1w ago

Sr. Technical Infrastructure Program Manager, Data Center Planning & Delivery, AWS DC Acquisition & Construction

Amazon Company

Sr Data Engineer (AWS | Multi-Cloud | Databricks)

CloudThat·Bengaluru, Karnataka·Remote

2w ago

Senior AWS Data Engineer – Data Migration & Automation

Inetum·Bogotá, Bogota D.C.·Hybrid

2w ago

Senior Data Engineer – Python | SQL | AWS | Data Platforms

Dearx·Western Cape

2w ago

Senior Data Engineer AWS

Encora·Peru, Indiana

2w ago

Consultant.e Senior Data Engineer AWS H/F

Devoteam·Lyon, Rhône-Alpes·Hybrid

2w ago

Senior Financial Analyst, AWS Data Center Finance

Amazon Company

Senior Data Engineer – AWS (META, Affiliate)

Radcube·Indianapolis, Indiana

3w ago

Senior Data Engineer – AWS (META, Affiliate)

Radcube·India

3w ago

Sr. AWS Data Architect

Signetjewelers·Support Center - Irving, TX·Hybrid

3w ago

Senior Data Engineer, AWS Infrastructure Supply Chain Automation

Amazon Company·Remote

Sr. Delivery Consultant- GenAI/ML & Data Science, AWS Industries

Amazon Company