- Salary
- ₹15 – ₹20/yr
- Location
- Bengaluru, Bangalore Division, India
- Type
- Full-time
- Department
- Engineering
Description
Job Description – Data EngineerLocation: BangaloreExperience: 5 to 10 yrsRequired SkillsProgramming & Data ProcessingStrong proficiency in Python or Java.Experience in Python-based data extraction and logic development.Hands-on experience with Apache Kafka, Apache Spark, ANSI SQL, and FTP.Experience in on-premises to AWS cloud migration.Data FormatsStrong understanding of JSON, Avro, and Parquet file formats.Platforms & TechnologiesExperience with Hadoop (HDFS/Hive).Hands-on experience with Snowflake, Apache Iceberg, and Sybase IQ.Data Modeling & ArchitectureUnderstanding of data normalization and denormalization techniques.Knowledge of natural keys and surrogate keys and their strategic use in data modeling.Key ResponsibilitiesDevelop and maintain data extraction and transformation pipelines.Build scalable data processing solutions using Apache Spark and Kafka.Work with structured and semi-structured data formats.Support on-premises to AWS cloud migration projects.Design and optimize SQL queries for efficient data processing.Implement data modeling strategies using normalization, denormalization, and appropriate key selection.Work with Hadoop, Snowflake, Apache Iceberg, and Sybase IQ platforms