- Type
- Internship
- Department
- IT
- Seniority
- Lead
- Experience
- 3+ years
- Source
- Freshteam
Description
Job Summary:
Building on the foundation of the SDE-I role, the DE- I position takes on a greater level of responsibility and leadership.
You'll play a crucial role in driving the evolution and efficiency of our data collection and analytics platform, capable of handling terabyte-scale data and billions of data points.
Key Responsibilities:
Responsibilities
As an experienced member of the team, in this role, you will:
• Contribute to evolving the technical direction of analytical Systems and play a critical role their design and development
• You will research, design and code, troubleshoot and support. What you create is also what you own.
• You will focus on performance, cost efficiency, reliability, security and high availability of the products/modules and features that you own.
• Develop the next generation of automation tools for monitoring and measuring data quality, with associated user interfaces.
• Be able to broaden your technical skills and work in an environment that thrives on creativity, efficient execution, and product innovation.
BASIC QUALIFICATIONS
• Bachelor’s degree or higher in an analytical area such as Computer Science, Physics, Mathematics, Statistics, Engineering or similar.
• 3+ years relevant professional experience in Data Engineering and Business Intelligence
• 3+ years in with Advanced SQL (analytical functions, window functions, Rollups/Cubes, Complex joins, Complex scanning methods and Join methods), ETL, Data Warehousing.
• Strong knowledge of data warehousing concepts, including data warehouse technical architectures, infrastructure components, ETL/ ELT and reporting/analytic tools and environments, data structures, data modeling and performance tuning.
• Ability to effectively communicate with both business and technical teams.
• Excellent coding skills in Java, Python, C++, or equivalent object-oriented programming language
• Understanding of relational and non-relational databases & data stores
• Proficiency with at least one of these scripting languages: Perl / Python / Ruby / shell script
PREFERRED QUALIFICATIONS
• Experience with building data pipelines from application databases.
• Experience with AWS services - S3, Redshift Spectrum, EMR, Glue, Athena, ELK, AWS lambda and Step functions.
• Experience working with Data Lakes & Data Mesh.
• Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space.
• Sharp problem-solving skills and ability to resolve ambiguous requirements.
• Experience on working with both structured & unstructured data at Big Data volume and internet scale.
• Knowledge and experience on working with Hive, Spark, Kafka & the Hadoop ecosystem.
• Knowledge and experience on coding with Pyspark, SparQL.
• Experience working with Data Science teams.