Azure Data Engineer 1-20-
Focusedhrsolutions
·May 31, 2024
- Location
- Raleigh, North Carolina
- Workplace
- Remote
- Type
- Full-time
- Department
- Engineering
- Experience
- 5+ years
- Source
- BetterTeam
Description
- YOUR CURRENT RESUME
- YOUR HOURLY RATE
- Collaborate with cross-functional business teams to understand requirements, analyze, and organize raw data import by identifying the ETL rules.
- Identify and apply transformation rules for legacy data migration from mainframe systems to the Azure cloud platform.
- Develop and implement data pipelines, ETL processes, and data integration solutions to facilitate the conversion of data.
- Develop and maintain documentation, best practices, and standards for data engineering processes and procedures.
- Provide technical leadership and mentorship to team members, guiding them in best practices for data engineering and cloud migration projects.
- Explore ways to enhance data quality and reliability.
- Proficiency in designing and implementing relational and non-relational databases.
- Knowledge of data modeling techniques and tools.
- Deep understanding and hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc.
- Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks.
- Knowledge of data integration and transformation techniques.
- Proficient in writing complex SQL queries and stored procedures.
- Familiarity with Transact-SQL (T-SQL) for managing and querying SQL Server databases.
- Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure.
- Awareness of compliance requirements and ability to implement solutions that adhere to NC DPI and DIT regulations.
- Ability to set up monitoring and logging for data pipelines and databases.
- Skills in optimizing data storage and processing for performance and cost-effectiveness.
- Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks.
- Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code.
- Additionally, obtaining relevant certifications, such as the Microsoft Certified: Azure Data Engineer Associate, can further validate and enhance these skills.
- Bachelor’s degree in computer science, Engineering, or a related field
- Proven experience as a data engineer, with a strong focus on data migration, ETL, and data integration.
- Hands-on experience with data warehousing concepts, database technologies (SQL on Azure)
- Strong problem-solving skills, attention to detail, and the ability to work effectively in a fast-paced environment.
- Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
- Proficiency in designing and implementing relational and non-relational databases. - Required - 5 Years
- Knowledge of data modeling techniques and tools. - Required - 5 Years
- Hands-on experience with Azure data services such as Azure SQL Database, Azure Cosmos DB, Azure Data Lake Storage, Azure Blob Storage, etc. - Required - 5 Years
- Expertise in designing and implementing ETL processes using tools like Azure Data Factory or Azure Databricks. - Required - 5 Years
- Knowledge of data integration and transformation techniques. - Required - 5 Years
- Proficient in writing complex SQL queries and stored procedures - Required - 5 Years
- Knowledge of data security best practices and experience implementing security measures for data storage and processing on Azure. - Required - 5 Years
- Ability to set up monitoring and logging for data pipelines and databases. - Required - 5 Years
- Skills in optimizing data storage and processing for performance and cost-effectiveness - Required - 5 Years
- Proficiency in scripting languages like Python or PowerShell for automating data engineering tasks - Required - 5 Years
- Knowledge of Azure Resource Manager (ARM) templates for infrastructure as code - Required - 5 Years