- Salary
- C$80k – C$95k
- Location
- Winnipeg, Manitoba
- Workplace
- Remote, Hybrid
- Department
- IT
- Experience
- 5+ years
- Closing date
- Today
Description
Job Title: Data Platform Engineering Specialist
Location: Winnipeg, Toronto, London (Hybrid)
Estimated Duration: Fulltime
Description:
The Data Platform Engineering Specialist is responsible for providing data platform and tool solutions to support business needs. Leveraging your cloud and Microsoft Azure technical subject matter expertise, you will have the exciting opportunity to design, adapt, and maintain data platform solutions within a cloud environment. You will navigate and reconcile considerations for immediate and future platform needs, encompassing but not limited to scalability, maintainability, performance, accuracy, reliability, security, compliance, cost, and robustness, even in situations where the requirements may be unclear or evolving. You’ll collaborate cross-functionally with Product Owners as well as developers, quality assurance, governance & support experts in Toronto and other offices. In this role, you will be part of an on-call rotation in order to service our customers.
Responsibilities:
- Design and build highly scalable data platform within a cloud environment.
- Partner with our internal customers, stakeholders and project teams to understand their development pain points and craft platform solutions to address them.
- Support the effort to build and enhance DevOps services, including platform monitoring, and platform and deployment support for respective data delivery pipelines.
- Connectivity enablement and integration for delivery pipelines and their data sources.
- Deliver appropriate Resource Access Permissions for respective use cases to implement Data Security and Governance.
- Troubleshoot complex performance and integration issues across Azure services.
- Design and implement data platform based on Azure Databricks supporting analytical and operational workloads.
- Administer, support, and optimize Azure-based data platforms including Azure Databricks, Azure Data Factory, ADLS Gen2, and associated platform services.
- Provision and configure cloud infrastructure using Terraform and Infrastructure as Code practices.
- Collaborate with Cloud Engineering teams to deploy and maintain Azure Databricks workspaces and supporting infrastructure.
- Manage platform security, access controls, and governance through Microsoft Entra ID, Active Directory groups, and role-based access models.
- Troubleshoot platform issues involving Databricks, Azure Data Factory, Control-M, storage, networking, and virtual machines.
- Monitor platform health, investigate incidents, analyse logs, and implement proactive measures to improve platform reliability.
- Support onboarding of new applications and data domains to the enterprise data platform.
- Develop automation to streamline platform administration, provisioning, and operational support activities.
- Participate in incident, problem, change, and release management processes.
- Provide operational support within an on-call rotation to ensure platform availability and service reliability.
- A University or College education in Computer Science, Computer Engineering or a related field or equivalent combination of education and experience.
- 5+ years of experience supporting cloud-based data platforms in a production environment
- Strong understanding of cloud data architecture, infrastructure best practices, and distributed systems.
- Hands-on experience administering Azure Databricks workspaces, clusters, Unity Catalog, permissions, and security configurations.
- Experience supporting Azure services such as ADLS Gen2, Storage Accounts, Key Vault, Virtual Machines, Networking, Private Endpoints, and Azure Monitor.
- Strong experience with Terraform and Infrastructure as Code practices.
- Experience managing access controls using Microsoft Entra ID and Active Directory security groups.
- Experience troubleshooting Azure Data Factory and enterprise scheduling/orchestration platforms such as Control-M.
- Strong understanding of operational support processes including incident management, problem management, change management, and root-cause analysis.
- Experience interpreting platform audit logs, diagnostic logs, monitoring dashboards, and performance metrics.
- Familiarity with CI/CD practices and DevOps methodologies
- Strong problem-solving and decision-making abilities.
- Experience with agile methodologies and delivery management tools (e.g., Jira, Trello).
- Customer focused with strong communication and relationship management skills.
- Ability to quickly adapt to changing priorities and working within ambiguous situations.