Senior Data Platform Support Engineer

TransUnion's Job Applicant Privacy Notice

Team Overview

We are looking for a Senior Data Platform Support Engineer to support and administer on-premise big data platform as well as proprietary data platform built on GCP as part of the wider Data Engineering & Analytics team. You will be based at our India office (Pune) and work in a hybrid model.
This is a hands-on operational support role. The primary focus is day-to-day platform administration, user onboarding, compute services administration & support, workspace and project setup, incident investigation, cost monitoring, access support, and operational issue resolution for data science and analytics users.
The successful candidate should have strong GCP operational knowledge, good Linux and system administration experience, experience supporting data and analytics platforms and relevant tools and services, ability to work with Data Science, Data Engineering, DevOps, Infrastructure, and L3 engineering teams.

The role will be focused on supporting both the existing on-premises big data analytics platform as well as the cloud platform we are migrating to. This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.

Role Overview And Core Responsibilities

• Linux administration (RHEL) and data services administration (e.g. Hadoop ecosystem, Postgres, POSIT)
• Provide operational support for a proprietary cloud data & analytics platform built on GCP
• Administer platform workspaces & compute, user onboarding, access & role management, project setup and general platform configuration
• Support Data Science and Analytics users with issues relating to compute, storage, access, workspaces, data availability, cost management and platform usage
• Manage and troubleshoot GCP access issues including IAM, service accounts, groups, roles and bucket permissions
• Support GCP operational administration across projects, compute, storage, networking, logging and monitoring in collaboration with the DevOps teams 
• Monitor cloud resource usage and support FinOps activities including cost tracking, configure/customize cost dashboards and resource usage reporting
• Use Harness.io and other internal tools to support operational processes, reporting and platform visibility; assist engineering teams with CICD setup
• Debug and resolve user and platform issues, collecting logs, error messages, screenshots, configuration details and other evidence for L3 escalation where required
• Support platform deployments (performed by DevOps) and changes where required, working with DevOps, Infrastructure and Engineering teams
• Understand the GCP services, configurations & setup for the relevant analytics services and participate in impact assessment prior to new platform version deployments
• Monitor production analytics services using Cloud Logging, Cloud Monitoring, alerts and internal support tools
• Work directly with Data Engineering, Data Science, Platform, DevOps and Infrastructure teams to resolve incidents and improve platform reliability
• Contribute to runbooks, support procedures, incident workflows and continuous improvement of platform operations
• Provide support for the existing on-premise analytics platform including assisting the platform engineers with patching/upgrades of key services and handling user support requests. 
• Participate in on-call rota for client-facing platform services, providing L2 incident triage / issue resolution, initial investigation, stakeholder updates, evidence gathering and escalation to L3/platform engineering teams where required

Required Knowledge And Experiences

• 8+ years of experience in Platform Admin & Support, Cloud Support, DevOps Support, Infrastructure Support or Data Platform Operations experience
• Linux administration (RHEL) and good scripting skills (bash or python) 
• Hands-on GCP operational experience across compute, storage, IAM, networking, logging and monitoring
• GCP Associate Cloud Engineer certification (or equivalent experience)
• Experience supporting data, analytics or data science platforms in a production environment
• Strong understanding of GCP projects, IAM, service accounts, permissions, VPC administration, GCS buckets and cloud resource administration
• Experience supporting users with access, compute issues, data access, platform configuration and operational troubleshooting
• Experience with incident handling, ticket management, escalation, root-cause investigation and support documentation
• Ability to debug issues methodically and provide clear evidence for L3 or engineering escalation
• Experience with cloud cost monitoring, resource usage reporting, cost dashboards or FinOps processes is desirable
• Experience with administration of data platform technologies such as Spark, Hive, Airflow/Cloud Composer, Cloud Run, Dataproc, BigQuery or GCS
• Strong communication, documentation and problem-solving skills

TransUnion Overview:

At TransUnion, we encourage and are committed to creating a real, positive impact and shared sense of purpose within our Workforce for Good, which empowers our people to grow, innovate and contribute to a better future for our communities and customers. We strive to build an environment where our associates are in the driver’s seat of their professional development— while having access to help along the way. We recognize that success comes when our associates thrive both professionally and personally; that’s why we prioritize work/life flexibility and offer resources for our teams across the globe to collaborate and drive excellence.

 

Be a part of our Workforce for Good – you’ll work with great people, pioneering products and cutting-edge technology.

TransUnion Job Title

Lead Engineer, Database Administration and Storage