Director, Enterprise Quality Engineering and Agentic Evaluation

Company Description

Zayo provides mission-critical bandwidth to the world’s most impactful companies, fueling the innovations that are transforming our society. Zayo’s 141,000-mile network in North America and Europe includes extensive metro connectivity to thousands of buildings and data centers. Zayo’s communications infrastructure solutions include dark fiber, private data networks, wavelengths, Ethernet, and dedicated Internet access. Zayo serves wireless and wireline carriers, media, tech, content, finance, healthcare and other large enterprises.

We are seeking an experienced Director, Enterprise Quality Engineering and Agentic Evaluation to build and lead a modern enterprise quality capability across Zayo’s technology organization. This role will be accountable for improving the reliability, predictability, and speed of technology delivery while providing independent assurance for critical business platforms, transformational programs, and AI-enabled solutions.

The successful candidate will combine deep quality engineering expertise with strong enterprise leadership, bringing a risk-based, automation-first approach to how quality is embedded across the software delivery lifecycle. The role will also shape how Zayo evaluates and governs emerging agentic AI capabilities, ensuring they are reliable, controlled, and ready for enterprise-scale adoption.

This is a highly collaborative and transformational leadership role, partnering across Engineering, Product, Architecture, Data and AI, Operations, and business teams to strengthen quality outcomes, reduce production risk, and establish a culture of measurable engineering excellence.

Key Responsibilities 

• Define and lead Zayo’s enterprise quality engineering strategy, operating model, roadmap, service catalog, standards, and governance. 

• Own the enterprise quality engineering platform, including Tosca, qTest, automation assets, integrations, test execution infrastructure, quality reporting, and AI-evaluation capabilities. 

• Establish risk-based quality models, release-readiness criteria, quality gates, certification standards, and evidence requirements for critical platforms, business processes, integrations, data products, and AI agents. 

• Lead a centralized quality engineering service that plans, automates, executes, and governs testing across enterprise products, platforms, programs, and high-risk releases. 

• Develop reusable automation frameworks, model-based testing patterns, API and integration testing capabilities, regression suites, and continuous testing practices aligned to business risk and production impact. 

• Establish enterprise capabilities for AI-agent evaluation, including scenario design, evaluation datasets, regression testing, tool-use validation, policy and permission checks, human escalation criteria, and production quality monitoring. 

• Own the enterprise approach to test data, test environments, service virtualization, production validation, and quality analytics to reduce release risk and delivery delays. 

• Provide independent quality intelligence and release-risk assessments to engineering, product, program, and executive stakeholders. 

• Manage vendor-outsourced quality engineering resources, Tricentis partners, systems integrators, and specialist testing providers to deliver sustained enterprise quality outcomes. 

• Build a quality engineering culture focused on automation, objective assurance, reuse, engineering discipline, measurable outcomes, and continuous improvement. 

Qualifications 

• Bachelor’s degree in Computer Science, Engineering, Information Systems, Mathematics, or a related discipline; equivalent relevant experience may be considered. 

• Minimum of twelve (12) years of experience in quality engineering, software testing, test automation, platform engineering, enterprise technology delivery, or related technology disciplines, including 5+ years leading quality engineering, test automation, enterprise testing, or platform-oriented teams. 

• Demonstrated experience building or leading modern quality engineering capabilities beyond manual test execution, including automation strategy, risk-based testing, continuous testing, quality gates, and release assurance. 

• Strong experience with enterprise test automation and test management platforms, preferably Tricentis Tosca and qTest. 

• Experience leading testing or quality engineering across multiple products, platforms, business processes, programs, or business units. 

• Strong understanding of API, integration, data, workflow, cloud, event-driven, distributed-system, performance, resilience, and production validation testing. 

• Practical knowledge of generative AI, large language models, retrieval, AI agents, tool calling, evaluation methods, and responsible AI testing practices. 

• Strong executive communication, stakeholder management, vendor management, financial management, organizational leadership, and decision-making skills.

Estimated base salary range: $126,600 - $194,700 USD/annually.  

Work Authorization Requirement: This position is not eligible for employment-based visa sponsorship. Zayo will not provide, transfer, or assume sponsorship for any employment visa or work authorization for this position now or in the future. 

#LI-Remote

The base pay range shown is a guideline and reasonable estimate for this role. It takes into account the wide variety of factors that are considered in making compensation decisions. Actual compensation offered may vary from the posted range based upon geographic location, work experience, skill level, certifications, and other business and organizational needs. Non- sales roles may be eligible to participate in a discretionary annual incentive plan. Sales roles may be eligible to participate in a sales incentive plan.

Additionally, this position may be eligible for certain benefits, such as health insurance, life insurance, disability retirement plans, paid time off.

The posting will be active for a minimum of 3 days. The active posting will continue to extend by 3 days until the position is filled.

Benefits, Rewards & Wellness

• Excellent Health, Dental & Vision Insurance
• Retirement 401(k) Savings Plan
• Generous paid time off policy including paid parental leave

Zayo is an equal opportunity employer to all protected groups, including protected veterans and individuals with disabilities. If you are an individual with a disability and would like to request a reasonable accommodation as part of the employment selection process, please contact us.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

As part of the application, hiring, onboarding, and/or employment process, Zayo or its affiliates, partners, and vendors may collect, store, and use biometric identifiers and biometric information (collectively, “Biometric Data”), such as fingerprints, facial geometry scans or other unique biological characteristics. Zayo uses CLEAR1, a third-party identity verification service, to verify applicant identity during the hiring process. CLEAR1 may collect Biometric Data, including facial geometry scans and/or other biometric identifiers, to authenticate your identity. Biometric Data will be retained pursuant to CLEAR1’s policies, which can be found here: https://www.clearme.com/clear1-credential-policy-crp. Zayo will not sell, lease, trade, or otherwise profit from any applicant's or employee's Biometric Data. By proceeding with your application, you acknowledge this disclosure. Prior to any collection of Biometric Data — including through CLEAR — you may be presented with a separate consent form and asked to provide your written authorization in accordance with applicable federal, state, and local laws, including the Illinois Biometric Information Privacy Act (BIPA), the Texas Capture or Use of Biometric Identifier Act (CUBI), and other applicable biometric privacy statutes.