STATISTICAL ANALYST IV - Evaluation Manager

This position is open to current Colorado residents only.

Opt in below to receive text message updates on CDHS recruiting events!

Hybrid. Predominantly telework with a minimum of one in-person meeting a month. This is subject to change.

CDHSCareers

About this Unit:
This position is located within the Colorado Department of Human Services (CDHS) Behavioral Health Administration (BHA) which is responsible for policy development, service provision and coordination, program monitoring and evaluation, and administrative oversight for the behavioral health system.

Additionally, the Behavioral Health Administration (BHA) leads and promotes the State’s behavioral health priorities, ensures that behavioral health services respond to the changing needs of communities, monitors State and local data, and continuously evaluates State efforts. In collaboration with other state agencies, BHA is accountable for the delivery of behavioral health services in Colorado. It bestows a streamlined and efficient government approach to support quality care while minimizing the burden on providers so that they can focus on service delivery. BHA is responsible for behavioral health policy development and effective collaboration with cross-sector partners working in and around the behavioral health system and along the continuum from prevention to treatment and recovery. BHA works in partnership with State agencies to reduce bureaucracy and fragmentation.

This position is located within the Technology and Data division of BHA. The Technology and Data division is responsible for the end-to-end data and digital strategy for the BHA, including:
Designing and building easy-to-navigate digital services that get people the information they need, faster;
Producing actionable insights and evaluation that drive better outcomes;
Promoting transparency and data access to drive accountability and continuous improvement;
Improving data quality and information flows between providers and the BHA, reducing administrative burden; and,
Maintaining critical data infrastructure that supports the delivery of the BHA’s services.

The data insights and evaluation function of the Technology and Data Division includes assessing equitable access to quality behavioral health services for people in Colorado among publicly-funded programs, monitoring the quality of services delivered by behavioral health providers as well as population-level outcomes for communities in Colorado. The division is also responsible for reporting information and answering questions about behavioral health service delivery to various partners or funders such as advisory boards, other state agencies, the federal government (SAMHSA), the Colorado General Assembly, and the Governor’s office.

About this Position:
This position exists to nurture evaluation practitioner skills, practices, and capacity that ensure the effective use of evaluative methods to design, develop, improve, and manage evaluation services for BHA.
Provide practice leadership and general guidance to a mixed-methods evaluation and data insights team to create consistent, clear, and rigorous methods and approaches for the evaluation practice in the Technology and Data division 
Foster a learning environment for the evaluation practice, including developing and supporting training, capacity building, and career development plans for staff.
Leverage communication and community-building strategies across diverse audiences to advance evaluation practices and inform and influence individual, organizational, community, and policy actions in order to improve behavioral health in Colorado.
Create a safe, open, and accessible environment where debate is encouraged, and opinions are respected to facilitate consensus in decision-making and the advancement of sound evaluation practices at BHA.

Evaluation Practices and Expertise:
This position supports the consistent and rigorous design of Evaluation studies to assess BHA-funded programs and services against BHA objectives. This position leads the design, implementation, and oversight of best practices and guidelines around evaluation that informs how the division approaches the strategic planning, program design and project implementation with research and analysis to uncover, document, or advance evidence-based approaches. 
Develops best practices, guidelines, standards, and other resources that help promote a consistent, high-quality approach to evaluation. Works with Evaluators to implement practice standards and document approaches. 
Provides strategic advice on the full range of evaluation methods and processes, including: providing technical assistance in defining measurable program goals and objectives; planning and designing evaluation research methodologies to assess needs, aid in program improvement, demonstrating accountability, effectiveness or impact, all to inform programmatic decisions; assessing the statistical reliability and validity of potential measurement instruments and/or developing new measurement tools as needed; planning and independently performing descriptive and inferential statistical analyses of quantitative data sets used in evaluation studies; employing qualitative research methods such as surveys, focus groups and key informant interviews to elicit qualitative evaluation information, and independently interpreting results to inform judgments about the program’s performance related to their evaluation questions. 
Deploys a high level of knowledge and expertise in evaluation theories, frameworks, tools, and research methods, as well as expertise in the full gamut of descriptive and inferential statistical analysis techniques available to answer various evaluation and data questions.
Develops and maintains an Evaluation practice talent strategy that supports the growth and development of Evaluation professionals and the maturation of Evaluation practices in the division. Works with other practice and delivery leadership to ensure alignment across practice approaches and delivery functions.

Management and Coaching:
Provides practice leadership and general direction to a mixed-methods evaluation and data insights team to create timely, clear, clean and statistically rigorous products; develops and executes training, capacity building, and career development plans for staff 
Provides coaching and mentoring to Evaluation professionals to support the development of a strong Evaluation practice at the BHA and to promote individual career growth for Evaluation professionals. 
Develops and guides staff and other professionals by providing effective performance feedback and making sure team skills and developmental goals are consistent with responsibilities
Oversees a strategic approach to the hiring, development, and management of Evaluation staff. Works with delivery management to understand the required skills and resources needed and supports the timely hiring of staff. 
Creates a culture of inclusion, psychological safety, dependability, continuous learning, in a fast paced environment. 
Ensures a supportive employee experience, including promoting equity and fairness in hiring and managing staff. 

Communication and Collaboration:
Works in partnership with others areas of the TaDa division, the BHA, agencies, organizations, and communities to promote good evaluation practices, communicate, and apply shared visions, missions and values; inspire trust and motivate others; build capacity; improve performance and enhance the quality of behavioral health system
Advances an understanding of Evaluation and the role it plays in producing actionable insights that drive better outcomes.
Prepares and presents written and oral reports on evaluation and data insights methods, results, key findings, and programmatic implications for a variety of audiences. 
Nurtures an Evaluation community of practice at the BHA to support sharing of lessons learned, best and emerging practices in the evaluation field. 
As appropriate, contributes to the body of evidence for public health strategies and interventions by submitting evaluation methodologies and key findings to professional journals in the field of public health evaluation. 
Works with other practice leads in the TaDa division to share best practices, tools, advice, and relevant resources to support the maturing of practices and processes. 

Learning and Development:
Designs and develop learning and development strategies for the evaluation practice, in support of nurturing evaluation practitioner skills, practices and capacity that ensure effective use of evaluative methods to design, develop, improve and manage evaluation services for the BHA. 
Fosters a continuous learning environment and learns often themselves - from within the evaluation practice, with TaDa partners, external partners, industry leaders – in both traditional and non-traditional ways. 
Develops a learning curriculum to support the growth and career development of Evaluators across levels of experience. 
Promotes learning and development opportunities that advance an understanding of equity, diversity and inclusion, with an emphasis on those communities traditionally underserved in the behavioral health space. 
Nurtures an Evaluation community of practice at the BHA to support sharing of lessons learned, best and emerging practices in the evaluation field.Minimum Qualifications

Experience Only:
Eight (8) years of relevant experience in applied, mixed-methods (qualitative and quantitative) social science research and/or program evaluation, data analysis, or research design and implementation or closely related field.
OR
Education and Experience:
A combination of related education in program evaluation, public health, community and behavioral health, sociology, applied social science research, statistics, psychology, or a closely related degree and/or relevant experience in applied, mixed-methods (qualitative and quantitative) social science research and/or program evaluation, data analysis, or research design and implementation an occupation related to the work assigned equal to eight (8) years.
 
Preferred Qualifications:

• Master's degree in program evaluation, public health, community and behavioral health, sociology, applied social science research, statistics, psychology, or a closely related degree; 

• Mastery of best practices and demonstrated capacity in research and evaluation design, qualitative and quantitative methods, statistical analyses and modeling, with the ability to utilize statistical methods for hypothesis testing and program effectiveness modeling

• Experience using or supporting teams in using SQL, R, Python, and Tableau

• Understanding of health equity and social determinants of health, particularly as they relate to research and evaluation

• Demonstrated capacity in leadership, including effective program and project management

• Experience successfully recruiting, supervising, and coaching stellar employees

Conditions of Employment:

• Conditions of Employment [Insert Conditions of Employment]

  • [Standard/full]background check and reference check required

  • This position requires State of Colorado residency at the time of application (unless otherwise identified in the posting), and residency within the state throughout the duration of employment in this position.

  • Motor Vehicle Check , if the employee will drive a state-owned vehicle, either in an on-going capacity while performing their normal day-to-day job duties OR on occasion for training/meetings/client visits/etc.

  • Must possess a valid, non-restricted Colorado Driver’s License or an non-restricted U.S. Driver's License for positions within 30 miles of the CO state border

  • Out-of-State Driver’s License holders must obtain a valid, non-restricted Colorado Driver’s License within 30 days of employment start date.  

  • Other Conditions of Employment specific to Program

  • Former State employees who were disciplinarily terminated or resigned in lieu of termination must:

  • Disclose that information on the application.

  • Explain why the prior termination or resignation should not disqualify you from the current position.

  • Provide your employee number from your prior State employment.  Absent extraordinary circumstances, prior disciplinary termination or resignation in lieu of termination and failure to provide this information will disqualify the applicant from future State employment with CDHS.

APPEAL RIGHTS:
Appeal Rights

You may file an appeal with the State Personnel Board or request a review by the State Personnel Director if your application is eliminated.  You will find the appeals process, the official appeal form, and how to deliver it on the State Personnel Board website.

• You or your representative must sign and submit the official appeal form for review.  

• You can find the official appeal form here. 

• You must be deliver the official appeal form to the State Personnel Board:

  • By email ([email protected]), or

  • Postmarked in US Mail to(1525 Sherman Street, 4th Floor, Denver CO 80203, or 

  • Hand delivered (1525 Sherman Street, 4th Floor, Denver CO 80203), or

  • Faxed (303.866.5038) within ten (10) calendar days from your receipt of notice or acknowledgement of the department’s action.

Contact the State Personnel Board for assistance:

• At (303) 866-3300, or

•  Refer to the  Colorado Code of Regulations (CCR) 801-1, State Personnel Board Rules and Personnel Director's Administrative Procedures, Chapter 8, Resolution of Appeals and Disputes, within the Rules webpage.

• How to apply to the State of Colorado(Youtube Video, Runtime 3:59, Closed Captions Available)

• The Assessment Process

About Us & Benefits

If your goal is to build a career that makes a difference, join the dedicated people of the Colorado Department of Human Services (CDHS). Our professionals strive to design and deliver high quality human and health services that improve the safety, independence, and well-being of the people of Colorado. Each of us is committed to contributing to a safe and accessible CDHS. In addition to a great location and rewarding and meaningful work, we offer:

• Strong, secure, yet flexible retirement benefits including a PERA Defined Benefit Plan or PERA Defined Contribution Plan plus 401(k) and 457 plans

• Medical and dental health plans

• Employer supplemented Health Savings Account

• Paid life insurance

• Short- and long-term disability coverage

• 11 paid holidays per year plus vacation and sick leave

• State of Colorado Employee BenefitHub Resource Center

• Employee Wellness program

• Excellent work-life programs, such as flexible schedules, training and more

• Remote work arrangements for eligible positions

• *Some positions may qualify for the Public Service Loan Forgiveness Program.

Our Values

• We believe in a people-first approach: We prioritize the needs, well-being, and dignity of the individuals, families and communities we serve. We commit to respect, fairness and access in every decision, policy and interaction. We engage client voices and experiences in the development and implementation of the services we provide.

• Balance creates quality of life: We want our team to be resilient through a supportive workplace that values flexibility, health and wellness, and employee engagement.

• We hold ourselves accountable: We take responsibility through our actions, programs, and results for the state of health and human services in Colorado.

• Transparency matters: We are open and honest with employees, our partners, the Coloradans we serve, and the public.

• We are ethical: We abide by what is best for those we serve by doing what is right, not what is easy.

• Collaboration helps us rise together: We work together with all partners, employees, and clients to achieve the best outcomes for Coloradans.

ADA Accommodations

CDHS is committed to a Colorado for ALL qualified individuals. As part of this commitment, our agency will assist individuals who have a disability with any reasonable accommodation requests related to employment. 

This includes completing the application process, interviewing, completing any pre-employment testing, participating in the employee selection process, and/or performing essential job functions where the requested accommodation does not impose an undue hardship. If you have a disability and require reasonable accommodation to ensure you have a positive experience applying or interviewing for this position, please direct your inquiries to [email protected].

EEO Statement

The State of Colorado is an equal opportunity employer

We are committed to increasing a “Colorado for ALL" of our staff and providing culturally responsive programs and services. Therefore, we encourage responses from people of all backgrounds and abilities.  The State of Colorado believes that a “Colorado for ALL” drives our success, and we encourage candidates from all identities, backgrounds, and abilities to apply. The State of Colorado is an equal opportunity employer committed to building inclusive, innovative work environments with employees who reflect our communities and enthusiastically serve them. Therefore, in all aspects of the employment process, we provide employment opportunities to all qualified applicants without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity or expression, pregnancy, medical condition related to pregnancy, creed, ancestry, national origin, marital status, genetic information, or military status (with preference given to military veterans), or any other protected status in accordance with applicable law.

Additional Support For Your Application

Toll Free Applicant Technical Support

If you experience technical difficulty with the NEOGOV system (e.g. uploading or attaching documents to your online application) call NEOGOV technical support at 855-524-5627 Mon-Fri between 6 am and 6 pm (Pacific Time).  Helpful hints: if you are having difficulty uploading or attaching documents to your application 1) ensure your documents are PDF or Microsoft Word files and 2) close the document before you attempt to upload (attach) it.

Required Supplemental Questions:

• (Multiple Choice) The bottom of this job announcement provides links to additional information on how to apply, the assessment process, toll free applicant technical support, and about how the State of Colorado is an equal opportunity employer. 

  • Please acknowledge below that you have read the information provided in these links.

    • This information is available to me and I have read this information.

    • I am unable to access the links with this information on the job posting. (If you select this option, please contact the recruiter, whose information is listed on this announcement, so that they can send this information directly to you.)

• Your legal name is used in the hiring process for background checks. Did you use your full legal name in your application? If not, please update your information before submitting  your application. Yes/No

• If you are a current or former State of Colorado employee, please list your employee number (starts with 997…). Your application may be considered incomplete if you do not provide this information. An incomplete application may not move forward in the Selection process.  If you are a former or current state employee, please identify what state agency you work(ed) with and how many years of relevant state service you have related to the position you are applying for. (Ensure this is listed on your application under work experience).

• Former State employees who were disciplinarily terminated or resigned in lieu of termination must disclose the information on the application.

In the space below, please explain why the prior termination or resignation should not disqualify your application from the current position.