A standardised method for evaluating outcomes
Vulnerable people typically use services across multiple service domains, meaning their data crosses multiple government agencies. There are many gaps in the evidence base in measuring the effectiveness of human services programs in NSW in achievement of targeted participant outcome changes. A measurement model is required that should be widely applicable, using a standardised, robust framework, designed to provide comparable, ongoing assessments of program outcomes.
The Standardised Evaluation Analysis (StEvAn) model was developed to support the implementation of an investment approach for human services in NSW. The model directs and prioritises whole-of-government funding to deliver evidence-based solutions that achieve meaningful and measurable outcomes for vulnerable people in NSW.
An investment approach to human services relies on a comparative assessment of the effectiveness of programs designed to deliver social and health outcomes, and to quantify the likely impact of policy settings. The first step in implementing the investment approach requires the measurement of outcomes that each in-scope program achieves.
The StEvAn model uses the Human Services Dataset linked asset to evaluate the impact of program participation by conducting outcome analysis in a standardised way. A series of statistical analyses determine and quantify any positive impacts that a program is delivering to its participants.
Achievements
The StEvAn model supports the investment approach for human services in NSW, which aims to focus efforts towards effective and efficient services, relying on data and evidence of program effectiveness and return-on-investment to drive decision-making to improve the outcomes of children and families in NSW.
Engagement
The following stakeholders contribute to the StEvAN model, each with a specific role:
- Multiple NSW Government agencies provide data for linkage and subject matter expertise on that data
- The Centre for Health Record Linkage (CHeReL) links data - the Human Services Dataset (HSDS). The HSDS contains de-identified administrative records from 12 NSW government agencies, including information on over 9 million people.
- Areas in charge of human services programs such as family preservation and restoration programs
- An External academic review team provides review on approach, methods and interpretation
Final products are intended to provide evidence to decision makers such as DCJ Policy & Commissioning and NSW Treasury
Department leading the project
NSW Government Actuary (NSW Department of Communities and Justice)