Evaluations & Monitoring

Reserach Group


Evaluation is our core business. We have extensive expertise in providing evaluation advice, undertaking evaluations of all types, levels and complexity, and designing monitoring systems.

We have a national focus, covering a wide range of areas such as families, children and child care, disability, employment and training, and health. Many of our evaluations have focused on programs and services for Indigenous peoples and people from diverse cultural backgrounds.

We also provide policy ‘think’ pieces and build staff capacity to undertake their own evaluation and research activities.

OUR APPROACH

Good design is the key to achieving high quality, valid evaluation data. We design evaluations paying careful attention to the program objectives, key evaluation issues, timing and budgetary parameters.

We are strongly consultative, flexible and client focused. We are committed to realistic and practical policy outcomes. We take deadlines seriously.

We are highly skilled at operating in complex and sensitive environments. Our experienced interviewers are able to engage effectively with a diverse range of stakeholder groups and obtain high quality data from respondents.

Our work is evidence-based and utilisation focused. Valid and reliable findings can only be achieved when good data from the right participants is combined with strict control of each stage of the evaluation process and a high level of analytical skills.

Sensitivity and respectfulness are fundamental philosophies in undertaking data collection. Our paramount concerns are for the rights and privacy of each participant. Whenever possible we minimise respondent inconvenience.

We write concise, informative, reader-friendly reports. Our aim is to provide insightful contributions to policy development and practical suggestions for program improvement.

Evaluation

Our evaluation services include:

  • Development of evaluation strategies
  • Evaluations of pilot programs
  • Formative and process evaluations
  • Summative, outcomes or impact evaluations
  • Longitudinal evaluations
  • Evaluations addressing systemic change.

We draw upon a wide range of evaluation techniques to ensure the most rigorous outcomes for each evaluation. Most usually we use a multiple methods approach, a combination of qualitative and quantitative methods involving a range of stakeholders – often called triangulation. A combination of methods provides the most comprehensive information and greatly increases the credibility of the findings.

Participatory methods such as Most Significant Change Technique and Action Research are particularly useful for increasing stakeholder involvement and provide valuable insights into program operations.

Where feasible and appropriate we use a comparison group approach for accurate net impact assessment.

To make it easier for evaluation participants we often use the internet both to collect survey and other information and to communicate through email and web based discussion groups.

Monitoring

We undertake the design and implementation of monitoring systems, including the collection of quantitative and qualitative information to provide robust, valid and reliable program data. Most often we take a program logic approach.

Determining the information requirements of a monitoring system should balance the needs of the users with the needs and capacity of those required to provide the information. We believe monitoring information should be sufficiently comprehensive and robust to inform policy and program decisions; it should also be manageable and sensible from the point of view of those providing the data.

Capacity building

We provide advice and assistance in all aspects of evaluation and monitoring. We can assist your staff to design evaluation strategies and monitoring systems. We can also train and advise staff in undertaking the field work, analysis and report writing.

 


services | about us | ethics | methodology | projects | contact us | home

© 2018 O'Brien Rich Research Group
[ website design & development +bkad+ ]