Role of Evaluation

Health Professionals & Consumers

The Royal Australian and New Zealand College of Radiologists (RANZCR) is committed to fostering excellence in radiology and radiation oncology education through robust evaluation practices. Evaluation is not just a process; it's a key priority and function of RANZCR. It promotes innovation, drives quality improvement of our programs, allows meaningful feedback from our stakeholders and is a core requirement for the accreditation of our specialist medical training programs.

Our responsibilities

Promote and undertake evaluation activities including reviews and monitoring processes across the College portfolio.
Develop and monitor programs that meet the reporting requirements of the Education and Training Committees, the College, external stakeholders and ensure these are met in a timely and accurate manner with due consultation with other relevant committees and stakeholders.
Monitor, analyse and develop recommendations based on external data sources including, but not limited to, the annual Medical Training Survey undertaken by the Medical Board of Australia, the Medical Education Training dataset collected by the Australian Department of Health and relevant workforce reports from both Australia and New Zealand.
Identifying issues pertinent to the evaluation purpose and to report them to the committees.
Using analytics and data to support quality improvement of the education and training programs delivered by RANZCR.
Conducting and completing an approved work plan/program of evaluation for the College education and training programs under the guidance of the Education and Training Committees and/or the RANZCR Board.

Our approach

Radiologist and radiation oncologist education operates within complex healthcare systems with diverse stakeholders. Therefore, our evaluation approaches are tailored to acknowledge and explore the contextual factors that influence outcomes. We utilise:

Program logic

We articulate program theory by mapping the inputs, activities, outputs, and outcomes of our initiatives. This approach integrates design and evaluation processes seamlessly.

Data triangulation

To enhance the credibility and reliability of findings we cross-verify data from multiple sources, which helps address potential biases and strengthens the validity of results.

Realist Theory

We employ realist evaluation theory to unpack what works, for whom, and in what circumstances. This allows us to make credible claims of causation considering contextual challenges.

Monitoring

Monitoring plays a pivotal role within RANZCR, ensuring ongoing oversight and assessment of our programs. Through systematic observation, data collection and stakeholder consultation, we track the progress and performance of our programs, policies, and initiatives. This continuous monitoring enables us to promptly identify any emerging issues, assess the effectiveness of interventions, and make informed decisions to optimise outcomes.

Stakeholders’ role in evaluation

Feedback and action are integral components of our commitment to continuous improvement. We actively solicit feedback from stakeholders, including trainees, members, and healthcare professionals, to gain valuable insights into the effectiveness and impact of our programs. This feedback is carefully analysed and used to inform strategic decision-making processes.

We extend an invitation to all stakeholders, trainees, members, healthcare professionals, and industry partners to actively participate in our evaluation processes. Your feedback and insights are instrumental in shaping the trajectory of radiology and radiation oncology education.

The Evaluation Cycle

Evaluation Framework Website Final

For more information about evaluation please find the relevant links below.

View the Monitoring and Evaluation Framework