A series of interviews must take place with the Program Director, Division chair, Department Head, Program Assistant, teaching staff, residents, Competence Committee and the Residency Program Committee (or equivalents). Visits to individual sites should take place as appropriate. There should be a careful assessment of the quality of the program based on the general and specific standards of accreditation as outlined by the respective College.
Meeting with the Program Director
The meeting with the Program Director is to ensure that the program structure meets the Accreditation Standards. For example:
- How does the RPC function? Are meetings frequent enough? How are decisions made?
- Is there appropriate representation on the Committee (i.e., Faculty members, Educators, Teaching Site Representatives, elected Resident Representatives)?
- How does the program review evaluations (of faculty, rotations, teaching sites)? What happens to this information and have any changes been made recently based on these reviews?
- Does the program provide opportunities for residents to evaluate the quality of their education?
- How do residents and faculty know how to target their teaching and learning on any given rotation?
- How are residents provided an opportunity for graded responsibility?
- Are exam Results consistent or has there been a significant reduction in performance over the last few years? Are they consistently below national average? If so, this may be a sign of a problem in the educational program.
- How did the program address weaknesses identified during the last review?
- What educational initiatives have been developed or updated since the last review?
- How does the program deal with residents in difficulty?
Meeting with the Program Assistant
There are new Accreditation standards relating to the Program Assistant, and this meeting is to explore the PA’s formal role description, role within the program, and relationships with program leadership, residents and the PGME office. Questions to consider include:
- Do you have a role description? Does it accurately reflect your work? Is it up to date?
- Do you receive feedback, formally or informally?
- Do you receive opportunities for professional development?
Meeting with the Department Head & Division Chair
This meeting serves to identify the involvement of the Head in the Postgraduate program.
Questions to consider include:
- Where does Postgraduate Education fall within the Department’s mandate?
- How much does the Head support the Program Director?
- Are adequate resources available to the program (administrative, financial, physical, material)? And if not, what efforts are being undertaken to obtain resources?
Meeting with the Residents
The reviewers will meet with all residents in the program. In large programs it will be customary to meet separately with the junior residents and senior residents.
This meeting is to allow the residents to identify the strengths and weaknesses of the program. It is important to be positive and give the residents a feeling of openness. It is suggested that the Review Team Chairperson start the discussion with an opening remark by indicating the purpose of the Internal Review and that residents should feel free to discuss any issue. It is also important to emphasize that all discussions will remain confidential and anonymous should there be a need to identify issues in the report.
Question the residents on the following points:
- Do they think the program is meeting the specialty training requirements?
- Are residents made aware of their educational objectives and are these being met?
- Are the residents receiving (enough) feedback?
- Do the senior residents feel that the program provides adequate opportunities to develop their skills necessary to function as a specialist physician?
- How do residents perceive the service to education balance? Do they feel there is a good balance between education and service expectations?
- Are there issues of intimidation and harassment in the program?
- Do residents feel there is open communication within the program?
- Do residents know where to turn if they have an issue?
- What are the strengths of the program?
Meetings with Teaching Faculty, Residency Program Committee (or PGEC) and Competence Committee (or RAC)
These meetings are to obtain feedback on how the members of the program perceive the quality of the education and the structure of the program. It is also an opportunity to question members of the Residency Program Committee. Questions to consider include:
- Do faculty receive feedback on their teaching? Do they feel their teaching is valued?
- How does the program communicate with faculty in the Division/Department?
- Is the RPC dealing with issues identified at meetings and is there a follow up mechanism?
- Do members (apart from the PD) understand processes within the program, RPC and CC?
- How does the Competence Committee review assessment data and make decisions? How are these decisions communicated back to the residents?
It is recommended that a portion of this meeting should be with the Residency Program Committee without the Program Director, Division Chair, or Department Head present, to allow for frank discussion.
Preparation for Exit Report
This meeting is to allow the Internal Review Team to come to a consensus on the apparent areas for improvement of the program and to prepare for the Exit meeting with the Program Director and the Associate Dean. The Internal Review Team should decide what they will report on during the Exit meeting.
Exit Meeting
The exit meeting is simply to obtain clarification on any issues and to outline to the Program Director the findings of the review. Be sure to identify the areas for improvement of the Program. Give an opportunity for the program to provide feedback on the comments you made. This will help the Internal Review Team to identify whether a specific issue is really a weakness/problem or if it was just a perception.