Exam Simulations – Romania (FASMR)

Name of the activity: Exam Simulations

Country/NMO: Romania (FASMR)

Program: Medical Education Systems

Contact information: [email protected]

Type of the activity: Education

General description:

These activities have the purpose to create a similar or even identical exam environment as the real ones in order to accustomize the candidates with the entire evaluation process. By objectively analyzing their own performance, the participants can assess their knowledge with accuracy, thus specifically improving their lacks for better results.

Focus area:

Students’ involvement in medical education | Evaluation and Assessment

Problem statement:

Even if we refer to the admission mock exam or the simulation of the residency exam, the main purpose is to help the (future) students become familiar to the environment and process of these events. Furthermore, the participants can evaluate themselves and assess their knowledge and level of preparation. The examinees are thus mobilized in improving their performance for the actual exam and they learn how to manage their time and stress. Moreover, both kinds of simulations create an almost similar atmosphere like in the real exams, so the future students/residents have a clearer view of what should they expect.

Target groups and beneficiaries:

For the admission mock exam, the main target is represented by highschool students from 11th and 12th grades, but it can also be taken by anyone who wishes to sustain the admission exam at the Faculty of Medicine.
Regarding the simulation of the residency exam, the target consists mainly of senior year students. Nevertheless, participation is also allowed for younger students who want to verify their medical knowledge or for other persons who may wish to retake the residency exam.

Objectives and indicators of success:

For a better understanding of this topic, I have to mention that there are 4 LC’s which organize the simulation of the residency exam (OSM- Medical Students’ Organization of Cluj-Napoca, SSMB- Medical Students’ Society of Bucharest, SSMC- Medical Students’ Society of Craiova, SSMI- Medical Students’ Society of Iasi) and 3 which organize the admission mock exam (SSMB, SSMI, SSMHS- Hipocrates Medical Students’ Society of Sibiu).

Specific: Creating a similar or even identical exam environment as the real ones in order to familiarize the candidates with the entire evaluation process.

Indicator of success: Better achievement of time and stress management during the actual exam, information based on participants’ testimonials.

Measurable: Number of participants at the simulations of the residency exam:
SSMB: 700/ 4 simulations (indicator: the number is similar with the 2017 one)
SSMC: 160/ 2 simulations
SSMI: 400/ 2 simulations (indicator: we expect around 80% of 6th year students to participate, nevertheless a presence of >65% will be as good)
OSM: >200/ 5 simulations (indicator: we expect around 65% of 6th year students to participate)
Number of participants at the admission mock exam:
SSMB: 2700/ 1 simulation (indicator: great increase in the number of participants during the years: 1st edition- 2009- 400 participants; 2017- 2500 participants)
SSMHS: >300/ 1 simulation
SSMI: 1000/ 2 simulations (indicator: to have more participants than in the previous years, when there were between 500-1000)

Achievable: The simulations can be easily organized by the students’ organizations with the help of the faculties or other partners, regarding the administrative issues, especially the questions from the questionnaires.

Realistic: If we take a look at the indicators below, we can notice that there has been an increase in the number of participants for both kind of simulations. This suggests their relevance for the candidates in what their scores are concerned.

Time-bound: (see the attached file)
https://drive.google.com/open?id=1CBrlEJ76dFRscL7jDJydhOt_RY4lfDor-DlsjeqfMjc

Indicator: The timetable is usually maintained, especially since all of the events are organized based on the actual exams dates.

Methodology:

Simulation of the residency exam:
OSM: 5 simulations: 3/5: divided into specific chapters from the residency books; 2/5: all chapters included
SSMB: 4 simulations: 3/4: divided into specific chapters from the residency books; 1/4: all chapters included
SSMC: 2 simulations- all chapters included
SSMI: 2 simulations: 1/2: 1/2 of the subjects from the residency books; 1/2: all chapters included

The bibliography and method of grading is the same for all the centers, because the residency exam is a national evaluation, which takes place at the same time for everyone. The total number of questions is 200 (50/200 unique answer, 150/200 multiple choice). The maximum score that can be obtained is 950. For each question with 100% correct answers you receive 5 points/question. For a mistake in a question from the multiple choice section, 1 point is taken off the total of 5. The questionnaires are corrected by scanning, thus eliminating the human error. The entire duration of the exam is 4 hours.

Admission mock exam:
SSMB:
In order to attend the mock exam, participants have to register online on the project’s website, in the timeframe mentioned. They fill in all their required data and have to upload proof of their payment of the admission fee. A confirmation email is sent.
After the registration period is over, a list of all the accepted participants will be published online. To be mentioned that there is no selection of the applicants or limit number of entries, the only reason of rejection is the lack of payment in due time.
A few days before the actual mock exam, another list will be published, containing the assignment of the participants in the exam halls.
The exam takes place on the 19th of May. Results will be announced a few days later.
The entire process is in accordance with the faculty’s admission exam, the same regulation applies: 100 questions- 60 questions from biology (mandatory subject) divided into 18 with a single answer and 42 with multiple choice and 40 questions from either chemistry or physics (the candidate has the right to choose) divided into 12 with a single answer and 28 with multiple choice. The multiple-answer questions have a key, so there are not in-between points. The maximum score that can be obtained is 100. The questionnaires are corrected by scanning, thus eliminating the human error. The entire duration of the exam is 2.5 hours.

SSMI:
The entire process is in accordance with the faculty’s admission exam, the same regulation applies: 90 questions- 54 questions from biology (mandatory subject) and 36 questions from either chemistry or physics (the candidate has the right to choose). The questions can be with a single answer or multiple choice. The maximum score that can be obtained is 100 (10 points are given by default). The questionnaires are corrected by scanning, thus eliminating the human error. The entire duration of the exam is 3 hours.

SSMHS:
The registration for the courses, respectively the exam is taking part at The Faculty of Medicine from Sibiu 1 week before the 1st course starts. Of course, the event comes up online way before so people know about it and get ready for registration. Using their ID cards, they are paying the registration fee established by the local committee, simulation coordinator and Faculty, so it can cover all the material needed for the simulation and classes.
The entire process is in accordance with the faculty’s admission exam, the same regulation applies: 100 questions- 75 questions from biology and 25 questions from chemistry, both of them being mandatory subjects. There are 50 questions with a sinle answer and 50 with multiple choice. The maximum score that can be obtained is 100. The questionnaires are corrected by scanning, thus eliminating the human error. The entire duration of the exam is 3 hours.

In both kind of simulations (residency and admission), students are not allowed to possess any electronic devices and they are offered pen, papers and other related materials for the well being of the exam. They can keep a transparent bottle of water, preferably without the label; at the residency exam (simulation+ actual exam) they are allowed to keep also some food, but in a transparent bag.

Plans for evaluation:

For both kind of simulations, the evaluation is based on the participants’ feedbacks, comparisons with the previous editions (see indicators) and comparisons between the grades obtained by the participants to the ones obtained at the actual exam. Verifying if the hierarchy is maintained, therefore the accuracy of the mock exam.