Methods: The last of the written exams, which are performed annually, were held in Eskişehir in May 2016. The exam items were analyzed in terms of difficulty, discrimination, and validity.

Results: Correct answer items were distributed equally. The average percentage of questions answered correctly was 70.7%. Of the questions, 56% were answered above the average. Range of exam scores was narrower compared to last year’s exam. According to the item analysis; rate of questions with the desired difficulty level was 39%, rate of questions with the desired discrimination level was 52%, rate of invalid questions was 54%, and rate of questions with high level of validity was 9%. A comparison of the exams of years 2015 and 2016 revealed that the latter exam was easier, had low discrimination, and weaker validity.

Conclusion: According to our findings, subject areas and number of questions in the exam set were effective on the validity of the exam. At least 70% of the questions in the exam set should include the main topics of the specialty and the number of questions should not be changed according to years. With the Proficiency Board forming a question bank and keeping the questions with high validity in the bank, the exam may become more qualified over the years.