{"id":5204,"date":"2020-05-18T10:45:03","date_gmt":"2020-05-18T08:45:03","guid":{"rendered":"https:\/\/blog.collaborator.biz\/?p=5204"},"modified":"2021-06-17T10:03:44","modified_gmt":"2021-06-17T08:03:44","slug":"good-test-bad-test","status":"publish","type":"post","link":"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/","title":{"rendered":"A Good Test vs a Bad Test, or How NOT to Make a Knowledge Assessment Test"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_1 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#What_is_given\" >What is given:<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#We_need_to_clarify_the_conditions_of_our_task\" >We need to clarify the conditions of our task.<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Solution\" >Solution:<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#What_we_should_remember_when_making_a_test\" >What we should remember when making a test<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#1_A_question_should_be_a_question\" >1. A question should be a question<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example\" >Example:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#2_Start_the_question_with_the_main_point\" >2. Start the question with the main point<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example-2\" >Example:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#3_Use_simple_and_short_phrases\" >3. Use simple and short phrases<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example-3\" >Example:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#4_%E2%80%9CChildish%E2%80%9D_and_%E2%80%9Cidiotic%E2%80%9D_questions\" >4. \u201cChildish\u201d and \u201cidiotic\u201d questions<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example-4\" >Example:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#5_Use_believable_distractors\" >5. Use believable distractors<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example-5\" >Example:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#6_Remove_%E2%80%9Call_answers_are_correct%E2%80%9D_and_%E2%80%9Cthere_are_no_correct_answers%E2%80%9D\" >6. Remove \u201call answers are correct\u201d and \u201cthere are no correct answers\u201d<\/a><ul class='ez-toc-list-level-4' ><li class='ez-toc-heading-level-4'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Example-6\" >Example:<\/a><\/li><\/ul><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/collaborator.biz\/es\/blog\/good-test-bad-test\/#Conclusion\" >Conclusion<\/a><\/li><\/ul><\/nav><\/div>\n<p class=\"qtranxs-available-languages-message qtranxs-available-languages-message-es\">Sorry, this entry is only available in <a href=\"https:\/\/collaborator.biz\/en\/wp-json\/wp\/v2\/posts\/5204\" class=\"qtranxs-available-language-link qtranxs-available-language-link-en\" title=\"EN\">EN<\/a>.<\/p><p>It is difficult to make a good knowledge assessment test. I faced this problem back in 2003. We started a distance learning system (DLS) at Vinnytsia National Technical University and began to accumulate a database of tests for various courses. It is impossible to say that all of them were perfect. All teachers, including experienced ones, made mistakes that turned the tests ineffective.<br \/>\nLater, we created our learning platform \u2013 <a href=\"https:\/\/collaborator.biz\">Collaborato<\/a>r. This is an LMS for business. And now, when it serves more than fifty companies in Ukraine, I again see similar errors in test questions.<br \/>\nIt might seem that making a good test is impossible without solid methodological skills and pedagogical experience. But in fact, common sense, a little time and some simple tricks are enough to receive a good result. I\u2019ll tell you about them.<br \/>\n<!--more--><\/p>\n<h2><span class=\"ez-toc-section\" id=\"What_is_given\"><\/span>What is given:<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"We_need_to_clarify_the_conditions_of_our_task\"><\/span>We need to clarify the conditions of our task.<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ol>\n<li>This is a knowledge assessment test. Such a test determines the level of understanding or confirms the assimilation of information. This is a measuring tool. Its result is a numerical value, the number of points scored.<\/li>\n<li>We consider only the test with the \u201cclosed\u201d type of questions, where you need to make a choice from the proposed options, and not write something of your own. These tests are very popular in the LMS, because the answers to them are checked by the algorithm, i.e. determining the result does not require the participation of a human teacher.<\/li>\n<li>We accept that there are enough questions for the statistical reliability of the result in the test (at least more than 100 questions). The number of questions sufficient for such reliability is a separate topic for discussion. Here we focus on the quality of test questions.<\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"Solution\"><\/span>Solution:<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h3><span class=\"ez-toc-section\" id=\"What_we_should_remember_when_making_a_test\"><\/span>What we should remember when making a test<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ol>\n<li>Any test question can be asked differently.<\/li>\n<li>Any knowledge assessment test can be reduced to simple types of questions, such as choosing one or more from many options. Complicating without urgent need is evil.<\/li>\n<li>We use infostyle for the questions and answer options. If you are not yet familiar with the book <a href=\"https:\/\/www.yakaboo.ua\/ua\/pishi-sokraschaj-kak-sozdavat-sil-nye-teksty.html\">Write and Reduce: How to Create a Strong Text<\/a>, then it&#8217;s high time to do it. I recommend to know and apply infostyle when formulating questions. This will make them understandable and reduce stress in test takers.<\/li>\n<\/ol>\n<h3><span class=\"ez-toc-section\" id=\"1_A_question_should_be_a_question\"><\/span>1. A question should be a question<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Do not make your employees to complete unfinished sentences or fill in ragged phrases. They cannot immediately understand either what you want from them, or the meaning and purpose of such a question in the test. They have to re-read all the answers to formulate in the mind the question they will have to answer. Why not just ask the question directly?<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">A feature of the M2 Eco tonometer is:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">absence of a connector for power supply<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">equipment with a fan-like cuff<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">eco-plastic housing<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">shockproof housing<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">interchangeable cuff<\/span><\/li>\n<\/ul>\n<\/td>\n<td><span style=\"font-weight: 400;\">Which of the following are the characteristics of the M2 Eco tonometer?<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">absence of a connector for power supply<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">equipment with a fan-like cuff<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">eco-plastic housing<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">shockproof housing<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">interchangeable cuff<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span class=\"ez-toc-section\" id=\"2_Start_the_question_with_the_main_point\"><\/span>2. Start the question with the main point<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Immediately draw the attention of the test taker to what is required of him. Start with the essence of the issue, with the main thing. Follow the example of the English language. A correctly constructed sentence begins with the subject and predicate (who does what). Only then all other details are added.<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example-2\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">When selling an Ala-Dofinua special dish, is a branded wet tissue added?<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Is it necessary to add a branded wet tissue when selling a special dish \u201cAla-Dofinua\u201d?<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">An employee can be removed from work by the decision of the employer, drawn up in the form of an Order, in what case?<\/span><\/td>\n<td><span style=\"font-weight: 400;\">In what case can an employee be removed from work by the decision of the employer, drawn up in the form of an Order?<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span class=\"ez-toc-section\" id=\"3_Use_simple_and_short_phrases\"><\/span>3. Use simple and short phrases<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Long sentences are like a ball of thread. One has to untangle all the commas, pronouns and parts of speech in order to understand the meaning of the question. Simplify your questions.<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example-3\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">The patient complains of a sore throat, fever, weakness. On examination, the tonsils are covered with abundant light plaque. What pathogen causes sore throat?<\/span><\/td>\n<td><span style=\"font-weight: 400;\">What pathogen causes tonsillitis (tonsils covered with abundant light coating)?<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Put in order the sequence of actions in order to find information about the patient and get to his medical appointments, if you have the number of his outpatient card.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Set the correct search sequence for the patient\u2019s medical appointments by the number of his outpatient card.<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span class=\"ez-toc-section\" id=\"4_%E2%80%9CChildish%E2%80%9D_and_%E2%80%9Cidiotic%E2%80%9D_questions\"><\/span>4. \u201cChildish\u201d and \u201cidiotic\u201d questions<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>This is a \u201ccasual\u201d terminology. Questions with an obvious answer are called \u201cchildish\u201d, and questions with an impossible answer are called \u201cidiotic\u201d. Both options are not allowed in knowledge assessment tests. They only distort the test result, which leads to an incorrect assessment of the employee.<br \/>\nI must say that \u201cchildish\u201d questions are not necessarily something bad. In the case of self-control, they are appropriate. Obvious answers help the authors of training courses to highlight the main and significant information, to focus the listener\u2019s attention on it. But if the \u201cchildish\u201d question does not concern the essential aspects of knowledge, it is useless.<br \/>\nMany LMS have tools to detect simple and complex questions. Such questions should be reformulated. Find those to which all employees answer correctly in more than 95% of cases \u2013 these are \u201cchildish\u201d questions. Questions which receive less than 5% of correct answers can be considered \u201cidiotic\u201d. Remember that this works if all selected testing cases were carried out under the same conditions and there were many of them \u2013 at least about a hundred or more.<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example-4\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td>How to minimize the formation of limescale on the windows of shower stalls?<\/p>\n<ul>\n<li>Glass thickness.<\/li>\n<li><strong>Anti-plaque option.<\/strong><\/li>\n<li>Decor on the glass.<\/li>\n<\/ul>\n<p><em>This is a childish question, because the correct answer \u2013 the Anti-plaque option \u2013 is obvious and easily determined by the exclusion method.<\/em><\/td>\n<td><span style=\"font-weight: 400;\">Which of the following minimizes the formation of limescale on the windows of shower stalls?<\/span><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Absence of decor on the glass<\/span><\/li>\n<li style=\"font-weight: 400;\"><b>Anti-plaque processing<\/b><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Additional glass polishing<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">AntiCalcium coating<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>&nbsp;<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span class=\"ez-toc-section\" id=\"5_Use_believable_distractors\"><\/span>5. Use believable distractors<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Wrong answer options \u2013 distractors \u2013 should be believable. Otherwise, they can be instantly recognized. A question with such answers is useless both for self-testing and in the certification test.<br \/>\nMoreover, such answer options reveal the incompetence and haste of the test compiler. They often bring a smile to those employees who are at least a little in the know of the subject.<br \/>\nMaking the right distractors is a separate topic for discussion. You can read about it briefly on <a href=\"https:\/\/ru.wikipedia.org\/wiki\/%D0%94%D0%B8%D1%81%D1%82%D1%80%D0%B0%D0%BA%D1%82%D0%BE%D1%80_(%D1%82%D0%B5%D1%81%D1%82%D0%B8%D1%80%D0%BE%D0%B2%D0%B0%D0%BD%D0%B8%D0%B5)\">Wikipedia<\/a>.<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example-5\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td>What action of the manager should be the first one in the event of a fire in a room with people?<\/p>\n<ul>\n<li><strong>Evacuate people from the premises<\/strong><\/li>\n<li>Call the security service<\/li>\n<li>Be the first to leave the room<\/li>\n<\/ul>\n<\/td>\n<td>What action of the manager should be the first one in the event of a fire in a room with people?<\/p>\n<ul>\n<li><strong>Take people out of the room<\/strong><\/li>\n<li>Call firefighters by calling 101<\/li>\n<li>Turn on the fire alarm<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h3><span class=\"ez-toc-section\" id=\"6_Remove_%E2%80%9Call_answers_are_correct%E2%80%9D_and_%E2%80%9Cthere_are_no_correct_answers%E2%80%9D\"><\/span>6. Remove \u201call answers are correct\u201d and \u201cthere are no correct answers\u201d<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>Firstly, using this approach, we play on the nerves of users and lose their time.<br \/>\nWhat do you feel when you see the option \u201call answers are correct\u201d? Doubt? Even a professional begins to doubt whether he understood everything correctly and starts to re-read the question and answer options.<br \/>\nSecondly, this answer option encourages you to choose it or vice versa \u2013 not to choose it. In psychology, this is called the \u201cextreme response set-up\u201d trap. The objectivity of the answer to the question is lost.<br \/>\nThirdly, the use of \u201cno correct answers\u201d \u200b\u200bcauses only confusion and \u201ca sense of trick\u201d. The obvious goal of such questions is to make the test taker fail, and not to determine his level of knowledge.<br \/>\nRemake the question by choosing several answers and add one or two believable distractors. Otherwise, break it down into several questions.<\/p>\n<h4><span class=\"ez-toc-section\" id=\"Example-6\"><\/span>Example:<span class=\"ez-toc-section-end\"><\/span><\/h4>\n<table>\n<tbody>\n<tr>\n<td style=\"width: 50%; text-align: center;\"><span style=\"color: #ff0000;\"><b>Wrong<\/b><\/span><\/td>\n<td style=\"text-align: center;\"><span style=\"color: #008000;\"><b>Right<\/b><\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">An employee can be removed from work by the decision of the employer, drawn up in the form of an Order, in the case of?<\/span><\/p>\n<ul>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Coming to work being intoxicated (in a state of drug or alcohol intoxication)<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Refusal or avoidance of mandatory medical checkups, training, instruction or knowledge examination on labor protection<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">According to the instructions of state authorities and in other cases stipulated by the legislation of Ukraine<\/span><\/li>\n<li style=\"font-weight: 400;\"><b>All answers are correct<\/b><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/td>\n<td><span style=\"font-weight: 400;\">In what cases can an employee be removed from work by the decision of the employer drawn up in the form of an Order?<\/span><\/p>\n<ul>\n<li><b>Coming to work being intoxicated (in a state of drug or alcohol intoxication)<\/b><\/li>\n<li><b>Refusal or avoidance of compulsory medical checkups, training, instruction or knowledge examination on labor protection<\/b><\/li>\n<li><b>According to the instructions of state authorities and in other cases stipulated by the legislation of Ukraine<\/b><\/li>\n<li><span style=\"font-weight: 400;\">Late arrival and violation of work schedule<\/span><\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<h2><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span>Conclusion<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">These are the most common cases of irrational formation of test questions. If you have experience working with problem tests, please share, write your examples and what you did with them in the comments.<\/span><br \/>\n<span style=\"font-weight: 400;\">If you have the time and desire to thoroughly understand the methods of developing pedagogical tests, you should refer to the science of Testology. Here is what will help you with this:<\/span><\/p>\n<ol>\n<li><a href=\"http:\/\/testolog.narod.ru\/Theory12.html\"><span style=\"font-weight: 400;\">Articles and works of Avanesov V.S.<\/span><\/a><span style=\"font-weight: 400;\"> \u2013 His works are devoted to pedagogical testing and this is one of the best ways to understand the theory of tests.<\/span><\/li>\n<li><a href=\"https:\/\/hum.edu-lib.com\/szbrannoe\/avanesov-v-s-kompozitsiya-testovyih-zadaniy-onlayn\"><span style=\"font-weight: 400;\">Avanesov V.S. <\/span><i><span style=\"font-weight: 400;\">Composition of Testing Tasks<\/span><\/i><\/a><i><span style=\"font-weight: 400;\">. <\/span><\/i><span style=\"font-weight: 400;\">Training book. 3rd edition added. Moscow, Testing Center, 2002. 240 p. \u2013 The recommendations collected in this publication remain relevant until now.<\/span><\/li>\n<li><a href=\"http:\/\/www.vep.ru\/statyi\/method.html\"><i><span style=\"font-weight: 400;\">The Secrets of Making Tests<\/span><\/i><\/a> <span style=\"font-weight: 400;\">\u2013 A good article on how to make tests on real cases of the banking sector.<\/span><\/li>\n<li><i><span style=\"font-weight: 400;\">Writing Good Multiple Choice Test Questions.<\/span><\/i><span style=\"font-weight: 400;\"> \u2013 A 2013 article on compiling multiple-answer tests and ways to create the right distractors.<\/span><\/li>\n<li><a href=\"https:\/\/www.twirpx.com\/file\/1712918\/\"><span style=\"font-weight: 400;\">Bulah I., Mruha M. <\/span><i><span style=\"font-weight: 400;\">Making Qualitative Tests<\/span><\/i><\/a><span style=\"font-weight: 400;\">. Tutorial.\u2013 Kyiv: Meister-class, 2006. 160 p. \u2013 A manual on pedagogical testology, the presentation style is academic, but there are many practical examples.<\/span><\/li>\n<li><a href=\"http:\/\/testology-book.ru\/\"><span style=\"font-weight: 400;\">A. Shmelev. <\/span><i><span style=\"font-weight: 400;\">Practical Testology<\/span><\/i><\/a> <span style=\"font-weight: 400;\">\u2013 recommended by Igor Beh, contains many good examples.<\/span><\/li>\n<\/ol>\n<hr \/>\n<p style=\"text-align: center;\"><i><span style=\"font-weight: 400;\">Stay connected with us on <\/span><\/i><a href=\"https:\/\/www.facebook.com\/lmscollaborator\/\"><i><span style=\"font-weight: 400;\">Facebook<\/span><\/i><\/a><i><span style=\"font-weight: 400;\"> and <\/span><\/i><a href=\"https:\/\/www.linkedin.com\/company\/18181447\"><i><span style=\"font-weight: 400;\">Linkedin<\/span><\/i><\/a><i><span style=\"font-weight: 400;\">!<\/span><\/i><\/p>\n<p style=\"text-align: center;\"><i><span style=\"font-weight: 400;\">Subscribe to our e-learning newsletter, get a discount on LMS Collaborator promo code: <\/span><\/i><b><i>LMS2020-05<\/i><\/b><\/p>\n<p style=\"text-align: center;\"><a href=\"https:\/\/bit.ly\/2JWGEJD\" target=\"_blank\" rel=\"noopener noreferrer\"><img decoding=\"async\" class=\"aligncenter\" src=\"\/wp-content\/uploads\/2018\/07\/test-drive.svg\" alt=\"Logo LMS Collaborator\" width=\"300\" \/><\/a><\/p>\n<p><\/p>","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":6566,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-5204","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/posts\/5204","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/comments?post=5204"}],"version-history":[{"count":0,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/posts\/5204\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/media\/6566"}],"wp:attachment":[{"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/media?parent=5204"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/categories?post=5204"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/collaborator.biz\/es\/wp-json\/wp\/v2\/tags?post=5204"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}