July 21, 2017

How to write a test for an
e-learning course

A test question is one of the key element in the e-learning course. Tests are used in tasks of any difficulty level, in any game or case. Tests are often the main tool to control knowledge after the training is over.

In spite of their importance, tests are sometimes underestimated. They are created at the very end, when everyone suffers from the lack of time and energy. One might think: "Oh, common! Is it hard to write 10-15 test questions?" Nevertheless, the test design is a true science. If you are interested in the subject, you may refer to the Russian Standard for Human Resources Testing. You will find their valuable ideas for e-learning developers too.

I would like to give my recommendations on writing tests. It's worth noting, that I do not have a goal to create tests that correspond to all psychometric requirements (reliability, representativeness, validity, reliability). However, the rules mentioned here would help people with other basic business duties in creating tests.
Evaluate things which need to be evaluated
The first rule and, at the same time, the most important thing. The topic of the tests should be intrinsically linked to the goals of the course. Connie Malamed suggests ranking the goals of their importance and determining how many tests you need to solve each task. Even if you do not use this kind of time-consuming method, it is important to link every question to the specific educational task. That's how we avoid creating questions on "simple" topics, just to fill the space. Consider the question "what do we want to evaluate?". What skills and professionally important qualities?
Focus on practice
Tests are often criticized for checking superficial knowledge. One of the best ways to solve this issue is to use questions based on true situations. For example, avoid asking "Who is a partner of the company?". Choose this one instead: "You need to call a partner of the company and arrange a meeting. Who will you call? "
Avoid being too academic
It is better to avoid the phrases like "Choose the right statement" or "Which is the odd one out?". I personally believe that the options such as "all of the listed above" and "there is no right answer" are unacceptable. This kind of answers reminds me of the university years, there is no practical aspect in them.
Test knowledge comprehension, rather than the level of attention
Please avoid negations, double negations, and other wordings, that should be read into to recognize the correct answer. There are other techniques for checking employees' attention to details. The question difficulty should depend on the content, rather than on the wording.
Keep the same style
The tests should have the same level of difficulty, tone, and wordings. It applies to the answers too: the distractors and the correct answers should have the same length and the similar grammar.
Write it simply
The basic rules for high-quality texts can be applied here as well: use simple sentences, avoid complicated participial clauses, save a list of forbidden words on your desktop, including there "only", "always", "never", "absolutely". A student should understand your words with no effort.
Create a clear instruction to the tests
A standard instruction includes the number of tasks in the test, time needed to finish them, the ways to perform the tasks of different difficulty levels, and the number of correct answers to successfully pass the test.
Give a feedback
When students have finished the test, do not leave them uncertain. You would better show them what questions were answered correctly and what tests needed to be corrected. You could avoid showing them the right answers, but indicate the tests with errors.
These are my recommendations. I hope you would find this information helpful.
Privacy policy
1. Any information transfered by the Parties to each other when using the Website resources is considered to be confidential.

2. The user gives permission to the Level LLC Company to collect, process and store their personal data, as well as to send text and graphic advertising information.

3. The Parties are obliged to adhere this agreement, which regulates legal relations for the establishment, modification, and termination of the privacy mode for the Parties' personal information, and not to disclose confidential information to third parties.

4. The Level LLC company collects two types of information about the User:

1) the personal information deliberately disclosed by the User to the Level LLC Company to use the Website content;

2) the technical information automatically collected by the Website software at the time of its visit. During the User's visit, the information from the standard server logs is automatically available for the Help Desk. It includes the IP address of the User's computer (or the proxy server if it has been used to get access to the Internet), the ISP name, the domain name, the type of browser and operating system, the information about the website used to transit the Website, the website pages visited by the User, the date and time of these visits, the files that the User has downloaded. This information is analyzed by the software in the aggregated (depersonalized) form to examine the Website traffic; it is used in proposal development for its improvement and progress. The connection between the IP address and the User's personal information is never disclosed to third parties, except where required by the law of the User's residence country.

5. The Level LLC Company takes the User's personal data security very seriously and never provides the User's personal information to anyone, except upon the direct request of the authorized government body (such as, upon written request of the court). All personal information of the User is used to communicate with him, to execute the order concluded between the Website Users with the use of the Website resources, to analyze the Website traffic, to develop proposals for its improvement and progress, and may be disclosed to other third parties only with his/her permission.

6. The Level LCC Company protects the User's personal information and applies common security methods to protect information from loss, distortion and unauthorized distribution. Its security is implemented by software network protection tools, access control procedures, cryptographic data protection tools, and the privacy policy compliance.

7. The website implements a user authentication technology based on the cookies. The cookies are small files saved on the user's computer through a web browser. The cookies may be saved in the computer used to access the Website and will be used later for automatic authorization, for collecting statistic data, website traffic data in particular. The Website Administration does not store personal data or passwords in cookies. The user has the right to prohibit the cookies saving on the computer for website access, by proper configurations in his/her browser. It is well to bear in mind that all services using this technology may not be available.