InnerWeb
Skip to main content

Multilingual test questions: best practices

The test after safety training is evidence of understanding, so its language versions must measure the same thing. An instructor who translates questions into Ukrainian, Russian and English should ensure equal difficulty, a shared answer key and a fair pass threshold. Below are the practices and a checklist.

4
languages of the kiosk training system

Why the test versions must be comparable

Training consists of material and a multiple-choice test. If the Ukrainian version is harder than the Polish one, the result stops measuring knowledge and starts measuring the quality of the translation. A worker fails not because he does not understand the rules, but because the question is ambiguous.

A plant that runs training in four languages (the kiosk training system supports Polish, English, Ukrainian and Russian) needs one answer key and one pass threshold, not four independent tests.

Practices for preparing the test

The practices below cover the whole cycle of preparing a test: from the source version, through translation, to control before it is made available on the kiosk.

One source version, translations made from it

Prepare the test in one language, usually Polish, and approve its content. Only then translate it. Every change to a question goes back to the source version and then to all translations.

The translator knows safety terminology

Questions about hazard zones, personal protective equipment and evacuation procedures require terms that a general translator may not know. Ask a person from the workforce to read the version and report any wording that sounds unnatural.

Short questions and unambiguous answers

A multiple-choice test works well with questions built around a single idea. Avoid double negatives and answers such as all of the above, because they translate worst.

The same number of questions and answers

Every language version has the same number of questions and the same number of answer options. A difference in the number of questions changes the chance of passing by guessing.

Example calculation: questions in the test per language version

Example calculation: questions in the test per language versionBar chart: 10 questions in each of the four language versions of the test.0246810questionsPolish: 10 questions10PolishEnglish: 10 questions10EnglishUkrainian: 10 questions10UkrainianRussian: 10 questions10Russian
Source: Example calculation: assumption of a test with 10 questions in each of the four versions

Classic or scenario mode

Training runs in classic mode, in which the material is followed by one final test, or in scenario mode, in which each step draws questions and requires a set number of correct answers, and a failed step repeats a fragment of the material. For multilingual groups scenario mode can be fairer: an error in one step sends the person back to the right fragment instead of invalidating the whole result.

Scoring of a scenario pass takes place on the server, and the player never receives the scoring of answers. As a result the answer key does not leak into the kiosk browser, and all language versions are assessed by the same rule. A single material can also be set to play after the test, which gives a flow of video, test, PDF.

How to check the fairness of the test after the first group

After the first group has finished, compare the results across the languages. If in one version a particular question is answered wrongly clearly more often than in the others, you correct the translation of that question, not the pass threshold. This analysis does not require advanced tools: a summary of questions and the share of wrong answers in each version is enough.

Remember that the availability of training in a given language depends on the plant's materials. The system provides the mechanism for choosing the language, the requirement and the proof of completion, while the quality of the test translation remains the responsibility of the instructor.

Checklist

Video

Frequently asked questions

Can the test have a different pass threshold in each language?

We do not recommend it. The threshold is meant to measure knowledge, so it should be shared, and the translation quality of the questions is what should be improved.

Does the player know the scoring of answers?

No. Scoring of a scenario pass takes place on the server, and the player does not receive the scoring of answers.

What does the system do after a failed scenario step?

The failed step repeats the relevant fragment of the material, and the questions in the step are drawn again.

A test in four languages without drift

We will show the classic and scenario modes on your material and agree a pass threshold for all versions.

Let's talk