In the testing cycle core concepts related to test development are presented. Click on a specific concept and see concrete steps on how to develop tests for signed languages aligned/related to the Common European Framework of Reference (CEFR).
The goal of such a pilot is to see if the test instructions, test items, procedure, rating procedure etc. work as planned. For example, when raters on a productive test have a huge difference in how they judge the signed language competences of a L2 learner, the rating scale/procedure needs to be revised. Or when students who already graduate from a four years BA programme perform worse on the same receptive test than first year students, one needs to investigate the reason and revise the test. After revising a test, test developers can start with a main study.
receptive test for DGS (Haug et al., 2014).
A rating procedure for signed language production is more difficult to achieve. For instance in an interview, like the adapted NGT Functional Analysis (NFA) version of the Sign Language Proficiency Interview (SLPI) which was developed for ASL, where a tester is engaged into a conversation with a test taker. The conversation is video-recorded and will be analysed later by three raters according to pre-defined criteria on a scoring-sheet, such as The individual Rater Worksheet B.
Following the definition of the purpose of language assessment, the content needs to be defined. Within the CEFR the content of assessment is “predetermined” within the domains of:
Here are some examples for the three domains of test items, taken from CEFR-aligned curricula from different signed languages and some examples for self-assessment.
Test level: A2
Skill: Receptive live
This test consists of eight (8) parts (page 7). For each part, you first read the description of the situation, and the questions and answers. Then go to the next page (click on the little hand). There you will find clips of the NGT texts and the questions.
Related to what is being signed, you are to choose one (1) answer out of a number of possible answers. Please tick the right answer (not more than one (1)).
In each fragment is indicated how much time you have to choose your answers. In total this test lasts 25 minutes.
Cliick here to find the video on “minuscule“
Instruction sheet for candidate
Test Level: A2
This test consists of three (3) parts:
The instructions for each part are on separate sheet. Before each part you are given the opportunity to read the instructions and to prepare.
Part 1: A dinner
A new colleague has come to work in your department/company, whom you really like. It so happens you both like to cook, and enjoy good food. You invite your colleague to have dinner with you at home. The following aspects should be addressed in the conversation:
Please click here to view the conversation. Note: the teacher also follows instructions to enable the student to perform at his/her best ability.
PRO-Sign self assessment example