Skip to main content

Online-openbook-examination with the LPLUS teststudio 3

Brief description

Online Open Book exams are characterized by the fact that

  • they are written simultaneously in a limited period of time at the home workstation,
  • any materials such as books and recordings may be used,
  • there is no proctoring and
  • there is no authentication via passport control.

Even if this form of examination resembles a written exam, it is not considered as a written exam in the sense of AT-PO §8 para. 9.

Open-book exams usually aim to test application, analysis, and synthesis skills via essay questions and other open response formats. It is important to note that the answers cannot be determined directly via internet research (e.g. case analysis or evaluation of data sets).  The e-exam system of the University of Bremen (LPLUS-Teststudio 3, hereafter LTS3) is used for the execution, the technical preparation and support including the digitization of the questions is done by the ZMML. The subsequent assessment is carried out online by the exam administrators. Equivalent alternative formats for students who lack the technical requirements for online examinations must be offered in order to maintain equal opportunities and studyability (fairness requirement).

Suitable number of participants

100 to 800 students

Procedure

  1. early information of the students about the procedure (registration and deregistration, withdrawal from the exam, technical requirements, time schedule) and about regulations, e.g. in case of technical problems and access barriers
  2. provision of the examination questions 28 days before the examination
  3. set-up of the exam and the system access by the ZMML 14 days prior to the exam
  4. online quality control: content, time allotment, max. number of points, assessment settings, task sequence and other options. Completion 10 days before the exam
  5. provision of the list of participants as an Excel spreadsheet with surname, first name, matriculation number and university e-mail address by the person responsible for the examination 7 days before the examination.
  6. sending of the access data and further information to the students by e-mail by the ZMML 6 days before the examination.

In the time until the examination date, access problems are then solved and, if necessary, final adjustments and settings are made. When registering for the main examination, a demo or trial examination can also be activated, which the students can start as a self-assessment to get to know the system and the question types independently of time (only one execution possible).

Procedure of the exam for students (see also video tutorial)

  1. log-in at online.eassessment.uni-bremen.de with the data received by e-mail (valid only for this date and exam, for further dates and exams new login data will be created).
  2. display of a declaration of consent, health and independence to be confirmed
  3. release of test start approx. 5 minutes before the official start, cancellation of release approx. 15 minutes after official start.
  4. display of an information text at the start of the examination, in which the most important, examination-specific conditions are pointed out (procedure in the event of technical problems, announcement of the plagiarism check, consequences in the event of attempted cheating, ...).
  5. persistent technical problems should be documented by the students (screenshots) and reported to the person responsible for the examination in a timely manner.  If necessary, the attempt will not be evaluated and a repeat date or an alternative form of examination will be arranged. Examinations handed in without credible problem documentation count as a regular examination attempt.

Further advice for those responsible for examinations

Please plan to provide an exam-related communication option via video conferencing, email, chat, or telephone hotline in case of problems or urgent questions. Unfortunately, this cannot be provided by the ZMML. If sufficient identical texts are found when carrying out a plagiarism check, we recommend that all affected examination performances are assessed as "failed". Following the online assessment in the examination system, you can independently export the result lists, exam printouts (PDF) and statistics. The results will be announced in the usual way (usually PABO), the obligation to archive the examination performance (approx. 3 years, see archiving ordinance) lies with you.

Advantages

  • The focus on transfer and application knowledge as well as the need for efficient use of relevant sources increase the competence orientation of the exam
  • Unlike oral video exams or homework, identical tasks can be set for all students. In addition, time flexibility is gained in the assessment, which can also be carried out in teams.
  • By means of a restrictive time quota as well as the combination of technical options such as random selection of questions, random order when compiling the examination, predefined processing time per question and fixed processing order, the probability or success of students working together during the examination can be considerably reduced.
  • The number of participants is essentially limited by the available resources for correction. From a technical point of view, experiences with up to 600 simultaneous accesses have been made so far, where no performance problems or a significant load on the servers was observed.

Obstacles

  • Factual knowledge can only be tested indirectly via its correct application.
  • Compared to an e-exam in the test center with predominantly closed questions, the correction effort is very high.
  • Equivalent to homework, students cannot be prevented from communicating with others or having someone else write the exam. When registering in the examination system, a declaration of independence is displayed, which must be confirmed (see also AT-PO §8 para. 9).
  • A test under time pressure, with the aim of reducing the exchange among students, may lead to construct-irrelevant variances, i.e. the testing of skills that are not part of the intended learning outcomes. For example, quick thinkers may be given preference, or to a certain extent media competence may be tested instead of subject competence.
  • Unequal technical conditions among students (hardware, Internet connection) endanger equal opportunities, as is the case with all synchronous online formats.
  • Technical problems on the part of the students (disconnections, slow network) are possible. In this case, retries or alternative formats should be offered.Faktenwissen kann nur indirekt über dessen korrekte Anwendung geprüft werden.