Test: randomize presentation order

Currently, response options are presented without randomization, and hence, the first option is always correct.

• Randomize presentation order of the 4+ options
• Ideally, if possible, mask/replace filenames (1.jpg, 2.jpg...) so that the correct answer is not always 1.jpg (but this is not absolutely necessary)

changed milestone to %0.4: Tests and studies improvements

added Studies & tests To do labels

assigned to @dvanrossum

created branch 123-test-randomize-presentation-order to address this issue

Hello! Sorry, I'm not sure how we get to the test. I have tried /tests/1 and /tests/2, but that doesn't seem to be it. I have a vague memory that the test happened after the end of a session, if that the case is there a way to end a session without waiting the session duration?

Tests are a completely different feature, not related to end of sessions surveys. You can find more information about them on those issues:

• #34 (closed)
• #77 (closed)

Don't hesitate if you have any question.

Hello! I'm sorry, I really can't seem to find where to check that the user had a correct answer or not. I randomized the display of the answer, so the first one isn't always the correct answer anymore. But I'd like to check that it still detect correctly if the user answer correctly or not, to be sure that I didn't introduce a bug with my solution.

If I remember correctly, the number 1 is always the correct answer. So I guess that the randomization display should only impact the frontend, but the backend still remains the same. It means that if the frontend send 1 (even if it's not the first one displayed) it should be the correct one.

marked the checklist item Randomize presentation order of the 4+ options as completed

mentioned in merge request !4 (merged)

mentioned in commit a72f41ca

closed with merge request !4 (merged)