Make sure the participant do these requirements:
- Populated the application form
- Accepted the rules through recording
- Answered the preliminary question
- Check if starting point is the same, don’t give advantage to one side
- If it looks that we must give advantage to one side, define how that will affect the end result
- Created Goal according to the format mentioned
- With Headline
- With Detailed Description
- What is target language?
- What is interface language?
- How much time will be spent on this?
- What resource will you use?
- What strategy will be used?
- What is not allowed?
- What is purpose of this experiment?
- Did Introduction video of himself
- Did Initial Test (If it’s a total beginner, skip this)
- Did Daily Checks
- Day Start
- Status Updates
- Day End
- Did Weekly Checks
- Did Final Test
- Record about his thoughts of the experiment
What are your Roles as an Admin
- Help the user to get the maximum of his task, help if he has problem, educate if needed
- Be fair judge, don’t take any side
- During the whole experiment we should be sure that we make fair comparison when review the entire flow. Must confirmed to multiple person
- Do the Current State Calculation correctly!
- Document the comparison, put together start and end state
- Make conclusion (Written, Video)
- Be Active in the Discord Channel
- If the participant don’t take much effort, ask him why he is not doing his best
- Educate them if necessary
- Remind participant to do all 3 types of daily checks if he is not doing it. Don’t skip 2 days in row to remind.
- Learn the Scoring of Initial Test and Final Test