A/B Usability Testing Technique Format?

I'm currently preparing a usability test for a module interface I'm designing and I want to be able to structure the test to ensure the best results.

Currently, there are 3 versions of the interface, and three groups to be tested:

Version A

  • Module 1
  • Module 2
  • Module 3

Version B

  • Module 1
  • Module 2
  • Module 3

Version C

  • Module 1
  • Module 2
  • Module 3

Currently, I'm a bit unsure on how to structure and randomize what each group tests and the order they test each Version to ensure people don't "learn" how to do the tasks I'll ask them to do.

My idea is this so far for the test:

Group A: Version A1, Version B2, Version C3

Group B: Version A2, Version B3, Version C1

Group C: Version A3, Version B1, Version C2

Would it make a difference if different overall version was tested first for different groups (ie. Group B would do Version B3 first, then Version C1, then Version A2) and does the module connected to the version tested make a difference?

Thanks and would appreciate any feedback.

Tags: , , , , , ,