Strange results in A/A test in Google Optimize

I did an A/A test in Google Optimize to validate if my measurements are correct. There were ~500 relations on each page "variant" (A/A test => no difference in them). Results:

  • default page: 22% conversion rate
  • my "variant": 29% conversion rate

How come the conversion rate is so different?

Is the problem with too little data or bad implementation?

I have both GA and GOptimize in Google Tag Manager. I think I don't need to implement the "anti-flicker snippet", wouldn't help.

Many thanks!

Tags: , , , , , ,