Hacker News Reader

Comment by josephcsible | Hacker News Reader

Consider this hypothetical situation: my grandma is having trouble with something on a website, so she calls me for help. She talks me through what she's doing and what she sees, and I try to follow along, but I see something totally different because unbeknownst to us, the thing she's having trouble with is being A/B tested, she's in the "A" group, and I'm in the "B" group. Does Splitzy offer any solutions for this problem?

View on HN

Hey Joseph, thanks for the comment. To be honest, this scenario never crossed my mind once xD. I have not implemented any solution to this problem... and as I'm writing this comment I'm not sure what the solution would look like. Surely the other big A/B testing tools have solved this and I could inspire myself from their solutions. Splitzy is very new (a couple of weeks old), so I haven't really covered all the possible use cases. It's very simple right now =).

I think your only option would be screenshare or visit your Grandma, there's not really a lot an A/B tool could do about that problem

I'd be curious to know what the other a/b testing tools are doing regarding this problem if anything.

I think you could possibly allow the user to copy the "fullUrl" and share it with others. This fullUrl will have all the AB tests in the query param, and when another user visits the url - he'll have all the same AB tests

google.com?835483558=A&gdfmgfmgd=A&5435848=B

Something like this

Agreed. It's usually noted in the URL, the metadata, or JS. All of which can be curled, processed, and diff-ed.

Right! That makes sense. I guess you still need some technical knowledge though.

Reply on news.ycombinator.com