Show HN: I added A/B testing to my cold email generator – does this add value? | Hacker News Reader

Show HN: I added A/B testing to my cold email generator – does this add value?

coldcopy.xyz

2 pointsZeeeTH6 comments

I built ColdCopy (coldcopy.xyz) a few days ago to solve my own cold email writing struggles. Initially it just generated one personalized email, but I kept wondering "should this be more direct or more friendly?" So I added A/B testing - now it generates 3 versions (Professional, Friendly, Direct) side-by-side so you can compare and pick the best approach. Early users seem to like having options, but I'm curious if this is genuinely useful or just feature bloat. Does having multiple versions actually help with cold outreach, or does it create decision paralysis? The technical implementation was straightforward - same form data, three API calls with different prompt variations, display in a responsive grid. But I'm more interested in whether it solves a real problem. Built with Next.js 14 + OpenAI API. Currently free with daily limits. What do you think - is A/B testing for cold emails useful, or am I overthinking this?

Open articleView on HN

That’s exactly how I use ChatGPT, to rewrite my writing by asking for 3 variations instead of just one.

The issue with Gmail’s built-in writing assistant is that it only gives a single suggestion, and it’s always a binary yes/no. I usually end up declining it.

With multiple versions, there's a higher chance one will resonate. Plus, I can mix and match the best parts to suit my tone. So yes, I think offering variations is definitely the right move.

I’m not a fan of cold emails in general so I would say no this does not provide value. I’m sure others have different opinions as it’s an important part of marketing.

I get that cold emails aren't ideal for everyone. The A/B testing has been helpful for me in understanding audience preferences, but I'm curious - what alternatives have you found more effective? I'm always open to trying different approaches.

I think what some sales people don’t understand is that some organizations are large. They reach out to me trying to sell a product or service, but I have minimal to no influence in what business arrangements the firm I work at makes. That’s all determined by the c-suite and divisional presidents.

Good insight about company size mattering. I think you're right that my approach probably works better for smaller orgs where there's less hierarchy. For larger companies, I imagine the relationship-building aspect becomes much more important. What's been your experience with breaking into those bigger accounts?

For larger firms (>4000 employees), if I were in a sales role, I’d try to get a sense of the org chart and try to make inroads with individuals in senior leadership positions first.

Reply on news.ycombinator.com