ChatGPT has taken the world by storm, and many SaaS professionals have seized the opportunity to streamline their workflows through this technology. But as we’ve learned in the past year or so, the most key variable in AI success is authenticity. As we’ve continued on our AI journey’s we’ve all gotten a lot better at spotting obvious AI-generated copy. Supercharge anyone?
But there are two things that are happening:
1. The technology continues to evolve
2. We continue to learn more about how to get the best out of this technology through careful implementation.
But you can only do so much with a tool that isn’t up to snuff. There are two principal AI tools that seem to be getting the most attention: Claude and ChatGPT. So to save you time, we decided to delve into which tool yields the best results for your business growth.
Let’s dive in.
Claude 3 vs ChatGPT: What’s the difference?
Since launching in 2022, ChatGPT has become world renowned for its versatility in a variety of different tasks, however many believe that Anthropic AI’s Claude has the advantage when it comes to generating copy with genuine authenticity, as well as being able to process larger documents. But in this case study, we’re going to put that theory to the test.
Claude vs ChatGPT: Which is better?
Ethical dilemmas
The rise of AI has come with a lot of excitement, but we can’t overlook the anxiety surrounding AI in SaaS. This is understandable, after all, how can you expect a non-sentient being to employ the human discretion required when handling sensitive customer information/data or handling decision making.
However, the developers of these tools are well-aware of this anxiety and are doing their best to build ethical AI tools. We wanted to test out how well both Claude and ChatGPT are able to puzzle out this ethical dilemma:
First, we put ChatGPT to the test. This was it’s possible solution to the problem:
As you can see, Chat gave a very nuanced and thorough approach to this problem, weighing up the different philosophies that might inform your point of view. This is extremely valuable in an AI tool, as you don’t want a tool that’s biased toward a particular ideology or point of view.
This is promising, although, one could argue, that if you’re looking for a more concise response, it’s maybe not ideal. Another nice touch, however, is the weighing up of the pros and cons for each solution, as you can see here:
Now, we put the same problem to Claude. Let’s take a look at this solution that Claude came up with:
Once again, we get a very nuanced, balanced response, but the difference is in its concision, making the proposed solution more digestible. Although both tools take a reassuringly balanced approach, we like the tidiness of Claude’s output. This first point goes to Claude.
Winner: Claude
2. Different styles and tones
Many companies will be looking to these tools for help with social media messaging and marketing copy, in general. One of the concerns on this has been that, despite the efficiency, it’s going to be difficult to write in a style that’s authentic to your brand’s unique tone of voice. When we think of AI, we think generic, robotic.
The good news, however, is that both of these tools can be trained on your specific tone of voice, but we wanted to see which of these tools adopts a more authentic approach, so we put them to the test
We took this serviceable, but fairly generic product description for SaaS Alliance. We asked both tools to jazz it up a bit, so that it could be more in line with our more colloquial tone of voice.
“SaaS Alliance is a global collective of SaaS leaders and thought leaders, and content hub written and curated by these experts. Through an extensive library of blog content, over 100 hours of OnDemand video hosted by some of the leading minds in the industry, and dynamic podcast discussions and webinars, you’ll unlock actionable insights and proactive strategies for leading your org to success."
Here’s what ChatGPT came up with: :
“Welcome to SaaS Alliance – the ultimate global hub for SaaS leaders and trailblazers! Dive into our treasure trove of expert-curated content, featuring a vibrant library of blogs, over 100 hours of OnDemand videos from industry geniuses, and dynamic podcasts and webinars. Get ready to uncover actionable insights and cutting-edge strategies that will propel your organization to new heights. Join the SaaS Alliance today and lead your team to unstoppable success!”
A stark improvement we think you’ll agree! But now let’s see how Claude matched up.
“Ready to supercharge your SaaS game? Welcome to SaaS Alliance – your ticket to the big leagues! We're not just another tech hub. We're a powerhouse collective of SaaS bigwigs and brainiacs who've been there, done that, and are ready to spill the beans. Imagine having the sharpest minds in the industry at your fingertips:Dive into our treasure trove of expert-crafted blogs; binge on 100+ hours of OnDemand video gold from industry rockstars; Tune into our addictive podcasts and webinars that'll make your commute fly by. Whether you're a SaaS newbie or a seasoned pro, we've got the secret sauce to skyrocket your success. No fluff, just real-world strategies that pack a punch. So, are you ready to join the Alliance and leave your competition in the dust?”
Which version you prefer, probably comes down to your personal preference. We like how Claude has split the copy up, making the features stand out a little more, however, we do feel like it has fallen back on some pretty generic phrases that are a dead giveaway for AI generated copy. ( ‘Supercharge’ needs to go to room 101 for good). So, Claude wins for concision, but Chat wins for authenticity, It’s a tie.
Tie: Claude and ChatGPT
3. Product descriptions
A product description is a must for any SaaS company. Customers need to know what your product does and how it will solve their problems, but more importantly, they need to know why they should choose your product over another. Both of these tools can write a product description for you. But as with anything AI related, it’s very much a case of crap in = crap out.
The more details you can give the tool not only on what the product does but on who it’s intended for, will really help Chat generate copy that sells.
For the purposes of this, we invented a fictitious company that sells organic luxury candles. Based on research into similar products, we provided these tools with as much information as we could. For the first step, we provided minimal details, but asked ChatGPT to create a simple product template for this. Here are the details we provided:
Here’s what ChatGPT came up with in response:
As you can see, it’s already quite detailed and at the very least, it’s a good headstart for your basic product description. Where the details get a little hazy is in the follow up.
So, let’s provide a view with more details, and hopefully, we’ll be a step closer to building out a detailed product description.
Here’s the prompt we provided
Here’s how the product description was adapted:
As seen here, Chat has altered the copy to reflect the more targeted audience, although we find that the copy still retains the tone from before, we would hope that the TOV would be adapted to a more exclusive audience.
So, we gave Claude the same task. Let’s see how it measured up:
It’s the same details, but we feel Claude has done a great job at turning this information into the kind of punchy copy that appeals to the consumer who might be tempted to buy luxury household goods, effectively distinguishing this brand from potential competitors
Winner: Claude
Wrapping up: Winner Claude
Ultimately, what you decide is down to personal preference, but whichever tool you choose to go with, it's important to repeat this mantra: crap in = crap out. As it turns out, getting the best results from a AI tool isn't so different than getting the best results from a human being. You have to be clear on the benefit of your product, what differentiates it, and who your intended audience is.
Don't get caught up on showcasing features, instead think about the problem you're solving and make sure you communicate this to the tool.
Like what you see? Why not keep up with new exclusive insights from the leading minds in SaaS with a SaaS Alliance Membership plan?
