The surprising results from a 10-week human vs AI content challenge

Sign Up / Advertise 

BROUGHT TO YOU BY

AI Marketing School Newsletter #63

Hi there marketers,

Welcome to AI Marketing School, where we’re helping marketers harness AI to its full potential.

Today, we’re looking at:

• The surprising findings from a 10-week AI versus humans content challenge

• Video tutorial: Gain rapid human feedback on AI-generated content with Conjointly

• The latest tools, tips, and tricks from the world of AI marketing

Hope you enjoy the issue.

Charlie & Tom

AI IN ACTION

The Man vs Machine Content Challenge

There’s one question on most marketers’ lips right now: do we still need human writers?

Or is AI good enough to replace them completely?

CMO Huddles wanted to test this out. So, it ran a 10-week ‘Man vs Machine’ content challenge.

The challenge

• CMO Huddles produced 60 blogs in total.

• 20 were written exclusively by people.

• 20 were almost entirely generated by ChatGPT-3.5. However, they were proofread, fact-checked and lightly edited by the team.

• 20 were generated by ChatGPT-3.5 and then rewritten by the team to match the quality of the human-authored posts.

• The team tracked search rankings, visibility and traffic over the test period.

The results

Here are the report’s key results.

• Human-authored posts improved traffic and rankings by 3x more than AI-authored content.

• But AI was 3x faster than humans in authoring content.
  
  

• “Marketers worried about a tsunami of superior AI competitor content can rest easier. The real question remains whether marketers can or should give up quality in exchange for cost / time savings.”

• Hybrid approaches were far quicker to produce than human written content (1.5 hours versus 3.5 hours).

• They also drove increased search visibility. However, this boost in visibility didn’t translate into increased traffic.

TOOLS TO TRY

Video Tutorial: Gain rapid feedback on AI-generated marketing materials with Conjointly

Creating marketing materials with AI is a piece of cake. However, how do you know which versions will resonate with your audience?

It’s simple—you use Conjointly.

In this video, Tom shows you how to use Conjointly to gain lightning fast human feedback on AI-generated marketing materials.

TODAY’S RECOMMENDATION

Master the art and science of creative strategy

Creative minds. Math-obsessed media buyers. To ship more winning ads, you need both worlds working together.

Introducing: Thumbstop.

Thumbstop is a weekly newsletter covering the art and science of creating winning Meta, TikTok, and YouTube ads.

⚡Creative strategy templates

🔬The science behind effective hooks

💰 Winning TikTok & Meta ad formats

📊 Time-saving reporting techniques

Who is this newsletter for:

👉 DTC and ecom creative teams looking to build their data skills

👉 Heads of growth who want to increase their creative skills

👉 CMOs who want to build effective creative performance teams

Every week, you’ll get new growth & creative cheat codes used by top DTC and ecom brands. New issues are sent every Sunday.

💌 Subscribe here

BONUS RESOURCES

Here are a few great AI marketing resources and tools that we’ve come across recently. Enjoy!

1. Use Generative AI to Enhance Content and Customer Experience

Gartner dives into practical marketing applications to drive creativity and personalized experiences, helping marketers exploit generative AI’s transformative promise.

2. YouAI’s personalized writing assistant

Product and creator expert Peter Yang, author of the Creator Economy newsletter, recently wrote about how to turn AI into your own personalized writing assistant. YouAI has gone a step further and turned his recommendations into an easy-to-use customized AI writing tool.

3. Repurpose presentations with AI

Katja Vogt demonstrates how to repurpose presentation slides into content with Canva’s new AI features.

What did you think of today’s email?

Loved it? Hated it? Hit reply and tell us why.

Happy marketing. We’ll see you again on Friday.

Charlie & Tom