• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar

John August

  • Arlo Finch
  • Scriptnotes
  • Library
  • Store
  • About

How ChatGPT resets the levels

December 22, 2022 Follow Up, Geek Alert, Hive Mind, Meta

On a recent Scriptnotes, I showed off ChatGPT to Craig and Scriptnotes guest Rian Johnson. We asked it to write up a plot summary for a future Knives Out movie set in space.

We got an answer similar to this query I just ran:1

In the far-flung future, wealthy space entrepreneur Harrison Thorne is found dead in his luxurious space station, the victim of an apparent suicide. However, Detective Benoit Blanc, a renowned investigator known for solving even the most complex cases, has a hunch that foul play is at work. As he begins to investigate, he finds that every member of Thorne’s eccentric and contentious family has a motive for murder.

As the detective delves deeper into the mystery, he must navigate the tangled web of lies and deceit spun by the suspects, all while trying to stay one step ahead of the cunning killer. With the help of Thorne’s loyal assistant Marta, Blanc must unravel the truth before the killer strikes again.

As the body count rises and the tension mounts, it becomes clear that no one is above suspicion in this high-stakes game of space-age crime and deception. Will Detective Blanc be able to solve the case before it’s too late, or will the killer get away with murder in the cold vacuum of space?

None of us were blown away by the plotting. It felt like it was copy-pasting ideas from the first movie, with a lot of generic pitch filler. Still, we all agreed that the sentence-by-sentence writing was surprisingly good. It didn’t feel like it was written by a bot.

When we asked it to write a scene, it was functional but weightless. Here’s one based on the summary above:2

INT. SPACE STATION – DAY

Detective BENOIT BLANC, a middle-aged man with a southern drawl, walks through the sterile corridors of the space station, his face etched with determination. He approaches a door labeled “Harrison Thorne – CEO.”

BLANC

(to himself)

Time to get to work.

He opens the door and enters the office, which is spacious and well-appointed. A young woman, MARTA, sits at a desk, typing away on a computer. She looks up as Blanc enters.

MARTA

(stands up)

Can I help you?

BLANC

(flashes badge)

Detective Benoit Blanc, ma’am. I’m here to investigate Mr. Thorne’s death.

MARTA

(nods)

I see. Well, Mr. Thorne was a good man. I can’t believe he’s gone.

BLANC

(nods sympathetically)

I understand. Is there anything you can tell me about his final days, or any unusual circumstances leading up to his death?

MARTA

(hesitates)

I’m not sure. I mean, he was under a lot of stress with the business, but he always seemed to handle it well.

BLANC

(nods)

I see. Well, thank you for your time. I may have more questions for you later.

MARTA

(nods)

Of course. I’ll do whatever I can to help.

BLANC

(smiles)

Thank you, ma’am. I’ll be in touch.

Blanc exits the office, deep in thought. The investigation has only just begun, and he has a feeling that it won’t be an easy one.

To be generous, it’s not nonsense. Unlike earlier attempts at algorithmically-generated screenplays, you can follow what happens, and characters do feel like they’re talking to each other. But there’s no nuance or character motivation despite the endless parentheticals.

It’s not a scene, but a simulacrum of one.

Listener JR, who makes his living using tools like these, wrote in with an interesting perspective:

Language models are built on “training data,” which is the text you feed into a learning process to produce the output. For very sophisticated models, the training data is vast: for something like ChatGPT, it includes something like all the text you can scrape off of the last twenty years of the Internet, or so.

But this means ChatGPT is about as smart as the average writer on the Internet has been over the past twenty years — and indeed, the models that comprise GPT drag the results toward the average, not the extraordinary, because the average has much nicer statistical properties than the extraordinary for companies that seek to produce a marketable, scalable product from their models, which requires the ability to tweak, diagnose, and defend what you’re selling.

ChatGPT isn’t optimized for breathtaking originality because that’s not its goal. It’s meant to be conversational and approachable, not wild and daring. It’s giving you hamburgers rather than Japanese wagyu sando with white truffle shavings because 90% of the time, that’s what you want.

JR continues:

Ultimately what these models mean is that with the click of a button you can now be just as good as the average writer who posts content to the Internet, and so the old “average” is now the new “zero.” If you wrote at the average level of the Internet in 2022 you now write at the zero level.

That’s a big idea, so let’s turn it over in our hands a bit.

Let’s imagine we can pick something that represents the average quality of English writing on the internet. It might be an article about holiday lobster prices or a piece of Peloton marketing copy.

from yahoo news: Dec. 21—Maria Minella shopped at Schiff's Marketplace on Tuesday night to stock up for an upcoming family tradition. The Madison Twp. resident purchased smelts, scallops and smoked whiting from the Scranton store on North Main Avenue. They were a bit pricier than in years past, but that didn't matter much to her. "We like to do seven fishes for Christmas Eve," she said. "It's special for the holidays, so you pay a little extra to keep up with the family tradition." While prices of some fish are rising, the cost of other traditional Christmas Eve and New Year's Eve staples is dropping, according to area grocers.

screenshot from Peleton blog post: We get it: Staying motivated to work out regularly can be hard. But that’s where an accountability partner comes in. An accountability partner is there to cheer you on and encourage you to keep going, even on the hard days. They’ll drag you out of bed in the morning and keep you focused on your goals. And you’ll return the favor for them, of course—because accountability partners support and lift each other up.   Looking to find an accountability partner of your own? We asked some of our Members to share how they found accountability partners and how that support has helped them achieve their goals.

Could any English speaker write at that level? No.

You probably don’t have to think that hard to come up with several people in your life who can’t write up to the standards of “Yahoo News article” or “Peloton blog post.”

Many folks don’t write, won’t write, can’t write.

In fact, if we want to consider it “median” writing quality rather than “average,” then approximately half the English speakers on the internet couldn’t hit this level of sophistication.

Only now, with tools like ChatGPT, they can. It’s very good at taking awkward, ungrammatical writing and making something decent out of it.

I fed ChatGPT this text —

if youre stove won’t light here’s what you do 1) check that that the gas is on turn the knob do you hear it 2) lisen if it’s clicking that’s the igniter. if it’s not clickign you could light it with a match 3) lift off the burner cover cuz sometimes that the issue 4) try another burner

— with the instruction to “Rewrite this as a good blog post.” Here’s the result:

If Your Stove Won’t Light: A Step-by-Step Guide

If you’re trying to cook a meal and your stove won’t light, it can be frustrating and time-consuming. Here are some steps you can try to troubleshoot the issue:

  1. Check that the gas is on. Turn the knob and listen for the sound of gas flowing. If you don’t hear it, the gas may be turned off or there may be a problem with the gas line.

  2. Listen for the igniter. If you hear a clicking sound, that means the igniter is trying to light the gas. If you don’t hear a clicking sound, you can try lighting the burner with a match.

  3. Lift off the burner cover. Sometimes, food or debris can accumulate underneath the burner cover and prevent the gas from lighting. Removing the cover may resolve the issue.

  4. Try another burner. If all else fails, it’s possible that there is a problem with a specific burner on your stove. Try using a different burner to see if it lights properly.

By following these steps, you should be able to get your stove working again in no time. If the problem persists, it may be a good idea to call a professional for assistance.

Imagine you’re a technician asked to document how a system works. You could describe the steps and let ChatGPT do the writing. Would you still need to proofread it, to make sure it’s not hallucinating something wrong? Absolutely. But most reluctant writers are competent readers. They should be able to spot when it’s gone off track.

Where I think these tools have even more benefit is for people who don’t feel confident in English. Type in your native language and let the AI do its work, translating not just the words but the intent.

Which brings us back to JR’s thesis, that a tool like ChatGPT resets the levels. In a world in which everyone can write at the old “average” level, what happens?

I’m not sure. There’s not a great comparison in recent human history. Calculators enabled ordinary people to do a lot more number-crunching, but were they transformative? (For the human calculators of Hidden Figures, perhaps so.)

A world filled with AI-polished text might push us in unexpected directions. To err is human, and we might find language incorporating mistakes to porve a hooman wrote it. Or we might use these tools like Instagram filters to make us look like someone we aspire to be.

Personally, I don’t think screenwriters are particularly endangered, at least not in the short term. Future tools may be trained and tuned for scriptwriting, but they’ll be working off a corpus of all the screenplays that have come before. And that’s how it’s always been.

JR notes:

All writers are competing against the cumulative past of our species and its semi-automatic weapons of creative destruction, and are competing to stand out from an average defined over the past couple of decades or so.[…] Writers should only worry about automated writers as much as they are already worried about the agglomerated capacity and output of our species up until the present moment, which, eh, we can do better.

  1. The prompt is “Give me a plot summary for a Knives Out set in space.” ↩
  2. Prompt: “Write me a scene from this movie where Blanc first meets Marta, in screenplay format.” ↩

Related Posts

  1. End today’s writing with a plan for tomorrow’s
  2. The One with Jack Thorne
  3. Who are you? Where do you come from?

Primary Sidebar

Newsletter

Inneresting Logo A Quote-Unquote Newsletter about Writing
Read Now

Explore

Projects

  • Aladdin (1)
  • Arlo Finch (27)
  • Big Fish (87)
  • Charlie (39)
  • Charlie's Angels (16)
  • Chosen (2)
  • Corpse Bride (9)
  • Dead Projects (18)
  • Frankenweenie (10)
  • Go (30)
  • Karateka (4)
  • Monsterpocalypse (3)
  • One Hit Kill (6)
  • Ops (6)
  • Preacher (2)
  • Prince of Persia (13)
  • Shazam (6)
  • Snake People (6)
  • Tarzan (5)
  • The Nines (118)
  • The Remnants (12)
  • The Variant (22)

Apps

  • Bronson (14)
  • FDX Reader (11)
  • Fountain (32)
  • Highland (72)
  • Less IMDb (4)
  • Weekend Read (34)

Recommended Reading

  • First Person (87)
  • Geek Alert (147)
  • WGA (123)
  • Workspace (19)

Screenwriting Q&A

  • Adaptation (66)
  • Directors (90)
  • Education (49)
  • Film Industry (486)
  • Formatting (129)
  • Genres (90)
  • Glossary (6)
  • Pitches (29)
  • Producers (59)
  • Psych 101 (117)
  • Rights and Copyright (96)
  • So-Called Experts (47)
  • Story and Plot (170)
  • Television (164)
  • Treatments (21)
  • Words on the page (238)
  • Writing Process (178)

More screenwriting Q&A at screenwriting.io

© 2023 John August — All Rights Reserved.