John August

QandA

Which of these answers was written by AI?

Tools, Words on the page, Writing Process

[GPTZero](http://gptzero.me/) is a new service created by Edward Tian designed to sniff out AI-generated text.

I’m dubious, in part because I’m not sure I could reliably spot the differences between sentences assembled by humans versus machines. But maybe that’s just my human bias.

As an experiment, I decided to run a quick, not-at-all-scientific test. I asked ChatGPT to “write three paragraphs explaining what a manager does for screenwriters.” I also looked up the answer for [“What does a manager do?”](https://screenwriting.io/what-does-a-manager-do/) on screenwriting.io.

Here are the two responses, one written by a human ((Stuart Friedel wrote most of the early screenwriting.io answers.)), the other by an AI. See if you can spot which is which.

### SAMPLE A
> In brief, a manager manages your career.

> This includes tangible acts, like setting up meetings, giving notes and feedback, and assisting with deal negotiation, as well as the more abstract, like helping steer your career’s direction.

> Managers, unlike agents, are not required to be licensed by the state. They usually have fewer clients than agents, and often take more personal and less business-focused roles in their clients’ careers. Managers, are allowed to take producer credits on their clients movies, which agents are not.

> Like agents, a manager typically receives 10% of a client’s earnings. A manager should never ask for an upfront or flat fee.

### SAMPLE B

> A manager for a screenwriter plays a vital role in helping the writer navigate the film and television industry. They can assist with finding and developing new ideas, as well as helping the writer shape their existing ideas into marketable concepts. This often involves providing feedback and suggestions to help improve the story and make it more appealing to potential buyers.

> Managers also help screenwriters with the business side of things, such as identifying potential buyers and pitching the writer’s work to them. They can also help negotiate deals and contracts, as well as manage any legal issues that may arise. In addition, they can help the writer navigate the many different players in the industry, such as agents, producers, and studio executives.

> Finally, a manager can also help screenwriters with their long-term career goals by helping them identify opportunities for growth and advancement. This might include working on larger projects, transitioning to other forms of media, or developing a personal brand to increase their visibility and credibility in the industry. Overall, a manager plays a critical role in helping a screenwriter achieve success in the competitive film and television industry.

For each answer, GPTZero measured the text’s Perplexity — the randomness of the text — across several ranges.

| | Total | Average | Highest |
|———-|——-|———|———|
| Sample A | 41 | 136 | 219 |
| Sample B | 11 | 36 | 49 |

That 219 is an example of “Burstiness,” which GPTZero defines as “spikes in perplexity.” For Sample A, the opening sentence has a perplexity of 219, whereas highest perplexity in Sample B is just 49.

That’s the tell, apparently.

> Some human written sentences can have low perplexities, but there is bound to be spikes in perplexity as the human continues writing. Contrastingly, perplexity is uniformly distributed and constantly low for machine generated texts.

After crunching the numbers, GPTZero renders its verdict.

SAMPLE A (score 66.44):
Your text is likely human generated!

SAMPLE B (score 9.93):
Your text is most likely to be AI generated!

On both counts, GPTZero got it correct.

But how hard would it be to fool the system? I spent two minutes editing the AI-generated version into the following:

### Sample C
> Managers can play a vital role for screenwriters. Basically, they help the writer navigate the film and television industry. They can assist with finding and developing new ideas, or shaping their existing ideas. They provide feedback and suggestions.

> Managers also help screenwriters with the business side of things: who the buyers are and how to pitch to them. They can help negotiate deals and contracts, as well as manage any legal issues that may arise. They help the writer navigate the many different players in the industry, including as agents, producers, and studio executives.

> Good managers think about screenwriters’ long-term career goals. This might include working on bigger (or smaller!) projects, transitioning to other forms of media, or developing a personal brand. Overall, a manager can play an important role in helping a screenwriter achieve success in the competitive film and television industry.

| | Total | Average | Highest |
|———-|——-|———|———|
| Sample A | 41 | 136 | 219 |
| Sample B | 11 | 36 | 49 |
| Sample C | 19 | 106 | 439 |

The verdict:

SAMPLE C (score 118.77):
Your text is likely human generated!

## Some takeaways

– The ChatGPT answer was well-written and potentially helpful for someone who didn’t know anything about managers.
– GPTZero is looking for patterns a human likely wouldn’t notice, which makes sense. But an AI model trained to provide responses with high perplexity and burstiness would likely evade detection. It’s interesting to see this arms race play out, because adversarial networks are already a fundamental tool in AI.
– It’s currently very easy to fool GPTZero with just minimal rewriting. If this tool meant to detect AI-generated term papers, students will quickly learn how to evade it.

Whither Westworld

Asides, Film Industry, Television

Like most writers, I’m trying to understand these [wild moves at HBO Max](https://www.vulture.com/article/hbo-max-removing-shows-movies-list.html).

Cancelling Westworld? Sure. Happens all the time. That’s TV.

Ditching an unaired season you’ve already shot, like what [just happened to Minx](https://variety.com/2022/tv/news/minx-canceled-hbo-max-season-2-1235458073/)? That’s heartbreaking, but I guess not unprecedented after Batwoman.

[Pulling Westworld off the service](https://deadline.com/2022/12/westworld-the-nevers-pulled-hbo-max-canceled-1235197233/) is just bonkers to me. My only guess is that they’re going to stick it on an ad-based service with a different residual formula.

Makes it hard to want to make a show for HBO Max.

I mistakenly titled this post “Wither Westworld” instead of “Whither Westworld” and both work.

How classes use Writer Emergency Pack

Education, Follow Up, Writer Emergency, Writer Emergency Pack

Since the launch of Writer Emergency Pack in 2015, we’ve partnered with youth writing programs to get decks into classrooms and after-school groups. By far our biggest partner is NaNoWriMo’s Young Writers Program.

With the arrival of [Writer Emergency Pack XL](https://www.kickstarter.com/projects/johnaugust/writer-emergency-pack-xl?ref=41qc4k), I asked NaNoWriMo’s executive director [Grant Faulkner](https://twitter.com/grantfaulkner?ref_src=twsrc%5Egoogle%7Ctwcamp%5Eserp%7Ctwgr%5Eauthor) for an update on how the original decks are being used.

**JOHN: A lot of people are familiar with National Novel Writing Month (NaNoWriMo), but what is [Young Writers Program](https://ywp.nanowrimo.org)?**

GRANT: It’s a version of NaNoWriMo, just for kids. When I was a kid, I didn’t dream of writing a novel (and I was bookish). Because of our Young Writers Program, though, now nearly 100,000 kids write novels each year, and educators from over 9,000 classrooms around the world participate.

The challenge is, like NaNoWriMo, to draft an entire novel in November. We believe that giving kids agency and making writing fun is the best way to learn. For 30 wild, exciting, surprising days, kids get to lock away their inner editor, let their imagination take over, and just create! You might say our pedagogy is rooted in joy.

**What are students doing in the program?**

We provide teachers a virtual classroom so they can do things like read student novels and create chat topics. And then we also provide kids with free classroom kits — which include Writer Emergency Packs! — workbooks, and Common Core-aligned K–12 lesson plans.

Kids set word-count goals for the month (appropriate to their age and capabilities) and then draft their novel right on our site. They track their progress, and then they also get support from published authors and an international community of fellow novelists.

photo of high school classroom, students looking at teacher

**How are teachers using Writer Emergency Pack in the classroom?**

I’ve heard so many stories. I’ve heard of teachers who weave cards into the mini-lessons they might do on things like conflict or characterization. I’ve heard of teachers who hand out cards to students who might have hit a wall and have writers’ block. I’ve heard of teachers who give the cards to groups of students and have them use the cards to collaboratively create a story together and then tell it to the class as a way to warm up to write in November.

There is one commonality, though: all teachers make the cards part of the classroom, which is important, because the classroom becomes a writing community during NaNoWriMo.

**What feedback have you gotten from teachers about the decks?**

They love them! The cards are encouraging, approachable, and fun! They provide the same lessons a book might—but in a single illustrated card. Like NaNoWriMo itself, the cards are all about sparking the imagination, making writing not about a teacher’s red correction marks but the joy of storytelling.

**Do you think the new decks will have the same reaction?**

I do. I think the size of the cards makes them more inviting. All of the relevant information is now on a single card, and with 52 cards there’s enough for every student in class, even bigger classes.

And, just one more thing: I know adult writers who use the cards as well (me).

—

Writer Emergency Pack XL is [now on Kickstarter](https://www.kickstarter.com/projects/johnaugust/writer-emergency-pack-xl?ref=41qc4k). For every deck we send to backers, we’ll be sending a deck to our youth writing program partners, including NaNoWriMo’s Young Writers Program.

Photo by Kenny Eliason/Unsplash

PayUpHollywood progress, an update from ‘Christian’

Film Industry, First Person, Follow Up, Television

Three years ago — October 8, 2019 — a writer who went by “Christian” emailed about [their experience as a writer’s PA](https://johnaugust.com/2019/hollywood-assistants-have-always-been-underpaid-but-this-is-different), explaining how they were expected to do the jobs of multiple support staff on a tiny salary. We discussed their email on the show, including the issue of [needing to have a car](https://johnaugust.com/2019/scriptnotes-ep-422-assistants-arent-paid-nearly-enough-transcript).

Last week at the premiere event for The Simpsons’ Treehouse of Horror XXXIII (delightful, btw), I met “Christian” in person. They filled me in on what had happened in the past three years.

Some legitimate progress had been made, which Christian felt could be traced to the #PayUpHollywood movement. Their pay had gone up from minimum wage — but not necessarily to a living wage — and conversations about pay were becoming more open. That’s the good news.

Frustratingly, studios were still balking at reimbursing staff for things like assistants’ use of their own cell phones. Showrunners weren’t willing to engage on getting assistant and support staff properly compensated for their hours. It felt like the same grind for a few dollars more.

Christian ended up quitting work as a writer’s PA to focus on their writing, which had gone neglected for two years due to stress and overwork. I asked what advice they’d give to a writer who was looking at taking a coveted showrunner’s assistant job.

> Honestly, do it for one show, one season. Learn everything you possibly can. Make contacts. Then get a job as a receptionist at a law firm so you can have the time to write.

This week, Christian wrote in with some follow-up thoughts.

—

first personI wanted to thank you for not only graciously listening to me ramble last night, but asking me how things were going. As you could probably assume from what I said, it’s been a lot of ups and downs.

I won’t bug you further with the details behind my experiences, but just want to make it known that my toxic boss and the refusal to provide pay parity or stipends for what we were legally owed was happening on essentially both the studio’s and network’s biggest drama cash cow. So there really isn’t any excuse for nickel and dime-ing the assistants, other than the fact that they can.

But really, it doesn’t matter what the budget is, there’s no excuse for screwing the lowest paid workers out of fair wages when these corporations are making billions of dollars a year. The money is there. They just don’t care.

It doesn’t help that there’s a huge line of people willing to accept things as they are because they believe getting an assistant job is a ticket to staffing. (The person who took over my desk when I left was a previously staffed writer, who had left the industry for personal reasons, and was so hell-bent on getting a foot “back inside” that they accepted the demotion to Showrunner’s Assistant on a desk that doesn’t promote up and isn’t particularly kind. So there were really no consequences to my toxic former boss or the show for behaving so poorly.)

And I’m not sure that there’s an easy solution, because even though my boss was not supportive, I know countless assistants who *do* have supportive bosses, and even their bosses have gotten stonewalled when trying to help their assistants get paid what they’re owed. One example: a friend’s boss actually carved out the show budget so that there would be enough to pay each assistant $20/hr (this is back in 2019 I believe, well before union negotiations), and the studio refused to allow the Showrunner to pay the assistants that because it would “start a precedent.”

Even today, I have a friend who got promoted to manager at her POD, but is still getting paid at the assistant rate AND having to cover her former boss’s desk because the studio won’t give the POD the budget for a managerial wage and a new assistant until the POD has “more projects in development.” Currently, this POD has the #1 show on its network, a spinoff in the works, and several other projects being pitched around town.

I feel as though ultimately the only solution seems to be to unionize every assistant position at every level, but that is a hefty, years-long goal filled with complications and extra financial barriers for those who are already struggling to make ends meet, or even just to break in.

And in the meantime, I think the only other thing to do is to make it really, REALLY clear that being an assistant isn’t a gateway to becoming a writer anymore. It’s purely a networking tool at this point, and you should use it to build up connections with supportive writers, then get out and find something that pays better with less hours so you can hone your craft (unless, of course, you are lucky enough to land a boss who actually will lift you up). And, just to note from my own job search over the past few months, almost everything pays better for less hours outside of the entertainment industry.

One more thing that I really think assistants need, and I wish that the WGA or even IATSE offered, was a course on financial literacy. I know this isn’t something that’s a problem specific to assistants, or even to this industry, but it’s something I think every assistant would really benefit from, and it would give them more capability to walk away from bad situations, rather than staying because they need the money.

I think the biggest takeaway I’ve gotten from becoming financially literate is that you don’t need a lot of money to learn how to better manage it. I was essentially broke when I started to understand my finances. In fact, I think it’s more important to understand money when you don’t have it. Especially if you’re also trying to pay off debt. That’s something I’ve been thinking about a lot and also contemplating in the context of being an assistant.

Sorry for such a novel of an email. After our conversation, I felt there was a lot I had left out that was more useful than what I had actually said, so I hope that this has been of value for your time.