Making movies using AI

Here’s how you can use ChatGPT and Midjourney to create Hollywood style movie treatments, scripts, and storyboards.

@tomsoderlund Making movies using AI: tomsoderlund.com/ai #AI #ML #artificialintelligence #machinelearning #chatgpt #midjourney #moviemaking #movies ♬ original sound - Tom Söderlund

Priming ChatGPT

ChatGPT prompt: “Pretend that you’re a world class movie director”

Get ideas for movie plots

ChatGPT prompt: “List 3 ideas for [Tarantino style cowboy movie set in Stockholm in 1860]. Max 80 words per idea.”

Results:

1. Title: “The Stockholm Standoff”. In 1860 Stockholm, two rival gangs of outlaws find themselves in a tense standoff over a stolen shipment of gold. As the tension escalates, loyalties are tested, and betrayals are unveiled. Filled with razor-sharp dialogue, dark humor, and intense shootouts, the film explores the blurred lines between heroes and villains in a lawless city.
2. Title: “Gallows of Gamla Stan”. A notorious gunslinger is captured and awaits execution in Stockholm's old town, Gamla Stan. A motley group of outlaws and misfits bands together to free him, leading to a series of daring heists, double-crosses, and violent confrontations. Tarantino's signature style shines in this gritty tale of redemption and revenge.
3. Title: “The Baltic Bounty”. A hardened bounty hunter navigates the seedy underworld of 1860 Stockholm, seeking the infamous outlaw known as “The Baltic Butcher.” As the hunter delves deeper into the city's dark corners, he uncovers a complex web of corruption and intrigue. This action-packed, dialogue-driven film masterfully intertwines Stockholm's history with classic cowboy themes.

Writing a film treatment

ChatGPT prompt: “Write a 100 word treatment for a [Tarantino style cowboy movie set in Stockholm in 1860]”

Creating the movie poster

ChatGPT prompt: Describe the movie poster for [“Gallows of Gamla Stan”]

Identifying key story beats or scenes

ChatGPT prompt: “Write the main story beats for [“Gallows of Gamla Stan”], as a bullet list. Aim for a 30 minute movie runtime.”

Results:

1. Opening scene: Notorious gunslinger, Gustav "The Ghost" Svensson, is captured and imprisoned in Gamla Stan, Stockholm's old town, awaiting execution.
2. Introduction of a motley group of outlaws and misfits, each with their own unique skills, who decide to band together to rescue Gustav.
3. The group devises a daring plan to infiltrate the heavily guarded prison where Gustav is held.
4. Tension builds as the group carries out a series of smaller heists to gather resources and intelligence needed for the prison break.
5. Unexpected complications arise when one of the outlaws betrays the group to the authorities, forcing the remaining members to adapt their plan on the fly.
6. A thrilling action sequence ensues as the group infiltrates the prison, battling their way through guards and navigating the labyrinthine prison corridors.
7. The group successfully reaches Gustav's cell, but faces a final confrontation with the prison warden, who has a personal vendetta against Gustav.
8. With the warden defeated, the group frees Gustav, and they make a daring escape from the prison just as reinforcements arrive.
9. The group, now united by their shared experience, parts ways, having learned valuable lessons about trust, loyalty, and redemption.
10. Closing scene: Gustav gazes out over the city of Stockholm, contemplating his newfound freedom and the uncertain future that lies ahead.

Casting the main actors

ChatGPT prompt: “What actors should play the main roles in this movie? Present one actor per role as a bullet list.”

Results:

• Gustav "The Ghost" Svensson: Mads Mikkelsen
• Stern-faced Guard: Stellan Skarsgård

Creating a visual storyboard

ChatGPT prompt: “Write a 80 word description for a concept artist, what a key moment of Story Beat 1 above looks like. Include location, year, season, time of day, and shot type, lighting, color grading details. Also describe face, body, clothes details of characters in the scene.”

Results:

Title: “The Outlaws Assemble”. Visual Setting: A dimly lit, smoke-filled tavern in Gamla Stan, Stockholm, 1860, on a rainy autumn night. A diverse group of outlaws gathers around a wooden table, lit by flickering candlelight. The camera captures a wide shot, using a warm color grading to emphasize the camaraderie. Each character, dressed in period attire, showcases unique facial features and expressions reflecting their individual personalities. The scene conveys a sense of determination and unity, as they devise a plan to rescue Gustav.

Then take this text, strip away any forbidden words (e.g. violence or sex related) and use it with Midjourney:

Midjourney prompt: /imagine Title: “The Outlaws Assemble”. Visual Setting: A dimly lit, smoke-filled tavern in Gamla Stan, Stockholm, 1860, on a rainy autumn night. A diverse group of outlaws gathers around a wooden table, lit by flickering candlelight. The camera captures a wide shot, using a warm color grading to emphasize the camaraderie. Each character, dressed in period attire, showcases unique facial features and expressions reflecting their individual personalities. The scene conveys a sense of determination and unity, as they devise a plan to rescue Gustav. cinematic photorealistic Kodak Vision3 anamorphic 8k --ar 9:16

Midjourney results:

Alternative with separate setting and character descriptions

ChatGPT prompt: “Write two 50 word descriptions for a concept artist, what a key moment of Scene 1 looks like. The first description should focus on the setting and include place, year, season, time of day, and cinematography details. The second description should be a medium shot of main character(s) in the scene, including face, body, clothes, and cinematography details.”

Results:

1. Setting Focus: Gamla Stan, Stockholm, 1860, during a chilly autumn twilight. Fading light casts long shadows on the cobblestone alley, surrounded by medieval buildings. Gas lanterns flicker, creating a moody atmosphere. The camera captures a low-angle shot, enhancing the sense of tension and danger in this key moment.

2. Character Close-up: Gustav “The Ghost” Svensson, a rugged gunslinger with piercing eyes and a scarred face, stands defiantly. Beads of sweat on his brow and a clenched jaw reveal his determination. The camera focuses on his twitching hands, subtly hinting at his readiness for a violent confrontation with the armed guards.