New Midjourney V6 Hacks + Runway Motion Tips

Fam,

We’re moving at light speed.

SO many developments…so little time.

Let’s get right into it.

Here’s a Quick Overview:

• New (More Controllable) MJV6 Prompt Structure.

• MJ Improved Coherence?

• Runway 3D Motion Tips.

• And some other random nonsense.

If you’re a beginner…check this out  ↓

Now…let’s get into this new structure.

People often say…”Midjourney doesn’t listen to my prompt”

Noted.

But, what if V6 requires a different prompting strategy?

MJV6 is very literal…meaning…it’s going to listen to what YOU say. (Think ChatGPT level of literal’ness)

Sooo…instead of using “general terms”…and hoping Midjourney creates magic.

Let’s be extremely detailed.

Quick Note: This makes prompting easier and harder at the same time.

If you have a vision…you’ll love this…

If you’re expecting a 3 word prompt and a perfect outcome…you’re NOT going to love this.

First, we’ll start with a standard prompt structure…then we’ll get ridiculously detailed.

Prompt Structure:

Photo Type: [description], Subject Focus: [description], Color Tone:[description], Setting: [description], Atmosphere: [description], Texture: [description], Mood: [description] Composition: [description], Lighting: [description] --[parameters]

Using the “categories” (ex. Setting: [description]) helps direct Midjourney appropriately…so it knows where to focus…here’s an example of a finished prompt:

Finished Prompt:

Photo Type: culinary portrait, closeup photography, Subject Focus: double burger, cheese cascade, Color Tone: rich, indulgent hues, Setting: minimalistic, contrast background, Atmosphere: deluxe, guilty pleasure, Texture: juicy beef, oozing cheese, Mood: bold, satisfying, Composition: stacked, cross-section view, Lighting: spotlight, dramatic --ar 3:2 --v 6

Alright that’s the basic stuff…but you can really push this.

This is a prompt structure I developed for maximum control.

***Disclaimer You will probably get 1 great generation per prompt. But you can control the output significantly.

Detailed Prompt Structure: 

Subject: [focus of the image + action], Subject Position: [where subject is in the photo], Photo type: [shot description], Subject Focus: [in focus, out of focus, etc], Subject Wearing: [clothing + attire], Props: [any objects in the photo], Environment: [setting + details], Environment Focus: [in focus, out of focus, etc], Environment Description: [additional descriptors], Emotion: [tone], Lighting: [lighting details], Time of Day: [Time of Day], Textures: [highlight any specific textures], Atmosphere: [aesthetic feel of the photo], Camera: [camera or general term], FIlmstock: [film stock] --ar 21:9 --v 6

Detailed Prompt Example:

Subject: satisfied Brazilian woman laying bed, with a cigarette, exhaling, Subject Position: left side of the image, facing right, Photo type: medium shot, editorial, Subject Focus: Sharp in-focus, mid-ground, Subject Wearing: muted blue oversized t-shirt, headband, red lipstick, Props: cigarette, Environment: cozy favella bedroom, house plants, Environment Focus: background, slightly blurred, Environment Description: rundown and liberated, Emotion: confidence and contempt, Lighting: low light, light shines from the window, dramatic shadows, Time of Day: early morning, Textures: smoke blending with light rays, Atmosphere: muted 1990s color grading, Camera: a cinematic moment, FIlmstock: BerggerPancro 400 film --ar 21:9 --v 6

Results:

Quick Tips:
01. You do not need to put all these tokens.
02. However, it will help you get much better control.
03. Think about how you want the images to be composed.
04. It will listen…if you prompt it correctly.

If this seems like too much brain power…ask ChatGPT to help.

Give ChatGPT the structure and ask it to fill in the details…very easy.

Need more help?

I’ll be adding content consistenly to the Midjourney Pro Creator Kit.

Use Code “2024” for $20 OFF the kit.

As MJ Version 6 develops… I’ll be adding all V6 content to the kit.

One-time Purchase…Access to EVERYTHING.

But what about Dall-E?:

The “coherence” debate has always favored Dall-E.

But…maybe we didn’t give Midjourney enough credit.

So I ran a test between both…to see the results.

Let’s take a look  ↓

If you missed it: 

Here’s the link to the full test - Dall-E vs Midjourney Coherence Test.

Now let’s talk about Runway.

Generating realistic car/object motion can be hard.

Remember you're working in 3D space.

Here's how to do it ↓

Process:

• Create Midjourney Images.

• Go to Runway.

• Select Runway Gen2 “start with an image.”

• Upload an Image.

• Adjust Motion.

Step 1: Start with Midjourney Image (or use Runway text to image)

Example Prompt: editorial photo, {high angle, drone aerial} shot, silver Toyota Tacoma navigating the mountainous roads of Tennessee, roads and lush greenery, scenic route, vastness and beauty of the mountains, rugged and serene wilderness. --ar 16:9 --stylize 200 --v 6

Midjourney Tips: 

• Create High Angle or Drone Shots.

• Make sure the car is not too small. (Runway will hallucinate)

• Rear shots tend to get better motion.

• Symmetrical shots or straight roads work better.

• “Spinning wheel aesthetic” is better for motion.

Step 2: Use Runway Gen-2

Runway Process: 

• Select “Gen-2 Image to Video”

• Upload Midjourney Image

• Adjust motion controls.

Step 3: Adjust General Motion + Camera Direction 

• General Motion: Use to increase overall Motion.

• Camera Direction: Mimic the direction of the car.

Step 4: Use Motion Brush to move in 3D.

• Paint the object only.

• Use the axis to visualize the path.

• If the car is moving toward you - use “positive” proximity.

• If the car is moving away from you - use “negative” proximity.

• If the car is driving in a certain direction - mimic the direction of the car with motion brush controls

Remember you’re working in 3D space.

It becomes easier once you’ve failed a few times. (I’ve failed a lot)

Here’s the full post ↓

Operational Ai?…Robot Dogs?…Bourdain GPT?…

This was fun.

A few weeks back…I kicked it with Nick Taylor and recorded the inaugural episode of The Brand Bots Podcast.

I had a hell of a time.

Nick’s a killer host…and an awesome guy.

If you're interested in the intersection of AI and Marketing…Check Nick out…

Have fun.

If you need help…DM me on Linkedin.

OR respond to this email with “HELP”…and we’ll chat.

Until next time…

RF