One of many holy grails of storytelling with generative AI is having the ability to create coherence between characters in photos and movies. Now MidJourney has made it just a little simpler.
The brand new Character Consistency characteristic works equally to utilizing a reference picture for types and scenes, however focuses on particular character traits discovered within the supply picture.
One of many primary use instances for this could possibly be creating graphic novels or changing photos generated by MidJourney into brief video clips and utilizing one thing like Pika Labs lip sync to animate the lips and permit for quite a lot of scenes with the identical character.
How does MidJourney character consistency work?
Like all MidJourney options, character consistency works by including code to the top of the message, on this case cref and the picture URL.
It really works finest utilizing MidJourney photos as a supply relatively than {a photograph} or drawing made exterior of the AI picture generator, though you possibly can nonetheless use different photos.
You may as well apply the –cw tag adopted by a quantity between one and 100 on the finish of the message after –cref to set how near the supply picture MidJourney ought to keep.
You may as well add a number of characters to a scene utilizing a second or third –cref with URLs for every supply picture. For those who set –cw very excessive, it can cowl every thing, together with garments, face, and hair. For those who set it low, it can solely deal with copying the face so you possibly can change garments.
How effectively does MidJourney’s character coherence work?
I made a decision to attempt it out with a personality I created for a earlier AI sound results mission known as Jack Sloane, an old-school personal detective in his 40s.
For probably the most half he remained constant, carrying his scowl and weathered face by every technology, even sustaining his hat and coat apparel.
Through the first assessments I saved it in its workplace subsequent to the desk, solely altering a number of delicate parts. I then lowered the –cw worth to 40 and altered the message to place it in a barely totally different outfit.
He took off his jacket however saved his hat and trademark scowl. She labored effectively sufficient that I might comfortably use it for a brand new body for a graphic novel or brief movie.
I lastly put it within the hallway and had a second character, Lydia Carver, a lady trying to find her lacking husband, within the scene with Jack. She did effectively however not effectively. Two of the 4 footage had two Jacks with out Lydia, one acquired her gown incorrect and the opposite was wonderful.
What are the principle use instances?
General, MidJourney did a great job with preserving his character constant. It requires some cautious prompting and getting the supply picture proper, but it surely works.
What this additionally does is convey the period of generated storytelling a lot nearer, enabling a brand new kind of content material creation throughout quite a lot of mediums.
A superb author can now visualize their creations extra simply than ever, a filmmaker creates storyboards that can assist current them to buyers, and others can flip a random concept into actuality.
- OpenAI is paying researchers to stop superintelligent AI from going rogue
- Unique: AI development might enable your subsequent trainers to study and adapt to the way in which you progress
- Meet Alter3, the spooky new humanoid robotic powered by OpenAI GPT-4
