devblog header image

How Our Actors Move

•devblog• by BizaNator

By BizaNator and RinEllaSky. Made in UEFN.

Our actors can talk, think and improvise. On the first day of the jam they could not do one single thing with their hands.

The reason is a good one: the game may not reuse Fortnite's own emotes. So every wave, shrug and dramatic accusation in HOT SET had to be made by us, from scratch, on the same skeleton the actors already wear. Here is how that went, including the part where our import test said no.

Watch the short (21 s):

The gesture gate

Every clip is built by script in Blender, keyed by rule, on the same 104-bone skeleton the actors use, moving only the bones that need to move. Then it has to get through a gate before it goes anywhere near the game:

  • The first and last frame must equal the skeleton's reference pose, to 0.00006 cm across all 104 bones. An actor never pops when a clip starts or stops.
  • In an upper-body clip, no leg, pelvis or root bone moves. A shrug does not get to shuffle the feet.
  • The arm reach must not be clamped, the axes must be right, and a re-import into Blender must keep all 104 bones.
  • A replacement clip keeps the same name and the same length. The Director plans a scene around clip lengths, so a clip that quietly grows makes everyone late.
  • Every clip ships with a preview GIF, so the next person can see what they are getting.

The day the import test said no

An early version of our clips passed our own checks and then failed the import test: the root came in rotated ninety degrees and the pelvis landed well over a metre off. We had exported the file exactly the way our own notes said to, which is the sort of sentence that turns up in a lot of postmortems. We rebased every clip on the true reference pose and re-ran the gate. The lesson, for anyone doing this: check against the thing you are importing into, not against your own notes.

Hands

Fists are real fists. Pointing is a real pointing finger, with open palms and the odd claw. Forty of the forty-three clips we added after the first six got proper hands; Nod, ShakeHead and LookAround do not use their hands at all.

What the Director can ask for

The Director's clip table names 79 clips. Thirteen of those are seated clips that we parked, so the standing set is 66:

  • Gestures, emotions, everyday moves and carry poses: 51, including Kneel and Bow
  • Listening reactions: 5 (ArmsCrossed, GlanceAway, HandToChin, LeanInNod, SlowHeadShake)
  • Hazard reactions: 9 (LookUp, LookUpHold, Flinch, Relief, PointUp, Forgot, WrongProp, Upset, Recovered)
  • One ChallengeBow

We have not counted how many of those play in a given take, so we are not going to claim you will see all 66 in one sitting.

How a clip gets chosen

The Director names a clip for a moment: the stage action of a line, its emotion, a reaction, or a big moment. When nothing else is going on, an idle fill plays every 10 to 14 seconds so nobody stands there like a mannequin. Upper-body clips run at most 2.5 seconds; the full-body ones (Kneel, Bow) run up to 6. Every clip is logged with its reason: fill, react or moment. That log is how we know which take a clip appeared in.

The first one we saw

The first clip BizaNator spotted on an actor in a real take was Point, in Friday evening's playtest, and he said it looked good. A Shrug followed. That is his observation from the playtest, and it is the only "seen it" we claim from that night.

Meet the clips

All eight clips in our Director capture run played on cue, each tied to a line in the game log. Here are six of them as rig previews (the rig, not the game):

Shrug: the rig, not the game

Accuse: the rig, not the game

CheckWatch: the rig, not the game

Wave: the rig, not the game

Yawn: the rig, not the game

Bow: the rig, not the game

What is next

More clips, another pass on hands, and an honest look at which clips players really see. If there is a gesture you want our actors to do, tell us on Discord: discord.gg/fWHBt5kyjj

Made by BizaNator and RinEllaSky. Made in UEFN. Island code coming soon (public release).

BizaNator

BizaNator

Verified CreatorGame DeveloperContent Creator
Unreal EngineVerseGame Design3D Modeling