Disney Let it Go MMD Elsa in iClone5

3DXchange5 Pipeline test series 16: Disney Frozen/ MMD Elsa Let it Go in iClone5
2014. 5.29 rev.2014. 8. 2, 2014.10.14, 2015.1.4, 2015.1.７ Hirospot (Personal Site)

Basic Approach for using MMD Elsa & frozen motion in iClone

Demo Video

(YouTube)

Go to other Report →

Test Reports with 3DXChange5 & iClone5 Pipeline

印は日本語でのレポートです

'Frozen' is a world famous Disney musical fantasy movie made by 3DCG Animation in which Elsa can produce ice and snow at will.

Among meny user videos and vocal sounds, MMD Elsa models and its motion have been introduced in the internet world.

I was moved to see her in my iClone5.
This is a personal report with my best of converting process how the model and motion can be brought into iClone5.

Skirt bone structure is modified tentatively, and only Spring Effects are applied to the Skirt bones.
Physics are not used in the test.

Thank you for all these creators, Companies Videos and Downloadings.

Data and Tools	DL Link	Name of DL Data
Elsa by 0-0-Alice-0-0	MMD Elsa DL by 0-0-Alice-0-0	mmd_elsa_dl_by_0_0_alice_0_0-d796q23.zip
Motion by mahlazer	MMD Frozen FREAKSHARE (Free) Uploaded:2014-3-15 23:09:57	MMD Frozen.rar (10.09 MB) ・frozen motion data.vmd　（5280 frames）・frozen camera.vmd ・let it go edit.wav
Motion (Full Length) by okacchi (おかっち）	Let it go full Posted:2014-07-22 23:36:10	Let it go.zip (133KB) ・Let it go-motion.vmd (12,814 frames) (Note: Fine with Editing Motion) ・let it go-camera.vmd
Decompression	Lhaplus Version 1.59
PMD Editor	PMDEditor_0139	Please use the same version PMDEditor_0139.
Collada Exporter	PMDEditor (ColladaExport.rar)	ColladaExportPlugin.dll
Live Animation	beta4.63	LiveAnimation_108.zip
FBX Converter	Autodesk FBX	FBX 2013.3 Converter X64
3DXchange5	iClone 3DXchange5 Pipeline	iClone 3DXchange v5.51 Pipeline
iClone5	iClone 5 PRO	v5.51 PRO(64 Bit)

Referenced Video	Creator Name	Notes
[MMD MOMI Cup 4] Let it Go	mahlazer	The video was made for a pure non profitable and educational purposes only.
MMD Motion 配布	Okacchi	12, 814 frames full version with Japanese song.
MMD Disney:Let it Go	Amane hatsura
[MMD] Let it Go (Elsa Frozen)	Shooter Fock
FROZEN - Let It Go Sing-along \| Official Disney HD	Disney UK	一緒に歌おう♪『アナと雪の女王』「Let It Go＜歌詞付Ver.＞」松たか子 ■「Let It Go～ありのままで」の原曲
Let It Go (From Disney's Frozen)	YourPianoCover	- Idina Menzel - Piano Cover Video

Using PMD Editor to make Elsa ＆ her Facial Morphs for PMX export.

1-1

Create a new folder to save all the downloaded/decompressed Elsa files.

PMD files and Texture files must be located in the same folder.

1-2

Open PMD Editor. PMX Editor and PMDView should open.

1-3

Go to PMX Editor/File(F)/Import(I) and import the 'Elsa with Cape.pmd'.

1-4

Select Import method as New, Size=1 and Click 'OK'.

1-5

PMXEditor turns to PMDEditor with the Elsa in the PMDView.

Editing the Model is permitted by 0-0-Alice-0-0.
ElsaData

1-3

Click PMDView and push F9, then TransformView should open.

1-4

At active TransformView, Push F4 for Bone & Morph Control Panel.

1-5

Initialize the Model posture (Ctrl + P) and Morph (Ctrl + K).

1-6

At TransformView, Go to File/Save Current shape.

1-7

Select PMX format and save the default Elsa as Elsa_Test.pmx for further reference.

1-8

Next, select any morph and use slider to confirm the facial change.

Adjust multiple morphs to attain target Facial Expressions
Modifier

Push F1 to open Preview Setting Panel and unselect Bone.
MorphFace

1-9

Check all Morphs and use a few morphs to attain target Facial Expressions.

1-10

Save by English Name for the target facial morphs to be used in iClone when PMX export.

MMD Elsa Morph List

eyebrow

Eye

Lip

Other

		PMX			PMX			PMX			PMX			PMX			PMX
0	まばたき	blink	10	瞳小２L		20	Look DownR		30	あ	ai	40	上L		50	困るR
1	ウインク		11	瞳小２R		21	Look Up		31	え	ei	41	上R		51	にこり	smile
2	ウインク２		12	Look Left		22	Look UpL		32	い	i	42	下		52	にこりL
3	笑い	laugh	13	Look LeftL		23	Look UpR		33	お	o	43	下L		53	にこりR
4	ウインク２右		14	Look LeftR		24	びっくり	OMG	34	う	u	44	下R		54	真面目	faith
5	ウインク右		15	Look Right		25	びっくりL		35	ω□	wao	45	怒り		55	真面目L
6	瞳小		16	Look RightL		26	びっくりR		36	にやり	Hi	46	怒りL		56	まじめR
7	瞳小L		17	Look RightR		27	じと目		37	にやり２		47	怒りR		57	Cape	Cape
8	瞳小R		18	Look Down		28	じと目L		38	へ		48	困る	sad
9	瞳小２		19	Look DownL		29	じと目R		39	上		49	困るL

blink	laugh	u	sad	faith

1-11

Save the Selected morphs in the same folder as Elsa in PMX format.

Exporting the original Elsa and Facial morphs as DAE format.

2-1

Go to Info(I) in the PMDEditor, and Change to PMXEditor as shown below.

2-2

Go to File/Export and Select COLLADA(*.dae).

2-3

Select Elsa_Test.pmx, select COLLADA(.dae) and click 'Save' button.

2-4

Set the Scale to 900% and use Japanese notation to identify the bone names in Japanese.

2-5

Open each of PMX files, then save it as COLLADA DAE format accordingly.

2-6

Open FBX Converter, pick all these DAE files and drag to converter all at once.

Making of Facial Morph List in 3DXchange5.

3-1

Open Texture images and drag them to the corresponding Elsa part.

3-2

Drag texture materials to the corresponding part.

Drag the 'Elsa Face' texture file to her face parts specifically: face, pulil, lip, mouth,... 5 times in total.
Materials

3-3

Select ModelMesh in the Scene Tree, Go to Modify/Normal(O), set Auto Smooth value of 180 and click 'Auto Smooth' button.

3-4

Go to Modify/Face Setup/Morph List, drag all FBX morph files into the table all at once.

3-5

Adding of all Morphs must be done before the Characterization of the Model (Elsa).

Elsa Facial morphs FBX sample data used in the report ⇒　Here

3-6

Select morph data in the Morph List one by one and confirm the lip shape.

3-7

Depending on the consistency of the work in Chapter2, irregular distortion of the body or Cape might happen at the step 3-6 operation.

If such are observed at the step above, try changing the fbx data for default ModelMesh to the other one such as replace the following data ① with data ②.

'9x_Elsa with Cape.fbx' ① was selected as default first,
then changed to '9x_a.FBX' ② in this report.

3-8

SpringEffect and Facial Expression is possible aftter the Characterization.

Characterizing of basic bones and Spring Effect Settings.

4-1

Go to Character(N)/Character Set Up, Push ’Convert to Non-Standard’ button.

4-2

Select Custom Presets, map the iClone basic bones to her corresponding body part.

3DXchange Mapping Pane

Elsa Mapping List example
（Basic Part, Left Only）

iClone Bone	Elsa Bone
Head	頭
Neck Page：Neck	首
Spine Page：Left Shoulder	左肩
Spine4	-
Spine3	上半身
Spine2	下半身
Spine1	センター
Spine	Armature
Hips	RootNode(0)
LeftUpLeg	左足
*LeftUpLegRoll	下半身
LeftLeg	左ひざ
LeftLegRoll
LeftFoot	左足首
*First Solution Only

4-3

Use 'Rotate Object' Tool to make a T-Pose first.

4-4

When Basic Mapping Finished, push 'Convert' Button.

Facial Expression Settings.

5-1

After Activation, Select 'Face/Extend Mapping' button and map to both eyes.

5-2

Push 'Convert' and 'Expression Editor' buttons, select 'Head', push 'Auto'button.

5-3

Select Head, use 'Move Object' tool to adjust Head Orientation.

5-4

Select Eye, use 'Move Object' tool to adjust Eye Direction.

5-5

Select Viseme and adjust Slider for each Viseme element.

5-6

Create Blink face for N.NG and/or BMP to use in Animation with Vocal in iClone.

5-7

At Custom panel, use sliders to create emortional expressions and set in a Group so that her emotion can be controlled by mouse in iClone.

5-8

(Test) Select Custom and set the Cape ON/Off control to Upward.

5-9

By finishing the above job, Upper Body motion and Facial expression are ready for iClone use.

5-10

Go to Mody/Character and 'Apply to iClone' button.

Extend Mapping and Spring Effect Settings: Hair and Cape

6-1

Under Characterization Profile, click 'Face/Extend Mapping' icon, select all Hair bones and crick 'Map to Extend Bone' icon.

6-2

Push 'Convert' button and go to Spring(L), click 'Edit Spring' button.

6-3

Select necessary bones and click 'Active Spring', then assign Spring Type and set slider.

6-4

Go to Preview Motion/Animation, and try walk animation to confirm the effect.

My Spring Settings

Spring Type
	Translate	Rotate
Hair 0	-	-
Hair 1	-	-
Hair 2	7
Hair 3	7
Hair 4	5
Hair 5	5
Hair 6		6
Hair 7	-	-
Hair 8	-	-
Hair 9	-	-
Hair10	-	-

Group Setting=6 all

6-5

Push 'Apply' button when the hair movement looks natural.

6-6

Apply the same Map procedure to Cape Bones.

Map to the Cape Bones.

Spring Setting for Cape

My settings

Spring Type
	Translate	Rotate
Cape 1	-	-
Cape 2	-	-
Cape 3	6
Cape 4	4
Cape 5	2
Cape 6	-

Group Setting
Mass	2
Strength	2
Baunciness	2

Previewing with Dance motion
Map_to_Cape2

6-7

Now, push 'Convert' then 'Apply to iClone' buttons to save the current Elsa in iClone.

Extend Mapping and Spring Effect Settings for Skirt (My First Solution).

12 Sets of MMD Elsa skirt bones are connected to one group bone （Lower Body bone）and not related to leg movement.

At Extended Mapping to skirt, it is preferable to find out the way of avoiding the show through of legs.

My First Trial is to map one of the LegRoll to the Lower Body bone and Extend Map to front part of skirt bones intentionally so that skirt follows to the one leg.
(This solution gives Long Slit Skirt effect.)

My Second Trial is to make two Under Body bones to map both LegRolls, or, separate the skirt group into two and connect them to both legs.

It is safer to apply Opacity map around her weist.

7-1

Under Characterization Profile, click 'Face/Extend Mapping' icon and map to the skirt bones.

7-2

Select 6 sets of front Left skirt bones and map to the Leg Roll so that skirt follow to left leg.

7-3

Check 'Active' and Click 'Convert' button.

7-4

Select all first skirt bones and click 'Map to Extend Bone' button.

7-5

Go to Modify/Spring, push 'Edit Spring', select Spring Type and adjust softness.

7-6

At Preview Motion/Animation, give walk animation and preview the Spring Effect. Push 'Apply' button when finished.

Extend Mapping and Spring Effect Settings for Skirt (My Second Trial).

8-1

Export the Elsa FBX data to a 3D Tool. （tested by 3dxmax ）

8-2

Open the Schematic View and confirm the current structure.

All 12 Skirt bones are connected to a Lower Body bone.
SkirtMap1

8-3

（Trial 2-1）
Create two more Under Body bones and allcate skirt bones to each one.

Map these two Under Body bones for LeftUpLegRoll and RightUpLegRoll

LeftUpLegRoll					RightUpLegRoll
Under Body（Left side）					Under Body (Right side）					Front	Rear
skirt 01	skirt 02	skirt 03	skirt 04	skirt 05	skirt 11	skirt 10	skirt 09	skirt 08	skirt 07	skirt 00	skirt 06

この状態で3Dツールからエクスポートし、3DXchage上で各LegRoll をマップします。

8-5

Change the Skirt bone structure; separate bones in half and attach to each leg bones.

Under Body bone

Left leg

Right Leg

skirt
00

skirt
01

skirt
02

skirt
03

skirt
04

skirt
05

skirt
06

skirt
00

skirt
07

skirt
08

skirt
09

skirt
10

skirt
11

Modified Structure schemaic view
NewSkirtBone

8-6

Confirm the Modified Structure on the 3DView.

Skirt bones are connected to both legs.
NewSkirt

8-7

At PreviewMotion/Animation, apply walk motion and review the modified bone structure.

8-8

Push 'Convert' and 'Edit Spring' buttons and go to 'Spring Activation'.

8-9

Set Spring Type and Softness and preview the effect.

8-10

Push 'Apply' buttton when all setting is finished.

Converting Frozen Motion data VMD to BVH, Export to 3DXchange for iClone.

9-1

Open Live Animation, click on any one of sample avatar icon.

9-2

Go to File/Import/VMD and open "frozen motion data.vmd" or "Let it go-motion.vmd".

9-3

1) Go to File and select
"Reset Motion to T pose".

2) Go to File Export/BVH, Select Left handed coordinate system and export T-pose in BVH format (Left_T.bvh).

3) Import the "frozen motion data.vmd" or "Let it go-motion.vmd" for full length.

9-4

4)Go to File/Export/BVH to export the motion in BVH format.

5)At BVHExportOption, Push 'Browse' to select the export file location.

6) Select Right handed coordinate system.

(Note) Observe the exported motion in the 3DXchange.

9-5

Open 3DXchange5, open the Left_T.bvh.

9-6

The model is shown backward, rotate her, push "Dummy" icon then scale her by 1750.

9-7

Push "Bone Mapping" icon and Characterize by mapping bones manually.

3DXchange Mapping Pane

Mapping List （Left Only）

iClone Bone	Bone
Head	Head
Neck Page：Neck	Neck
Spine Page：Left Shoulder	-
Spine4	-
Spine3	-
Spine2	-
Spine1	-
Spine	Chest
Hips	Hips
LeftUpLeg	LeftHip
LeftUpLegRoll	-
LeftLeg	LeftKnee
LeftLegRoll	-
LeftFoot	LeftAncle

9-8

Check on Active, then push 'Convert' button.

9-9

Click 'Import' button, select the "frozen motion.bvh" and click 'Convert' button on Characterization Profile.

9-10

Push "Add to Perform" button to show it in Perform Editor.

9-11

Confirm the 5280 (or 12,814) frame motion.

9-12

At File/Export, select Animation, and set the Destination to iClone Custom Folder.

Using MMD Elsa Facial Expression in iClone5.

10-1

When Pushed 'Apply' button in the 3DX5, MMD Elsa should be up in the 3DView.

10-2

Go to Actor/Avatar/Modify/Avatar, pick Elsa and check the Foot Contact.

10-3

Go to Animation/Facial Animation, push 'Puppet' button and select 3DX Custom.

10-4

Select a Group in the Full Face Control, push Preview. Push Space bar and move mouse.
By pressing Head Orientation and Tilting before pushing Preview, face stops moving.

Use Head Orientation and Tilting when necessary.
puppeteering

10-5

Go to Animation/Facial Animation/Modify/Import Voice/Vocal, and Open 'let it go.wav'.

10-6

Open TimeSetting Panel, change Animation Length to 5,700 (or 13,000).

Using MMD Elsa Frozen Motion in iClone5.

11-1

Go to Animation/Motion/Custom and drag the 'frozen motion' onto Elsa body.

11-2

Start Motion at frame 0. Confirm her action with Vocal voice with Piano sound.

11-3

Open TimeLine, editing of basic bones are possible with Edit Motion Layer.

(to be continued)

3DXchange5 Pipeline test series 16: MMD Disney Elsa Let it Go in iClone5
2014. 5.29 rev.2014. 8. 2, 2014.10.14, 2015.1.4, 2015.1.7 Hirospot (Personal Site)