MMD Wafuku Ca(Shii-e) dances to the Yume to Hazakura in iClone

Welcome to Hirospot Personal Site on FC2

Click!

Introducing MMD Model "Ca_wafuku_mmd"（和服シーエ）
Dances to the Music: Yume to Hazakura（夢と葉桜） in iClone

Demo Video

Using MMD Character for
iClone Dance Prop and iAvatar

3DXchange6 Pipeline test series 6 (27)
2015. 12. 10 Hirospot (Personal Site)

Dance prop has been reported in the past Report #8 as a simple way for MMD character to play dance in iClone.
LiveAnimation Soft can import MMD character, load any Dance Motion and export as a single FBX data. $Ca\Hazakura$

This FBX data is imported into 3DXchange directly and can play the same dance without Characterizing.

Lots of excellent Character models and motions are available in the MMD world for free, however, not all models can succeed the dance animation in iClone.

The model selected in this report "Ca(Shii-e)_wafuku_mmd" was succeeded as Dance Prop and iAvatar for iClone Use.

They play Japanese dance in the same demo video screen, the Prop has Finger Actions and the iAvatar can show Facial Expressions.

Work Flow

	MMD based Dance Prop	MMD based iAvatar
Edit Body Bones	Possible Modify/Motion/Edit Animation Layer/Edit Motion Layer	Possible Modify/Animation/Motion/Edit Motion Layer/Bone Edit Mode
Add Facial Expression	Not Possible	Possible by Expression Editor setting in 3DXchange Use 'Face Puppet' with 3DX_Custom in 'Face Animation Profile'. 'PuppetClip' can be moved in the Timelone
Edit Spring	Not Necessary	Possible by Spring setting in 3DXchange Select Spring and Activate
Edit Material	Possible	Possible:Modify/Material/Material List
Edit Proportion	Not Possible, Scale only	Partial:Modify/Edit/Avatar Propotion

Tools Used	Version	Producer	Comments
PMDエディタ　(PMD Editor）	0.1.3.8	極北P様	Used for Exporting the MMD Model in DAE format. Used for confirming the Texture location of the Model.
LiveAnimation	Beta 4.64	Dreamfactory社	For iProp: Used for Import the MMD Model in PMX format, Loading the VMD Motion Data and Export as FBX data. For iAvatar: Import the VMD Motion data and Export in BVH format.
FBX Converter	X64 2013	Autodesk社	For iAvatar: Convert Model and Animation from DAE to FBX.
3DXchange 6 Pipeline	6.2.0828.1	Reallusion社	For iProp:Import MMD Model in FBX format and Texturing. For iAvatar: Import MMD Model in FBX Format Characterize and load the BVH motion for iClone.
iClone 6 Pro	6.2.2102.1	Reallusion社	Compose Video by Editing the Timeline, Preview and RealTime Rendering.

Contents for Demo Video and Site
（デモ動画用素材と参照サイト名）

Creator （作者）

Comment （内容）

Lyrics：The Rant Room:夢と葉桜（Yume to Hazakura)

Aoki Gekkoh様

日本語歌詞、英語歌詞を転載させて頂きました。

Vocal ：　hazakura.mp3 (5.86MB)
ボーカル: 夢と葉桜

AOKI_GEKKOH
青木月光様

Music:AOKI_GEKKOH 青木月光様、
ボーカル：紅様（Gloomylunar 様）

Dance Motion:hazakura_Teto.vmd (2,074KB)　
モーション：夢と葉桜（Full Version)

こだわりPのMMD
モーション工房様

全体のモーション振付には「こだわりPのMMDモーション工房」様ご提供のモーショントレースデータを借用させて頂きました。
LiveAnimation と FBX Converter を使い、3DXchange でiMotion化しています。

Background:
背景（ステージ）：御神木桜ステージ.x　
【MMD】桜ステージ三種セット

()@zutanosi様

MMD用Xファイル形式のデータを借用いたしております。

Background Sky Warter and Leaves

Reallusion

iClone6/Template/Set & Atmosphere

MMD Character used in the Report and Demo Video

Thank you for using MMD Model Data: Ca_wafuku_mmd_V101 Designe & modeling by: Deino, rigging by kuroyu
Uploader
Download Page
Data Save Button

Creating the Dance Prop from Ca_Wafuku_MMD Character

Preparing the MMD Model

1-1

Download the MMD Model data, extract in the Target Folder and find the PMX data in the Folder.

1-2

Open LiveAnimation, Go to File/Import/PMX Import, and Import the Ca_Wafuku.pmx.

Note:

LiveAnimation can import the Model in FBX format, but VMD Motion can not be applied to this model.

1-3

Go to File/Import/VMD, and import the hazakura_Teto.vmd.

1-4

Go to File/Save Motion, and Save the motion as .lam format.

1-5

Adding T-Pose before the Motion start. This step is preferable for the works in the 3DXchange.
At Window, open ActionMixer, Motion List and drag the STNT_POSE.lam on the Action Mixer.

1-6

Set the Current Frame at 10, push the Cut Clip Botton and delete the rest of frames.

1-7

Go to File/Import/VMD, import the hazakura_Teto.vmd, save it.

1-8

Update the Motion list and drag the Hazakura Teto.lam to the Action Mixer after the T-pose position.

Click the upper right text
MotionList

0-10	11-15290
T-pose	Hazakura Motion

1-9

Comfirm the Motion for Total 15290 frames.

1-10

Go to File/Export/FBX, Push OK button on the FBX ExportDialog.

1-11

Wait several minutes until the Export is completed as this step is very heavy. (Filesize:104.225KB)

FBX_ExportDialog
FBXExprtDialog

Material Mapping Work in 3DXchange

2-1

Open 3DXChange6. Go to File/Open, and open the FBX file.

Model Scale and Rotaiton are to be adjusted.
3DX

2-2

Scale the Model by 850 and Rotate by 180°.

2-3

Texture the model, drag each texture data from the Model Folder.

Info on PMDEditor			iCon	DAE-FBX Converted	FBX from Live Animation
	Material Name	Texture Name		Name on 3DXchange
0	m_ca_hada	hada.png		Material-m_ca_hada	Ca_wahuku_m_ca_hada0
1	m_ca_white2	white.png		Material-m_ca_white2
2	m_ca_kuti	pink.png		Material-m_ca_kuti
3	m_0_ca_black_metal	dgray.png		Material-m_0_ca_black_metal	Ca_wahuku_m_0_ca_black_metal3
4	m_0_ca_kuro2	black.png		Material-m_0_ca_kuro2	Ca_wahuku_m_0_ca_kuro24
5	m_ca_kami01+	kami_ca5.png		Material-m_ca_kami01+	Ca_wahuku_m_ca_kami01+5
6	m_ca_hunaver2	na.png		Material-m_ca_hunaver2	Ca_wahuku_m_ca_hunaver26
7	m_ca_me meka	me_L.png		Material-m_ca_me_meka	Ca_wahuku_m_ca_me meka7
8	m_ca_me	me_R.png		Material-m_ca_me	Ca_wahuku_m_ca_me8
9	m_of_nawa	red.png		Material-m_of_nawa	Ca_wahuku_m_of_nawa9
10	m_of_maebari	black.png		Material-m_of_maebari	Ca_wahuku_m_of_maebari10
11	m_of_skirt1	skirt_wa.png		Material-m_of_skirt1	Ca_wahuku_m_of_skirt111
12	m_of_skirt2	black02.jpg		Material-m_of_skirt2	Ca_wahuku_m_of_skirt212
13	m_of_skirt3	black.png		Material-m_of_skirt3	Ca_wahuku_m_of_skirt313
14	m_of_body1	black02.jpg		Material-m_of_body1	Ca_wahuku_m_of_body114
15	m_of_body2	red.png		Material-m_of_body2	Ca_wahuku_m_of_body215
16	m_of_body3	white.png		Material-m_of_body3	Ca_wahuku_m_of_body316
17	m_of_sode1	wahuku2-05.png		Material-m_of_sode1	Ca_wahuku_m_of_sode117
18	m_of_sode2	red.png		Material-m_of_sode2	Ca_wahuku_m_of_sode218
19	m_of_socks	black.png		Material-m_of_socks	Ca_wahuku_m_of_socks19
20	m_of_leg1	skirt_wa.png		Material-m_of_leg1	Ca_wahuku_m_of_leg120
21	m_of_leg2	gold.png		Material-m_of_leg2	Ca_wahuku_m_of_leg221
22	m_of_gtrbelt1	black.png		Material-m_of_gtrbelt1	Ca_wahuku_m_of_gtrbelt122
23	m_of_gtrbelt2	gold.png		Material-m_of_gtrbelt2	Ca_wahuku_m_of_gtrbelt223
24	m_of_kutu1	tare02.png		Material-m_of_kutu1	Ca_wahuku_m_of_kutu124
25	m_of_kutu2	black.png		Material-m_of_kutu2	Ca_wahuku_m_0_ca_black_metal3
26	m_of_kanzasi1	black.png		Material-m_of_kanzasi1	Ca_wahuku_m_0_ca_kuro24
27	m_of_kanzasi2	gold.png		Material-m_of_kanzasi2	Ca_wahuku_m_of_kanzasi227
28	m_of_kanzasi3	red.png		Material-m_of_kanzasi3	Ca_wahuku_m_of_kanzasi328
29	m_of_necklace1	gold.png		Material-m_of_necklace1	Ca_wahuku_m_of_earring131
30	m_of_necklace2	necklace2.png		Material-m_of_necklace2	Ca_wahuku_m_of_necklace230
31	m_of_earring1	gold.png		Material-m_of_earring1	Ca_wahuku_m_of_necklace230
32	m_of_earring2	red.png		Material-m_of_earring2	Ca_wahuku_m_of_earring232
33	m_of_ribbon1	black.png		Material-m_of_ribbon1	Ca_wahuku_m_of_ribbon133
34	m_of_ribbon2	red.png		Material-m_of_ribbon2	Ca_wahuku_m_of_ribbon234
35	m_of_armfrill1	black.png		Material-m_of_armfrill1	Ca_wahuku_m_of_armfrill135
36	m_of_armfrill2	red.png		Material-m_of_legfrill2	Ca_wahuku_m_of_armfrill337
37	m_of_armfrill3	black.png		Material-m_of_armfrill3	Ca_wahuku_m_of_armfrill236
38	m_of_legfrill1	black.png		Material-m_of_legfrill1	Ca_wahuku_m_of_legfrill138
39	m_of_legfrill2	gold.png		Material-m_of_legfrill2	Ca_wahuku_m_of_legfrill239
40	m_of_tare	tare02.png		Material-m_of_tare	Ca_wahuku_m_of_tare40
41	m_ca_matuge	matuge.png		Material-m_ca_matuge (Opacity)	Ca_wahuku_m_ca_matuge41

2-4

Confirm the Model action over the entire frames.

2-5

Go to File/Export, Chek the 'Export Geometry' and 'Export Animation' at Animation Settings.

2-6

Push OK button and confirm the Props in iClone 6 Custom.

Creating the iMotion applied to iAvatar in iClone

Open LiveAnimation, drag sample avatar on the screen, and import the Hazakura_Teto.vmd.

Add T-Pose at the top of the Motion, go to File/Export/BVH and export the Motion in BVH.

Select RightHandCoordinate at BVHExportOption. (Do not select Mirror this time)
BVHExxp_Hazakura_R

Open 3DXchange, Open the BVH file, Scale by1700 and Rotate the dummy model by 180°.

Characterizing_1: Map the Dummy Hips to the T-Hazakura Hips.

Complete the Mapping to the other Bones, Activate and Push 'Convert' Button.

Go to File/Export, Check on the 'Export Animation' at Exporting iClone Content, then push 'OK'.

Creating the iAvatar for iClone by Ca-Wafuku MMD Character

Open PMDEditor, import MMD Character Ca_Wafuku.pmx and export by DAE Format.

Open FBXConverter, drag the Model data on the Table and click the OK button.

Open the Main FBX File and other Morph added Files, Set Facial Expressions first.

Check the report#15J-1 for the Details. This step is necessary for the Viseme Setting at Expression Editor.

Make T-pose and Start Characterize by pushing 'Convert to Non Standard' button.

Characterizing_2 for iAvater: Map the Hips on the Dummy to the 全ての親 bone.

Main Bones Mapping Table

					Head/頭
					Neck1/首
Right Hand	Right ForeArmRol	Right ForeArm	Rightc ArmRoll	RightArm	Right Shoulder 右肩	Left Shoulder 左肩	LeftArm	Left ArmRoll	Left ForeArm	Left ForeArmRol	Left Hand
左手首	右手捩	右ひじ	右腕捩	右腕			左腕	左腕捩	左ひじ	左手捩	左手首
					Spine2/上半身2
					Spine1/上半身
					Spine/下半身
					Hips/全ての親
		Left Food	Left Leg	Right UpLeg			Left UpLeg	Left Leg	Left Food
		右足首	右ひざ	右足			左足	左ひざ	左足首

Map the Hips on the Dummy to the '全ての親' bone as MMD characters are not designed with Hip bones.
Characterize

Extend Bone Mapping: Bone Angle Adjustment

Following Bone angles are adjusted to apart from the body.
Skirt Bones　スカート	右スカート11-15	左スカート11-15
	右スカート21-25	左スカート21-25
	右スカート31-35	左スカート31-35
	右スカート41-45	左スカート41-45
	右スカート51-55	左スカート51-55
	右スカート61-65	左スカート61-65
(Straw Rope しめ縄)	右縄1　-　右縄5	左縄1　-　左縄5

Skirt Bone Angles can be adjusted to prevent Body penetration. This can also be done in iClone.
SkirtBoneAdjust

Spring Setting for Extend Bones

Part	Bone Name	Element Spring		Group Setting
Part	Bone Name	SpringType	Level	Mass	Strength	Bounciness
Sleeve 袖	左/右袖11	None
	左/右袖12	Rotate	8	11	11	1
	左/右袖13	Rotate	8	11	11	1
	左/右袖14	Rotate	8	11	11	1
	左/右袖15	Rotate	8	11	11	1
	左/右袖16	Rotate	8	11	11	1
Skirt スカート	左/右スカート11	Not Mapped
	左/右スカート12-15	Translate	7	11	11	1
	左/右スカート22-25	Translate	7	11	11	1
	左/右スカート32-35	Translate	7	11	11	1
	左/右スカート42-45	Translate	7	11	11	1
	左/右スカート52-55	Translate	7	11	11	1
	左/右スカート62-65	Translate	7	11	11	1
	スカート72-75	Translate	7	11	11	1
Rope しめ縄	左/右縄1	Not Mapped
	左/右縄2	Translate	7	11	11	1
	左/右縄3-5	Rotate	7	11	11	1
Apron 前垂	左/右前垂22	Not Mapped
	左/右前垂23-25	Translate	7	11	11	1
	前垂13-15	Translate	7	11	11	1
Long Hair 後髪	左/右後髪0501	Not Mapped
	左/右後髪0502	Translate	7	6	6	3
	左/右後髪0503-9	Rotate	8	6	6	3
	左/右後髪0301	Rotate	2	2	2	2
	左/右後髪0401	Not Mapped
	左/右後髪0402-3	Rotate	2	2	2	2
Ribbon	左/右リボン11,21	Rotate	6	1	9	1
Skirt	左/右スカート紐
String	左/右和服紐１1,2	Translate	8	3	3	11
Earing	左/右イヤリング	Rotate	2	3	3	3
Hairpin かんざし	カンザシ1	Not Mapped
Hairpin かんざし	カンザシ2,3	Rotate	4	9	2	9
Breasts 胸	左/右胸	Translate	6	9	5	10

Extend Mapping: Spring Set for Breasts
SpringSet

Finish Setting the Spring Type and Group Setting, Preview the Result.

Push 'Apply to iClone' button or Expport to iClone.

Scene Making with the Dance Prop and the iAvatar in iClone 6

Open iClone6, Locate the MMD Dance Prop (Ca-Hazakura) and iAvatar (Ca-Wafuku MMD).

Open Project/TimeUnit and Set the Total Frames as 15800.

Go to Render/Output Size/Frame Size, Select HD720p (1280x720).

Add the Sound data (Hazakura.mp3)　to iAvatar Ca_Wafuku MMD.

Try Facial Expressions by using the 3DX_Custom on Face Puppet.

Modify/Motion/Facial/Face Puppet
FacePuppet

Select the Back Ground images for Demo Video and drag them on the Screen.

Content	iCon	Access
Water		Template/Content/Set/Video Diffuse/Spring Water
Sky		Template/Content/Set/Sky/Night
Leaves		Template/Atmosphere/Special Effects Vol.2 Natural Phenomenon/ Leaves_Large Space/Leaf 01_Air_Backward
Stage		Custom/Props/MMD_Stage/SakuraStage （御神木桜ステージ）

Adjust Position for Avatars, Stage, Light, and preview the Demo Scene.

Camera Switch Setting for the Demo Movie

Open Timeline/Project/Switcher. Go to Create/Camera and add Cameras.　　

Camera Name	Target	Focusing Mainly on:
Camera-S	BG Scene	To Show all the Scene
Camera-P	For Dance Prop	To Show Finger Action of the Dance Prop
Camera-A	For iAvatar	To Show Facial Expression of the iAvatar
Camera-T	Two Characters	To Show dancing together

Set the Camera name in the Scene Panel.
Scene

Go to Project/Switcher/ Click on the Switcher Line, select Camera at Camera List.
CameraSwitch

Camera Settings for the Demo Video

Step	Vocal Japanese Lyrics	Vocal Base Frame Number	Demo Frame Number	Camera No.	English Lyrics by Aoki Gekkoh
Intro		1 - 1638	1-1617	Camera-S
1	この川の流れるが如く穏やかに音色が聞こえる吹く風が頬を撫でていく懐かしい思い出が滲む	1617 - 3063	1618-3007	Camera-A	The flow of this river is like a calm tone coming into hearing. The blowing wind strokes my cheek. Nostalgic memories flow out.
2	遙かなる空は胸を裂くように忘れかけた記憶を醒ます溢れるは涙	3065 - 4560	3008-4555	Camera-T	The distant sky, as if splitting my chest, awakens almost-forgotten memories. Tears overflow.
3	白い桜の花の季節は遠く夢の中にだけ舞い散る花びらの囁いた忘れられない言葉	4554 - 6045	4556-6051	Camera-A	The season of white cherry blossoms is only within a distant dream. The fluttering, scattered cherry blossoms whispered　 unforgettable words.
Interlude		6026 - 6836	6052-6830	Camera-T
4	眠れない夜を一人きり歩き出す　ぬるい風の中いたずらにはしゃいでいたまま気がつけば思い出に変わる	6837 - 8250	6831-7547 7548-8236	Camera-P Camera-A	In a night I cannot sleep, alone I begin to walk in the lukewarm wind. While I tried in vain to cheer up, once I realized, it had changed to a memory.
5	月も雲隠れ蒸し暑い日々の消したい記憶も儚くは止まらない涙	8251 - 9728	8236-9736	Camera-S	Even the moon has disappeared. The hot and humid days' memories I want to erase remain fleetingly in the unceasing tears.
6	刻まれる時間は残酷にヒトを縛りつけ遊ぶ青々と茂る桜の葉は何も語りはしない	9722 - 11212	9737-9728	Camera-T	The time engraved in me cruelly binds people together in play. The lushly growing cherry blossom leaves tell no more.
7	白い桜の花の季節は遠く夢の中にだけ舞い散る花びらの囁いた忘れられない言葉	11213 - 12676	9729-12711	Camera-T	The season of white cherry blossoms is only within a distant dream. The fluttering, scattered cherry blossoms whispered unforgettable words.
Ending		12677 - 15290 - 15800	12712-15800	Camera-S

Render Setting

Render/Format:MP4, Select Video

Output Size/Frame Size:HD 720p(1280x720)

Render Quality:Preview

iClone Music Practice: Yume to Hazakura（夢と葉桜）by Ca_wafuku_MMD（和服シーエ） in iClone iClone3DXchange6 Pipeline test series 27: 2015.12.10