Piano Player: Menuett by iClone 5 & 6

3DXchange5 Pipeline test series 20
iClone Music Practice: 'Menuett' by Piano Player
2015.4.18, 2015.8.3 rev. Hirospot (Personal Site)

Four Steps of the MMD 88 keys Piano Player to iClone

Demo Video

(YouTube)

Go to other Report →

Test Reports with 3DXChange5 & iClone5 Pipeline

印は日本語でのレポートです

Piano Player used in MMD world can be used in iClone through 4 conversion process.

The MMD Piano model is included in the 'Midi2VMD' tool by mqdl and have 88 boned keys.

By the 'Midi2VMD' tool, Midi data is converted to VMD motion data which is to be used to drive the boned keys of Piano.

To combine the Piano Model and the VMD motion data, the 'PMDforCollada' tool is used and creates Key motion in DAE format.

This data is converted to FBX in the FBXConverter and imported to 3DXchange for the use of iClone as Props.

All these tools are free and work steps are reported here with my short video.

Piano and Conversion Tools

No	Conversion	Tools	Notes
1	Midi/VMD	Midi2Vmd	12-44-Midi2Vmd.zip(394KB): Midi2Vmd/Model/pmdGRAND.pmd (DL Page)
1		Piano Model	pmdGRAND.pmd (rev.a) (877KB)
2	VMD/Dae	MMDfromCollada	MMDfromCollada_DirectX_10 (DL Page)
3	Midi/mp3	WavePad	NCH Software (DL Page)
4	Dae/FBX	FBXConverter	AUTODESK FBX (DL Page)
5	FBX/iProp	3DXchange	REALLUSION (DL Page)

Contents	Notes
Piano Chair	(DL Page) OMF2-01_band用品.zip(1.07MB) by ろっしろだ様 (Page)
Sound	(DL Page) menuett mid (4KB) by みゅうー様
Robo Dog	Props/3D LiveProps/Robo Dog_A
BackGround	Props/Wedding Planner/B171_Garden

Piano Model Conversion: PMD data to FBX

1-1

Open mqdl.jpn.org and download the '12-44-Midi2Vmd.zip' file.

1-2

Unzip the downloaded File.

Unzip 12-44-Midi2Vmd	Model	Pose

1-3

Import the pmdGRAND.pmd (rev.a compact GrandPiano, 2011 mqdl) in the PMDEditor.

1-4

Go to Export, select Collada format (use the plug in) and export the file.

1-5

Open FBX exporter and convert the file format to FBX.

1-6

Open 3DXchange and import the Piano. Each Key can be moved by the Rotate tool.

1-7

By selecting Toof bone and use Rotate Tool to open Roof.

Sample Piano Music: Midi Data Download

2-1

Download the sample Midi data: menuett.mid, 46sec (4KB)

2-2

Locate the downloaded file to the same Midi2Vmd folder.

2-3

Prepare Sound Converter and convert the MIDI data to mp3 format for iClone use.

Sound Data Conversion: Midi to VMD File

3-1

Download the MIDIData library (MIDIData.dll) and locate it to the same Midi2VMD.exe folder.

3-2

Open the Midi2VMD.

3-3

Drag the Midi File into the root> area, type open after the root> and push Enter.

MIDI2VMD

3-4

Enter 'conv pr' after the Prompt and push Enter to create Piano Roll data.

3-5

Enter 'track 003' which is the piano track number.

3-6

Enter 'export menuette.vmd' and push Enter.

3-7

Confirm the 'menuette.vmd' file is shown in the folder.

Piano Key Operation Conversion: VMD to FBX

4-1

Download the 'MMDforCollada' tool and open 'MMDfromCollada.exe'.

4-2

Confirm the Downloaded files and unzip them.

4-3

Open Net20 folder, run the 'MMDfromCollada.exe'.

4-4

Confirm the [初期設定]（Initial Setting） and Push the [設定完了] button in the corner.

MMDfromCollada
InitialSet

4-5

Select [入力]（Input） tab, add the Piano model name 'pmdGRAND.pmd' .

4-6

Push [追加（I）] button and add the animation data menuette.vmd.

MMDfromCollada

4-7

Select [出力]（Output） tab, enter the name for the converted DAE data at [変換先ファイル/参照]　and push　[実行（A）'] button.

MMDfromCollada
Menuette

4-8

Confirm the converted file 'mmdGRAND_menuette.dae' in the destination folder.

4-9

Use FBXConverter to convert the above DAE data to FBX format.

4-10

Confirm the converted file 'mmdGRAND_menuette.fbx.

4-11

Go to File/Open, and open the FBX file in 3DXChange.

4-12

Confirm the data in the Modify/Animation(M)/Motion Library and start the play button.

Piano Key Motion: mmdGRAND_menuette Take 001

Exporting the Piano with Key Operation

5-1

Go to File/Export, export the File as Props.

5-2

Open iClone 6, Confirm the Timeline.

5-3

Piano Key motion is shown in the Animation track.

5-4

Drag the mp3 sound data to the Piano.

5-5

Piano color can be changed by Modify/Material/pick Piano Mesh and change Diffuse Color.

Sample Video Work for 'Menuette' by iClone5/6

6-1

Prepare 3D Background in iClone 6, or iClone 5 can be used for easy set up operation.

6-2

Locate the Piano in the Scene. Add Chair and 'Robo Dog_A' for Video composition.

6-3

Prepare Three Cameras for Piano, Robo Dog and Scene.

6-4

Select Piano Key, Go to Modify/Material Settings and adjust Self Illumination to 86.

6-5

Select Piano, push 'Edit Animation Layer' select Roof and Post, then open by Rotate tool.

6-6

Save the Project in the iClone 5.

6-7

Open iClone 6, drag the Project file saved in iClone5 to iClone 6 screen.

6-8

Go to Window/Visual Settings/Shadow Map, make a mark on the Shadow, Set a Shadow Range.

6-9

Go to Render/Render Video, Set the Frame Size:1280x720.

6-10

3DXchange5 Pipeline test series 20: Piano Player - Menuett by iClone 5 & 6

2015.4.18,2015.8.3 rev Hirospot (Personal Site)