Some hints on training with your own data

[kv2000]

Some hints on training with your own data

[hua-zi]

Hello, I'm interested in training ASH using my own multi-view video data. Could you please guide me on how to get these files similar to Subject0022_train.conf for my dataset? Thanks!

character{
    skeleton_dir =./meta_data/mydataset/ddc.skeleton                      # skeleton file
    skinning_dir =./meta_data/mydataset/ddc.skin                          # the skinning weights
    template_mesh_dir =./meta_data/mydataset/ddc.obj                      # the template meshes 
    graph_dir = ./meta_data/mydataset/ddc_graph.obj                       # the embedded graph, which is a lower res ones
    rest_pose_dir = ./meta_data/mydataset/ddc.motion                      # the rest pose 
    ...
    hand_mask_dir = ./meta_data/mydataset/hand_segmentation.txt           # for Dynacap Dataset characters we comment out this entry ;D 
}
dataset {
    ...
    # dofs
    skeleton_angles = ./meta_data/mydataset/skeletoolToGTPose/poseAngles.motion
    # rotation, and translation normalized dof; of (n, n-1, n-2 th frame) w.r.t the nth frame :D
    skeleton_angles_rotation_normalized = ./meta_data/mydataset/skeletoolToGTPose/poseAnglesRotationNormalized.motion
    ...
}

[hua-zi]

Maybe ASH_Train_Dataset.get_precomputed_human() in models/dataset_no_charactor_train.py can generate these files.

[Yi-Cheng0101]

Hi, as you mentioned above, there are five files we need to prepare before training. Could you provide how you preprocess your original videos and use what kind of tools to get these five files. Thanks!

[Yi-Cheng0101]

Maybe ASH_Train_Dataset.get_precomputed_human() in models/dataset_no_charactor_train.py can generate these files.

Thanks! And do you know here I place my custom video and the command to run this?

[moqiyinlun]

But how can I get the "Subject0022/ddc.skin", "Subject0022/ddc.skeleton", "Subject0022/ddc.obj", "Subject0022/skeletoolToGTPose/poseAnglesRotationNormalized.motion", "Subject0022/skeletoolToGTPose/poseAngles.motion" for my own dataset, since I carefully reviewed the code and realized that generating those five cache files you mentioned requires the preparation of skeleton information in advance？