In the field of human behavior generation, the X,Y,Z axis of the skeleton data is changed to R,G,B channels respectively to convert to image generation problems. Convert the full Time sequence of actions to a single image for each point and image generation for each class of data through ACGAN. Having novelty in taht the creation of human behavior has been resolved by converting it into an image.
Microsoft Research Cambridge-12 (MSRC-12) besture data was used in the experiment. A total of 12 classes exist, and about 60 time sequence data exist for each class. There was a problem that the length of time sequence for each class was very different. For smooth model learning, the time sequence for each class was extracted to a total of 256 through Average sampling. In addition, 60 data were thought to be insufficient for learning to generate appropriate behavior, so 600 data for each class was used through data copy.
Method
Discussion
1. Information loss inevitably occurs when converting the entire time sequence of human behavioral data into an image, and we need to think about how to minimize it.
2. Concerns about problems with different sequence lengths for each motion of human motion data
3. Performance improvement is needed to the extent that each operation can be distinguished in detail.
generation_of_human_motion_through_a_single_image_transformation_of_the_motion_time_sequence's People