ipisoft.com
https://forum.ipisoft.com/

The quality of the 3d data
https://forum.ipisoft.com/viewtopic.php?f=2&t=8949		 Page 1 of 2
Author:  siriusye [ Mon Jan 20, 2014 7:51 am ]
Post subject:  The quality of the 3d data
I am recently experimenting the ipi soft mocap system for some education purposes. I set up 4 sony ps eye cameras in a performance studio. It looks like I've got most of things right.

1. The wall is in white color. The ground is grey (cannot find other space with bright color ground).

2. The calibration is good. I've got nearly perfect calibration with no red dots at all.

3. The actor was wearing solid dark color clothes (dark green jumper, blue jeans, dark brown shoes).

4. He did a T-pose at the beginning of the recording.

However, the tracking result seems like not very convincing. I have to edit a lot of frames during the tracking process to get an ok result. Now the question is: Is this supposed to be the process of this system. Or I could do something to improve it to require less manual intervention? I could message youtube videos of the setting and the post-process if anyone wishes to help. I couldn't post the video publicly as it contains some of my colleagues' face.

Thanks in advance!
Author:  vmaslov [ Mon Jan 20, 2014 11:54 am ]
Post subject:  Re: The quality of the 3d data
Hello
The amount of clean-up needed is affected mainly by the following:
  • quality of calibration
  • how good an actor's model in the software matches the real actor in video (proportions and colors)
  • uniformity of lighting (harsh shadows make the same color of clothes look different depending on a POV)
  • kinds of motions - motion which render some body parts invisible are obviously hard to track
Can you check what are the values of "marker misdetections" for different cameras in your calibration project? Go to the "Scene" tab and loop through the cameras.
Did you adjusted the actor's model, including applying "Analyze appearance", before you started the tracking?
If there are complex motions in your action video, I recommend you to record another action with simple motions (walking, turning around) to practice with.

You may share your videos (calibration and action) with us privately (send links to tech support email). We guarantee you to use them only for helping you, and will delete the files afterwards.
Author:  Greenlaw [ Mon Jan 20, 2014 9:42 pm ]
Post subject:  Re: The quality of the 3d data
siriusye wrote:
3. The actor was wearing solid dark color clothes (dark green jumper, blue jeans, dark brown shoes).

Was all the clothing dark? For example, were the sleeves the same dark color as the body? That may cause problems with tracking because if everything is the same dark color, the software may not be able to distinguish the arms from the body.

The ideal clothing is a saturated color long sleeved shirt with a black T-shirt pulled over. Here's a really old video that shows what I wore back when I was using the PS3 Eye configuration: Early iPi Mocap Test

The color of the long sleeves isn't important, but it should contrast with the body color and the background. You can find additional information about proper clothing in the Wiki. Actor Clothing

Good luck. :)

G.
Author:  siriusye [ Tue Jan 21, 2014 5:59 am ]
Post subject:  Re: The quality of the 3d data
I cannot send message with pictures. I put all the materials here as I found some videos with only myself. As I only can upload two attachments in a post, I show the scene setting in this one and present the tracking result in the next post

The scene setting includes all the camera positions
Attachment:
scene_setting.png
scene_setting.png [ 120.16 KiB | Viewed 46150 times ]


The calibration result
Attachment:
calibration.png
calibration.png [ 135.44 KiB | Viewed 46150 times ]
Author:  siriusye [ Tue Jan 21, 2014 6:02 am ]
Post subject:  Re: The quality of the 3d data
The appearance analysis in progress
Attachment:
appearance_analysis_in_progress.png
appearance_analysis_in_progress.png [ 443.02 KiB | Viewed 46150 times ]


The result of the appearance analysis.
Attachment:
appearnance_analysis_result.png
appearnance_analysis_result.png [ 444.7 KiB | Viewed 46150 times ]


The starting pose
Attachment:
init_pose.png
init_pose.png [ 464.14 KiB | Viewed 46150 times ]


The result video
http://youtu.be/kvgxFGOCGho

It looks like the system has been confused by a turning around movement. Waving hands with a relatively quick speed may also cause problem.
Author:  siriusye [ Tue Jan 21, 2014 11:15 am ]
Post subject:  Re: The quality of the 3d data
I attempted to edit my post to say thanks for your reply but kind of didn't find a way to do it..Anyway, really really thanks for help.
Author:  vmaslov [ Tue Jan 21, 2014 11:44 am ]
Post subject:  Re: The quality of the 3d data
siriusye wrote:
I attempted to edit my post to say thanks for your reply but kind of didn't find a way to do it..Anyway, really really thanks for help.

Forum settings allow to edit a post within a limited time after original posting, 2 or 3 hours as I recall.
Author:  vmaslov [ Tue Jan 21, 2014 12:46 pm ]
Post subject:  Re: The quality of the 3d data
From your attachments the possible problems to me are:
  • Model was not adjusted precisely enough. It is a bit bolder, and colors look not very close. Usually running Refit Pose and Analyze Appearance several times in a loop produces more close results.
  • Some actor's colors may confuse with the background - shirt & curtains, arms and walls.
But it is hard to give you proper directions without the video.
Author:  siriusye [ Tue Jan 21, 2014 3:18 pm ]
Post subject:  Re: The quality of the 3d data
Thanks a lot mate. I put a youtube video in the bottom of my second post.
Author:  siriusye [ Tue Jan 21, 2014 3:32 pm ]
Post subject:  Re: The quality of the 3d data
vmaslov wrote:
From your attachments the possible problems to me are:
  • Model was not adjusted precisely enough. It is a bit bolder, and colors look not very close. Usually running Refit Pose and Analyze Appearance several times in a loop produces more close results.
  • Some actor's colors may confuse with the background - shirt & curtains, arms and walls.
But it is hard to give you proper directions without the video.


Do you need the ipivideo file? I can put it somewhere.
Page 1 of 2 All times are UTC - 8 hours [ DST ]
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/