I am recently experimenting the ipi soft mocap system for some education purposes. I set up 4 sony ps eye cameras in a performance studio. It looks like I've got most of things right.

1. The wall is in white color. The ground is grey (cannot find other space with bright color ground).

2. The calibration is good. I've got nearly perfect calibration with no red dots at all.

3. The actor was wearing solid dark color clothes (dark green jumper, blue jeans, dark brown shoes).

4. He did a T-pose at the beginning of the recording.

However, the tracking result seems like not very convincing. I have to edit a lot of frames during the tracking process to get an ok result. Now the question is: Is this supposed to be the process of this system. Or I could do something to improve it to require less manual intervention? I could message youtube videos of the setting and the post-process if anyone wishes to help. I couldn't post the video publicly as it contains some of my colleagues' face.

Thanks in advance!

Hello
The amount of clean-up needed is affected mainly by the following:

• quality of calibration
• how good an actor's model in the software matches the real actor in video (proportions and colors)
• uniformity of lighting (harsh shadows make the same color of clothes look different depending on a POV)
• kinds of motions - motion which render some body parts invisible are obviously hard to track

Can you check what are the values of "marker misdetections" for different cameras in your calibration project? Go to the "Scene" tab and loop through the cameras.
Did you adjusted the actor's model, including applying "Analyze appearance", before you started the tracking?
If there are complex motions in your action video, I recommend you to record another action with simple motions (walking, turning around) to practice with.

You may share your videos (calibration and action) with us privately (send links to tech support email). We guarantee you to use them only for helping you, and will delete the files afterwards.

Was all the clothing dark? For example, were the sleeves the same dark color as the body? That may cause problems with tracking because if everything is the same dark color, the software may not be able to distinguish the arms from the body.

The ideal clothing is a saturated color long sleeved shirt with a black T-shirt pulled over. Here's a really old video that shows what I wore back when I was using the PS3 Eye configuration: Early iPi Mocap Test

The color of the long sleeves isn't important, but it should contrast with the body color and the background. You can find additional information about proper clothing in the Wiki. Actor Clothing

Good luck. :)

G.

_________________
Greenlaw
Artist/Partner - Little Green Dog | My Demo Reels (2013,) (2015,) (2017,) and (2019)

Watch a one minute excerpt on Vimeo now!

I cannot send message with pictures. I put all the materials here as I found some videos with only myself. As I only can upload two attachments in a post, I show the scene setting in this one and present the tracking result in the next post

The scene setting includes all the camera positions


The calibration result

The appearance analysis in progress


The result of the appearance analysis.


The starting pose


The result video
http://youtu.be/kvgxFGOCGho

It looks like the system has been confused by a turning around movement. Waving hands with a relatively quick speed may also cause problem.

I attempted to edit my post to say thanks for your reply but kind of didn't find a way to do it..Anyway, really really thanks for help.

Forum settings allow to edit a post within a limited time after original posting, 2 or 3 hours as I recall.

From your attachments the possible problems to me are:

• Model was not adjusted precisely enough. It is a bit bolder, and colors look not very close. Usually running Refit Pose and Analyze Appearance several times in a loop produces more close results.
• Some actor's colors may confuse with the background - shirt & curtains, arms and walls.

But it is hard to give you proper directions without the video.

Thanks a lot mate. I put a youtube video in the bottom of my second post.

Do you need the ipivideo file? I can put it somewhere.