Hello all

I am working on with the capture software trying to push it in a different direction.
I am trying to combine motion capture and video to make hybrids like 2010's Alice in wonderland.

I am using two kinects, I do not own the processing software (yet) and I am having a third party process it for now.
I have done tests with 1 kinect, 2 kinects at 90 degrees (front and left side) and at 180 degrees. the video camera is placed over one of the kinects.

here are my issues, I was hoping someone would have some insight?

1) the left arm. 2 kinects are 90 degrees or near to 180 I have the same issue of the model's left arm folding up oddly or failing to track at all even if it is visible clearly from both cameras depth mode. and it is almost always the the left arm. My model is an actress and her arms are bare. How do I increase accuracy? If I can get it dead on accurate I can use the model's hands thus solving the "no hand tracking" issue.

2) Sync slippage: Longer takes of over a minute often have the video sync slipping by more than an second. Both are set to the same time code of 29.97 frames per second. I imagine for most applications it would not matter much, but for this it is critical.

How I am syncing:
Pretty simple, actually.... I have model do a T pose, and clap over her head, I can line things up visually from there.



Is there a setting to prevent self-collision? For those times when the arm decides it really is actually through the ribcage?

Tracking errors with "lost" limbs usually can be easily cleaned up within Mocap Studio:
http://wiki.ipisoft.com/Clean-up


Kinects record at exactly 30 fps, not 29.97. This may be the cause of slipping.

Ah, you might well be correct on the time slipage, you would not think .03/persecond would make that much difference, but apparently, it does.

As for the limb issue, here is the problem. In Mocap studio, it does not see or loses track of the limb, you stop the tracking do back and fix it, refitting the pose does not work most of the time, and there is often a gimbal lock issue trying to pose the arm such that you are nearly doing this frame by frame. I can show screen grabs if you like.

example, when holding her arm out to the side in the typical pose one would do show your bicep muscle (arm is out, elbow is bent upward). it places her arm inside her chest. manually adjust this, the next frame is goes right back in there. so clearly I am doing something wrong.

It is recommended to turn off Trajectory Filtering (set it to zero) when doing cleanup. Otherwise, you do not see the exact "refitted" pose, but filtered one, which considers neighbour "incorrect" poses in its calculation.
Of course, you are encouraged to share your problematic project, so we can help you with tracking.