ipisoft.com
https://forum.ipisoft.com/

General smoothing of movements
https://forum.ipisoft.com/viewtopic.php?f=2&t=9334
Page 1 of 5

Author:  Yan [ Tue Apr 14, 2015 5:58 am ]
Post subject:  General smoothing of movements

Hi!
I have a question: i noticed - some kinds of animations are going to be "ragged". Like i lost some frames and algorithms can`t figure out how to extrapolate those movements. I`ve attached a video. I`ve tried completely ALL variations of tracking this region. I even created second calibration file with more precise heights of cameras. The same result.

So can i somehow smooth it? Can i smooth it in Ipi or should i use some of MotionBuilder`s extrapolation/smoothing tools?

On another hand, i have an example where my friend recorded a video WITHOUT any special clothes and movements are quite smooth.
Here is a video: https://www.youtube.com/watch?v=ALSS9fK1ULo

I`m sorry if theme like this already exist on forums.

Video: https://www.dropbox.com/s/iue3tyjwl4x6p ... t.wmv?dl=0

Thanks.

Author:  vmaslov [ Tue Apr 14, 2015 8:00 am ]
Post subject:  Re: General smoothing of movements

Hello

What exactly have you tried when processing the video? Usually, the required smoothness can be achieved with jitter removal and trajectory filtering after the tracking itself.

Also, does the source video itself suffer from issues like missing or duplicated frames?

Author:  Yan [ Tue Apr 14, 2015 8:50 am ]
Post subject:  Re: General smoothing of movements

So it was usual "idle" - when model is just standing and doing some small movements. Nothing else. The issue is that exatly THESE simple small movements are going to be very "ragged". It`s not about trajectory filter or jitter removal, or something else - we`ve tried absolutely all variations of tracking. It`s about why exactly these movements are quite "robotic" or something like this... We have no frame drops, sure. But i want to ask you - what is "duplicated frames"?
I think it`s because movements of our actor are quite implicit, not distinct or something like that.

Author:  vmaslov [ Tue Apr 14, 2015 9:11 am ]
Post subject:  Re: General smoothing of movements

Yan wrote:
But i want to ask you - what is "duplicated frames"?

I mean by-pixel equal images in sequential frames of the video. This may be the result of dropping frames by some camera, when missing frame is filled by the previous image.

You may be right about subtle movements. It would be great if you could share this video with us so we process it ourselves and see whether the result can be improved. We'll need iPiVideo and a scene file.

Author:  Yan [ Thu Apr 16, 2015 2:49 am ]
Post subject:  Re: General smoothing of movements

I сut the video to region when this motion appears, because it`s very large(7gb).It`s not a problem if video will be shorter than IPImotion tracked file? Also there are calib file with cam height. Thanks for feedback.

Author:  vmaslov [ Thu Apr 16, 2015 9:14 am ]
Post subject:  Re: General smoothing of movements

So, where's the link? :)
We do not need iPiMotion file, try to do the tracking from the scratch. Only need iPiVideo with action and iPiScene or iPiCalib with calibrated camera positions.

Author:  Yan [ Fri Apr 17, 2015 6:23 am ]
Post subject:  Re: General smoothing of movements

What the.. sorry, it`s something wrong))
https://www.dropbox.com/s/m8tgzuth29pmd ... Video?dl=0
https://www.dropbox.com/s/erwso4130ri01 ... e.xml?dl=0

Author:  vmaslov [ Wed Apr 22, 2015 4:54 am ]
Post subject:  Re: General smoothing of movements

I have looked on your video. I confirm that there are some small movements of the arms when an actor is looking quite still. Not as obvious as in your initial sample though.
The issue may be mitigated by applying higher values for smoothing filter. But at the cost of loosing actual small movements that were captured.

I suppose this is something that can be solved by improving our Jitter Removal filter. We'll do a research on this topic. Thanks for pointing that out.

Author:  Yan [ Thu Apr 23, 2015 8:15 am ]
Post subject:  Re: General smoothing of movements

Thanks for feedback.
It would be great if you are looking into this direction, because this is our main problem now.
So, we are planning to expanse up to 16 cameras.
What can you advice about calibration. It`s going to be much more painful than 8 cams(which also was a bit difficult).

Author:  vmaslov [ Sat Apr 25, 2015 1:53 am ]
Post subject:  Re: General smoothing of movements

The calibration should not be much of a problem (except extended time) when a light is moved properly.
I usually walk by the border of capture space holding the light inside the space in a straight arm. This way it can be seen by the majority of cameras at once. Also, attaching the light to a long stick usually helps in relation to visibility.
Make 2-3 loops holding the light at different height each time. And do not forget to mark several ground points in distinct places.

Page 1 of 5 All times are UTC - 8 hours [ DST ]
Powered by phpBB® Forum Software © phpBB Group
http://www.phpbb.com/