Hi again,
I made some changes to my setup, and I'm really happy with the results now:
http://youtu.be/3RNNL_28Gkwhttp://youtu.be/b0PRzdA-Q1MThe hands are tracked most of the time without an error, and there is very little jitter. Post-processing does not change much.
I changed the positions of my cameras - as Greenlaw suggested - a little bit: two of them are much lower now, and cover much better the two sides of the scene. I still have 3 cameras at 2 meters 80. I might lower two of them a little bit, I'll see that.
I also made a few tests with clothes, and the best I found is what i wear on the video. I think the gloves are very important. They are in a dark red color. I also bought a few polystyrene plates in order cover most of the clutter in my room. I'm pretty sure it helped: I'll build something more practical soon.
One more thing: I use most the time the head tracking feature now. Processing takes longer, but it's much more realistic, except maybe for robots, monkeys or astronauts!