Comments on In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body InteractivityTypePad2010-07-23T18:39:28ZSLHamlethttps://nwn.blogs.com/nwn/tag:typepad.com,2003:https://nwn.blogs.com/nwn/2010/07/mocap-second-life/comments/atom.xml/bodzette Coignet commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f3331e90970b2010-08-20T18:58:36Z2010-08-20T18:58:36Zbodzette CoignetSo let's say that this can't/won't be done in second life any time soon. Have the naysayers forgotten the existence...<p>So let's say that this can't/won't be done in second life any time soon.</p>
<p>Have the naysayers forgotten the existence of OpenSim and open source browsers such as Imprudence?</p>
<p>This technology doesn't have to be implemented on Linden Lab's version of Second Life for it to make it part of the experience, opensim will do just as well.</p>Arcadia Codesmith commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f2a1fae1970b2010-07-28T14:13:33Z2010-07-28T14:13:33ZArcadia CodesmithTo my mind, the biggest challenge in full-body avatar control is the lack of kinetic feedback. We've seen systems to...<p>To my mind, the biggest challenge in full-body avatar control is the lack of kinetic feedback. We've seen systems to "touch" things, even "hug" people, but it's hard to envision with the current state of technology a consumer-grade system that would allow the user to be lifted or dipped in a ballroom dance, or permit a player with a virtual sword to have a blow blocked by the opponent's shield and have the momentum of the controller be checked in mid-swing.</p>
<p>You can do fun and amazing things with gyroscopes in this regard, but not quite enough.</p>
<p>I'm very sorry to say that by the time we have full-body control with feedback sufficient for an immersive experience, many of us are going to be moving very slowly and cautiously. It'd be embarassing if grandma or grandpa broke a hip playing Street Fighter XXXVII.</p>
<p>But I dearly hope I'm wrong. I have plans for my holosuite when it finally hits the market.</p>shaqq commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f29db67f970b2010-07-27T23:50:02Z2010-07-27T23:50:02ZshaqqAnn, you shouldn't treat science and technology as something that aims at leaving someone behind. Nobody is going to prohibit...<p>Ann, you shouldn't treat science and technology as something that aims at leaving someone behind. Nobody is going to prohibit using keyboard and mouse. Moreover, the technology mentioned above by RODION is being developed with the goal in mind to facilitate the use of computer systems by disabled people (even completely paralysed). Nobody will be left behind! What I'm doing is just an attempt to force those who can walk and move to finally stand up from the couch and do some exercise. </p>Ann Otoole InSL commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485c16257970c2010-07-27T22:43:46Z2010-07-27T22:43:46ZAnn Otoole InSLI'm sure people that use wheelchairs or other equipment will be thrilled to see the metaverse discard them.<p>I'm sure people that use wheelchairs or other equipment will be thrilled to see the metaverse discard them.</p>John "Pathfinder" Lester commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485be0f5f970c2010-07-27T18:42:14Z2010-07-27T18:42:14ZJohn "Pathfinder" Lesterhttp://bit.ly/John_LesterVery cool research. Ultimately, I think the ability to instantly map your physical-world body language and facial expressions onto your...<p>Very cool research. Ultimately, I think the ability to instantly map your physical-world body language and facial expressions onto your avatar will be a game-changer. </p>
<p>I spoke about this idea at length at a recent keynote I gave in Denmark: <a href="http://worlds.ruc.dk/archives/2758" rel="nofollow">http://worlds.ruc.dk/archives/2758</a></p>
<p>"To condense fact from the vapor of nuance" is the key.</p>Adric Antfarm commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485bcb98e970c2010-07-27T16:00:08Z2010-07-27T16:00:08ZAdric Antfarmhttp://www.adric.usIf there is any piece of software (I know the hazard of calling Second Life a "game") with more user...<p>If there is any piece of software (I know the hazard of calling Second Life a "game") with more user "experts" in just about every area than Second Life, I've sure as hell never seen it.</p>Arcadia Codesmith commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f297d7a8970b2010-07-27T13:59:49Z2010-07-27T13:59:49ZArcadia CodesmithWho said anything about high quality mocap? Controlling the limited number of joints available in SL would be just peachy....<p>Who said anything about high quality mocap? Controlling the limited number of joints available in SL would be just peachy.</p>
<p>But the best we could do with the state of the art would be to trigger animations with the mocap interface. Primative.</p>
<p>On the other hand, if a PC verson of kinect can drive mocap software, the barriers to entry in the SL animation market would fall through the floor. </p>
<p>And to be honest, full-body control is a LOT like voice, in terms of breaking immersion. If you're an average graceless human being, your avatar's posture and gestures will reflect that. </p>
<p>I expect it would be a fantastic advance for specific applications (SL's ballet companies rejoice), but not much employed in day-to-day use. Too bad; we could all use the exercise.</p>Ajax Manatiso commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485bbf702970c2010-07-27T13:21:31Z2010-07-27T13:21:31ZAjax Manatisohttp://www.second-lives.comThe quality of motion is based on the actually number of joints interpreted -- at this point in time SL...<p>The quality of motion is based on the actually number of joints interpreted -- at this point in time SL avis have no finger joints or toes joints and the remaining joints have limited motion. MOCAPS CAN be uploaded to SL and I have successfully loaded a number of them -- however the extra joints have to be removed from the BVH to work properly in SL. The end result is better than most SL animations, but a lot of the fluidity is lost. I'm surprised at Stroker's statements -- AO's use BVH files just like any other animation in SL -- didn't he know that? <br />
Bottom line is all the additional joints required for high-quality MOCAP movement in SL would probably double the lag and the strain on the servers, so it just ain't gonna happen.</p>Ann Otoole InSL commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f29721a9970b2010-07-27T11:10:33Z2010-07-27T11:10:33ZAnn Otoole InSLok so what will win to replace a mouse and keyboard? "rigging up" in an expensive mocap system or a...<p>ok so what will win to replace a mouse and keyboard? "rigging up" in an expensive mocap system or a set top box (ala kinect) that costs a couple hundred bucks or less?</p>
<p>I'll go with the kinect style system because, in a couple of years, it will be ubiquitous and the defacto standard for advanced UI development.</p>
<p>People that want to develop the viewer for these things should be discussing things with PrimeSense so they can be ready when the units are getting ready to ship.</p>
<p>I.e.; we don't need full body control (not possible in SL anytime soon anyway). We do need hand motion control for the UI and that would be ground breaking enough for the edu and training simulation market to make a vast difference alone.</p>Little Lost Linden commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f2962771970b2010-07-27T06:52:37Z2010-07-27T06:52:37ZLittle Lost Lindenhttp://profile.typepad.com/thebotzoneThe Lawnmower Man is in your head now Jake. There's no escape...Ever. http://www.virtualworldlets.net/Resources/Hosted/Resource.php?Name=LawnmowerMan<p>The Lawnmower Man is in your head now Jake. There's no escape...Ever.</p>
<p><a href="http://www.virtualworldlets.net/Resources/Hosted/Resource.php?Name=LawnmowerMan" rel="nofollow">http://www.virtualworldlets.net/Resources/Hosted/Resource.php?Name=LawnmowerMan</a></p>shaqq commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f2960a5b970b2010-07-27T06:23:48Z2010-07-27T06:23:48ZshaqqActually, I'm wrong... the technology is EEG rather than MRI, so the health risk might not be there.<p>Actually, I'm wrong... the technology is EEG rather than MRI, so the health risk might not be there.</p>shaqq commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485ba4b18970c2010-07-27T06:13:05Z2010-07-27T06:13:05Zshaqq2 RODION: I know a person who is working on an interface you describe. At this stage what you suggest...<p>2 RODION:</p>
<p>I know a person who is working on an interface you describe. At this stage what you suggest is impossible and there are also potential health risks involved. Measuring brain activity and trying to decipher the signal to understand whether the user wants to move the avatar left or rights is possible with some minor errors and quite some training required on the user side. Something simple like playing packman in this way can certainly be done... but something as complex as dancing and all other types of body movement... I don't think we are there yet.</p>
<p>I don't think there is any rock solid evidence in regards to the health risks when wearing the neurohelmet, but I would cetrainly refuse to wear one on the regular basis. As far as I know those helmets use a technique similar to MRI -the process that involves passing a strong magnetic field through the head. This can't be good for you.</p>Rodion Resistance commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485ba3939970c2010-07-27T05:55:08Z2010-07-27T05:55:08ZRodion Resistancehttp://www.avatrian.comI don't know if it's just me, but I find the idea of actually moving your own body to control...<p>I don't know if it's just me, but I find the idea of actually moving your own body to control you avatar a bit "primitive" compared to a method by which something akin to "neuroimpulses" would be used to control an avatar.</p>
<p>Back in the 80's, there was this B-movie called Robojox--it's basically like the mecha you see in Battletech or Mechwarrior, but the main difference was, the writers of the movie approached the idea of controlling the gigantic robot by "puppeteering" it inside the cockpit (i.e. the guy stands on this shiny, slippery metal plate, and he actually uses his shoe movements to move his robot/mech forward, kinda like Michael Jackson moonwalking, and his own hand/arm movements would also control the robots upper limb movements). The result was a somewhat of an awkward, silly, and possibly even fatiguing set of actions done by the mech pilot.</p>
<p>In contrast, the Battletech universe simply employed a "neurohelmet" system by which to control the robot/mech--i.e. impulses from the brain would control the lower and upper limb movements of the robot--a more elegant way IMHO to control a robot or an avatar (a method I believe which has already been documented in this very blog several months/years before).</p>
<p>-RODION</p>shaqq commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f2954aea970b2010-07-27T03:15:16Z2010-07-27T03:15:16ZshaqqSecond Life is completely open source now, so how can anything development related be a problem?<p>Second Life is completely open source now, so how can anything development related be a problem? </p>Adeon Writer commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f29544f0970b2010-07-27T03:10:25Z2010-07-27T03:10:25ZAdeon Writer1:1 Motion, live puppetry of an avatar with a full body suit would be one step closer to SnowCrash. :)<p>1:1 Motion, live puppetry of an avatar with a full body suit would be one step closer to SnowCrash. :)</p>Stroker Serpentine commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485b957ed970c2010-07-27T02:25:54Z2010-07-27T02:25:54ZStroker Serpentine@shaqq Please do not misconstrue my comments as contrarian.I was one of the most ardent supporters of "puppeteering' and the...<p>@shaqq</p>
<p>Please do not misconstrue my comments as contrarian.I was one of the most ardent supporters of "puppeteering' and the physical avatar when the intial development was spearheaded by Cube and Ventrella Linden. The source code was posted to svn and subsequently shelved. </p>
<p>To my knowlege there is no current plans by LL to incorporate the physical avatar source code into any public release client now or in the future. There may however be an OpenSim application or interest.</p>
<p>See:</p>
<p><a href="http://wiki.secondlife.com/w/index.php?title=Puppeteering&oldid=639823" rel="nofollow">http://wiki.secondlife.com/w/index.php?title=Puppeteering&oldid=639823</a></p>
<p><a href="http://avatarpuppeteering.com/" rel="nofollow">http://avatarpuppeteering.com/</a></p>
<p>If your research and/or progress indeed motivates LL to re-visit the technology I would be most impressed and supportive.</p>
<p>However,Given recent budget/staff cuts I am not very optimistic.</p>Stroker Serpentine commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485b93633970c2010-07-27T02:02:16Z2010-07-27T02:02:16ZStroker Serpentine@shaqq "At the moment it's just able to control the avatar walking direction," Bogdanovych allows, "but in the future we...<p>@shaqq</p>
<p>"At the moment it's just able to control the avatar walking direction," Bogdanovych allows, "but in the future we will enable full control of the avatar with the suit (e.g. every move of every part of the body of the person wearing the suit will be translated onto the avatar.)"</p>
<p>I believe this statement to be misleading somewhat. While one can certainly inferface with movement controls and UI manipulation, currently there is no real-time functionality within the SL client-server architecture that will allow for direct skeletal manipulation of the SL avatar.</p>
<p>Correct me if I am wrong. </p>shaqq commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485b8c8cc970c2010-07-27T01:10:47Z2010-07-27T01:10:47ZshaqqWell.. Just wait I guess and you'll see real time motion streaming happening pretty soon. It is certainly possible and...<p>Well.. Just wait I guess and you'll see real time motion streaming happening pretty soon. It is certainly possible and we know how to do it.</p>
<p>I agree that our suit is quite an expensive alternative right now. Its price will certainly drop in the future though. We're just lucky to have one of those in our lab and why would we use something else if this one is a top of the line equipment and very precise as well :) I was looking into Gyro before we ordered our MVN suit and the animation designer that consulted us said that Gyro is not a good option as a lot of postprocessing is required and the data is a little messy. With MVN suit, in contrary (if properly calibrated) we never had to do any postprocessing at all.</p>
<p>Moreover, the technology we're developing is not limited to this suit only. Any motion capture equipment can be connected to it. There are cheap alternatives already available on the market with 3D cameras and even with a number of simple cameras (like <a href="http://www.youtube.com/watch?v=dTisU4dibSc)." rel="nofollow">http://www.youtube.com/watch?v=dTisU4dibSc).</a></p>Adric Antfarm commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485b8ab41970c2010-07-27T00:52:56Z2010-07-27T00:52:56ZAdric Antfarmhttp://www.adric.usI concede I am lacking bumping ugly animation and compurgator knowledge, but I think it's pretty damn cool.<p>I concede I am lacking bumping ugly animation and compurgator knowledge, but I think it's pretty damn cool.</p>Ann Otoole InSL commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef013485b80ac7970c2010-07-26T23:34:40Z2010-07-26T23:34:40ZAnn Otoole InSLThe company that makes the logic controller for microsoft kinect is making a PC compatible version soon and it uses...<p>The company that makes the logic controller for microsoft kinect is making a PC compatible version soon and it uses an open API. Therefore it will be a matter of someone wanting to develop the client/plugin for this controller when it comes out. No mocap suits needed. Affordable to consumers.</p>
<p>I look forward to being able to construct assemblies with my hands. The education and training use cases for this are staggering.</p>Stroker Serpentine commented on 'In Development: Software for Integrating Motion Capture Suit With Second Life For Full Body Interactivity'tag:typepad.com,2003:6a00d8341bf74053ef0133f2938ff9970b2010-07-26T22:59:20Z2010-07-26T22:59:20ZStroker SerpentineWhile I applaud any interface extensions of the SL UI, I can tell you from first experience and considerable research...<p>While I applaud any interface extensions of the SL UI, I can tell you from first experience and considerable research and application, that a mocap suit is limited to ONLY avatar movement controls and/or AO/Guesture manipulation. BVH animations or any real-time streaming format are NOT progressively uploaded to SL (yet). </p>
<p>Basically, you could get more "bang from your buck" by using a Xbox controller and not a 30-60K mocap suit.</p>
<p>Until such time VW's incorporate real-time streaming of animation files (a la webcam, mocap, pupeteering) These appliances are simply expensive toys funded by education grants.I'm not complaining mind you, since we sell and support all sectors =D</p>
<p>There are inexpensive systems coming to the marketplace that will significantly lower pro-sumer entry price points.The Gypsy 7 for instance:</p>
<p><a href="http://www.animazoo.com/index.php/gypsy-7)" rel="nofollow">http://www.animazoo.com/index.php/gypsy-7)</a> </p>
<p>However, representing them as an "interface" is speculous at best.I am unaware of any SL/OpenSim client capability that will allow for direct joint manipulation of an avatar in real time. One could only specualte the resource/lag hit the server would take with such an open port.</p>
<p>A "tool" would be a more accurate description. Quite an expensive tool at that!</p>