New World Notes

Watch: Modbox Sandbox Game Includes Mind-Bending "Mirror World" Mixed Reality Feature

This demo video makes my brain slightly melt:

This was created in the latest update to Modbox, a multiplayer sandbox game from Toronto developer Lee Vermeulen. This particular demo uses a ZedMini camera with an HTC-Vive set-up, and while it may seem like a massive leap to incorporate a mirror's reflection into an augmented reality experience, so that real objects seem to move back and forth into a "mirror world", Lee tells me it's available as a default feature for Modbox: "Literally no special programming /setup at all. I am hoping within the next 2 months the update will be out."

And yes, this is the same platform that makes The Abyss/Terminator 2-style fluid physics possible in VR. More about Modbox on the homepage and on its Steam page. The feature list is insanely robust and exciting:

Jesse Damiani's Mixed Reality Trends for 2019: AI, Location, Theater

Three big trends I’m excited to see emerging in the XR community in 2019:

1. Artificial Intelligence (AI)
2. Physical Installation
3. Immersive Theatre

👇

— Jesse Damiani (@JesseDamiani) January 30, 2019

This is an excellent Twitter thread on 2019 AR/VR/AI trends from mixed reality thought leader* Jesse Damiani. I agree with him that immersive theater and art installations incorporating VR will enjoy a fairly strong wave of interest, because art patrons tend to have greater patience for new/novel experiences, and are a smaller audience that's easier to on-ramp. (As anyone who's tried out a VR demo in a gallery, the set-up time is inevitably irksome and time consuming.)

I'm more skeptical VR/AR physical installations for a mass market will gain traction, notwithstanding the huge VR investment in Sandbox VR -- again, the basic friction of setting up thousands of people to experience VR a day will likely kill the novelty factor quick, especially for a price point of $20-40. (And once again, even in Los Angeles, name brand IMAX couldn't attract an audience to its VR experiences that was larger than the audience for a single small movie theater.)

Watch a Single 2D Image Become 3D Animation: Amazing University of Washington Project Sponsored by NSF, Intel, Facebook, Google & Huawei

Photo Wake-Up is a pretty impressive (if poorly named) project created by researchers at the University of Washington Reality Lab, with big gun sponsorship/assistance from the National Science Foundation, Intel, Facebook, Google and Huawei:

Given a single photo as input, we create a 3D animatable version of the subject, which can now walk towards the viewer. The 3D result can be experienced in augmented reality; in the result [in the video] the user has virtually hung the artwork with a HoloLens headset and can watch the character run out of the painting from different views.

More on the project (and academic paper) at this link. I'd be a bit more skeptical this process works as smoothly as it seems in the demo video, but the major corporate backing suggests we'll see a consumer-ready version of this relatively soon.

Top 12 AR, VR & Avatar-Based AI Projects & Innovations of 2018 Featured in New World Notes

Watch An AI-Controlled Avatar "Learn" How To Dribble In Real Time - Huge Implications For Games, AR/VR, And Real Life Robotics

• HoleLenz Turns HoloLens Into A Literal (Virtual) Portal Into Other Worlds
• We Heard You Like AR & VR, So We Put AR In Your VR
• Project H.E.A.R.T: A Virtual Reality War Game Where Soldier Morale Is Controlled By The Player’s Real Emotions
• VR Pioneer Helping Advise $10 Million ANA Avatar XPRIZE, The Contest To Merge Robotics With VR/AR-Driven Human Expertise

IOS' ARKit Enables Reflection Of Real Objects On Virtual Surfaces

Many more beyond the break!

Instagram Game by an Augmented Reality Expert: Guess If an Image Posted to Her Stories is Real or AR UPDATE: Answer Revealed!

Here's a fun, weekly mini-game on the Instagram of Dr. Helen Papagiannis, an influential author and speaker on the topic of Augmented Reality. As suggested by the screengrab here, you have to guess whether the image posted every week to her Stories is a real photo or an Augmented Reality screenshot. After 24 hours, she reveals which category it actually is; good chance you'll guess wrong.

"My game Real or AR was inspired by just how good Augmented Reality is getting and the double takes I found myself making, as well as the influence AR and the digital was having on the real physical world," she tells me. "The game became a way to share my research and love for AR — as well as art — with a larger audience in a fun game. It’s been awesome to watch the game grow and to play it with people around the globe both on Instagram and on stage in my keynotes."

As with the real or virtual human web quiz I posted awhile back, aggregate answers to previous Real or AR games from Dr. Papagiannis have been wildly off base. 77% of people guessed that this image was AR (but it's real), and while many thought this image of a mesh building was AR, it's made out of actual wire mesh.

I'll update this post when Helen reveals this photo's ontological substrate! I'm personally guessing Real, but a high tech Evil Deceiver may be flimflamming me.

Update, 12/19: Answer is now available below - it may surprise you!

With Slow Sales, VR Headset Market Still Not Having Meaningful "Rebound"

IDC, an analyst firm which was once so bullish about virtual reality, the company predicted (as recently as 2016) that VR headset adoption rates would be as fast the iPhone -- yes, seriously -- is now touting a "rebound" of sales:

The VR headset market returned to growth in 3Q18 after four consecutive quarters of decline and now makes up 97% of the combined [AR/VR] market. Global shipments for VR headsets reached 1.9 million units in the quarter, up 8.2% from 3Q17, as extensive discounts on existing products and interest in new ones led to shipment gains in both the consumer and commercial markets. "The VR market is finally starting to come into its own," said Jitesh Ubrani senior research analyst for IDC Mobile Device Trackers. "On the consumer front, the combination of lower prices and increased content is beginning to resonate with users. Meanwhile, commercial adoption is also on the rise for a range of use cases, including training, design, and showcasing."

If there's commercial adoption, why are there so few palpable VR hits besides Beat Saber (still a modest hit at best, in terms of the overall market) while even the once-viral VRChat has seen a usage decline? But the real problem with this analysis is that "shipments " are not the same as sales or usage  -- and more key, 8.2% growth in shipments isn't much of a "rebound" when you compare the growth to other competing platforms. For instance:

Watch: Augmented Reality App Created for Virtual Reality Headset

Last week we were speculating on Philip Rosedale's comment that VR is preferable to AR, since after all, you can use the video camera capabilities of many virtual reality headsets to create an augmented reality experience within VR. And then a guy named TonyVT Skarredghost came by to comment that he'd done exactly that: 

I already do AR with the Focus. (At the link you can also find an opensource plugin for that that I made for Unity) and also mixed reality.  And I can guarantee you that is pretty awesome. And it has the potential of showing a modified view of the world... so not only virtual objects added to the world.

Read about it on his blog post cleverly entitled, "How to create an Augmented Reality app for the Vive Focus in Unity". Tony gets pretty deep into the technical weeds of making AR possible on a VR platform. For instance, it involves hacking the Vive Focus' camera streams:

Philip Rosedale: Why Virtual Reality Offers a Better Consumer Experience Over AR Devices Like HoloLens & Magic Leap

Interesting NWN comment from Second Life/High Fidelity founder Philip Rosedale, responding to Magic Leap's just announced, no frillys avatar chat app:

It seems possible that VR headsets like the Quest or Focus, with pass-through video capabilities and wide field of view at a consumer price point ($400) will provide a better experience than can be delivered with AR. You can't see a person's eyes when they are wearing the HoloLens or Magic Leap, so why not just wear a VR headset?

If I'm reading this right, Phillip is arguing that you can use the Quest and Focus' video capabilities to create augmented reality-type experiences within VR. (Whereas you wouldn't be able to do virtual reality-type experiences from within most augmented reality HMDs.) Which is a very valid point. I'm also intrigued by his acknowledgement that lack of eye contact is a problem for both AR and VR:

Magic Leap Launches Avatar Chat With AR Chatroom & Media Sharing, Cartoonish, Low-Detail Avatars

Continuing in its now familiar "Where's the fricking whale we were promised?" theme, Magic Leap just announced Avatar Chat with media and browser sharing features in (what looks to be) a small, augmented reality chatroom setting. If you were hoping to see vivid recreations of your friends as full featured 3D avatars displayed right in front of you, seeming to be sitting on your couch or resting against a wall or whatever, this is not for you: The avatars are extremely low-detailed, disembodied heads.

In fairness, the limited graphics seems to be by design -- probably because this is meant to be a light application for content sharing. Still, the lack of "Wow" factor continues to be a frustration for Magic Leap:

Watch: Dazzling Demo of Fluid Physics in Augmented Reality

Remember those great scenes in James Cameron's The Abyss where water seems to float in the air and change to the character's touch? Developer Lee Vermeulen has basically done that in augmented reality with fluid physics -- watch above. He's using a ZedMini with an HTC-Vive set-up. This feature is for a platform he's building for Modbox, his ambitious AR development platform: