New World Notes

Rosie's Rift Rips a Rift Into Reality

Rosie Summers recently wandered into a neighborhood park, and casually dropped this black hole into the grass.

"Soon as I saw its colossal size in an area of familiarity," she wryly notes, "the fear set in."

This rip of existence was made possible through several pieces of technology, and her own artistry:

Watch: Mesmerizing Procedural Art Sculpture by Michael Kozlowski

Mid-afternoon AR visual treat: Procedural artist Michael Kozlowski created this utterly hypnotic video sculpture in Unity with some kind of 3D projection display. I'm reaching out to hopefully know more.

Hat tip: William Gibson, who appropriately says just "Whoa" and AR expert Dr. Helen Papagiannis (last on NWN here), who properly pointed us to Kozlowski's Instagram to credit the creator.

Hit AR Game Company Niantic Partners With Hit Mixed Reality Sleep No More Play Producers

I have not seen many AR applications recently which struck me as exciting let alone likely to be financially successful, but a recent deal definitely caught my eye:

Pokémon Go creator Niantic Labs is partnering with Punchdrunk, the UK-based production company behind seminal immersive theater piece Sleep No More. The partnership will see both companies work toward “developing multiple projects that will reinvent storytelling for a 21st century audience and further expand the horizon of interactive entertainment.”

Sleep No More, launched in its current iteration in New York City back in 2011, is a landmark immersive theater production that lets audiences walk through a series of rooms and experience various storylines and other elements of the production at their own pace. Influenced in part by haunted houses and other nonlinear live productions, immersive theater sounds like a prime fit for augmented reality because it could allow for Niantic and companies like Punchdrunk to create fantastical virtual worlds that are then overlaid over real spaces.

I never got a chance to experience Sleep (trailer above) but the many colleagues who did consistently described it as a kind of virtual world layered on top the real one. So creatively, Punchdrunk makes a lot of sense as a partner. Interestingly, it's a partnership that might better financial sense for Niantic too:  

Watch: Awesome AR App Copies Real World Objects Then Pastes Them as 3D Files Directly Into Photoshop

4/10 - Cut & paste your surroundings to Photoshop

Code: https://t.co/cVddH3u3ik

Book: @HOLOmagazine
Garment: SS17 by @thekarentopacio
Type: Sainte Colombe by @MinetYoann @ProductionType
Technical Insights: ↓#ML #AR #AI #AIUX #Adobe #Photoshop pic.twitter.com/LkTBe0t0rF

— Cyril Diagne (@cyrildiagne) May 3, 2020

Cyril Diagne, an artist, designer and programmer currently in residency at Google Arts, created this utterly awesome augmented reality app which seamlessly captures objects in the real world... and then "pastes" them as 3D files directly into Photoshop. (Watch the video above, you'll immediately see what I mean.) I've seen similar AR apps before, but nothing quite as seamless or as magical.

Perhaps as amazing: Cyril also made the code publicly available on GitHub here.

"The code was given away because it's a research prototype," Cyril tells me. "I don't think it giving that code away necessarily take away commercial potential. There is much more that can be done with that approach."

His goal is to make AR reality capture as intuitive on a smartphone as it is in Magic Leap -- except without needing an expensive HMD.

"Also the phone has such a perfect form factor it's hard to beat," he adds. "[T]here is no UI, there's no need to move the thumb or care about how we're holding the phone, which happens to be quite pleasant and intuitive... Because we're able to delegate some of the cognitive tasks (like deciding which object is the one being pointed at in an image, selecting and removing the background, .etc) we can reduce the number of steps required to perform a task."

As for how he did it, he goes into great technical detail on Twitter, which I've excerpted for the technically minded below:

Magic Leap's Massive Layoffs Today Telegraphed by Tiny Headset Sales

It's the worst possible news to happen to the VR/AR industry right now, but also the most unsurprising:

Bloomberg reports that half of Magic Leap’s employees were laid off, roughly 1,000 in total. Magic Leap was in the process of exploring a sale, Bloomberg had also reported, one that could value the company at $10 billion. Magic Leap is one of the most well-capitalized consumer hardware startups ever, having raised more than $2.6 billion from investors, including Google, Alibaba and Saudi Arabia’s Public Investment Fund.

Citing COVID-19, CEO Rony Abovitz wrote in a blog post that the company needed to shift focus to enterprise applications of its technology. Early-on, Magic Leap had long emphasized that it was a consumer device company.

I've been expecting this shoe to drop since late last year, when I first heard insider whispers that Magic Leap was selling shockingly tiny numbers of its augmented reality headset -- something more or less confirmed by The Information last December:

VR Developer Trapped in Quarantine Maps His Real Life Home, Turns It Into a Treehouse Escape in VR

After being stuck in the same space for so long, I decided to try mapping it to a virtual treehouse for a more relaxing atmosphere. I think it would be great new feature if Oculus could make the home environments mapped to your real home pic.twitter.com/dL7XCOtXEe

— Emanuel Tomozei (@eman_insilico) April 4, 2020

Like most of us, developer Emanuel Tomozei has been largely trapped at home under quarantine these last few weeks. Unlike most of us, Tomozei is an AR/VR developer by specialty, and so was able to turn his home into a virtual world he could escape into:

"After being stuck in the same space for so long, I decided to try mapping it to a virtual treehouse for a more relaxing atmosphere," he explains on Twitter. (See above.) And so when he's wearing his Oculus Quest, he can still walk over to and sit in his couch -- it's just that instead of staring at the blank wall in front of him, in VR it looks as if his couch is on top of a tree house with a view of the lush forest below.

Creating a VR world that maps exactly to his real life apartment, as you might imagine, took some effort:

Best SuperData AR/VR Datapoints for 2019: Pokémon GO is the AR Market, Standalone VR Games Earned $171 Million Last Year

Game/XR analyst firm SuperData* recently released its 2019 year in review report, and was nice enough to give me a preview. I love when a single datapoint can tell you quite a lot about the larger ecosystem, and in this case, the report has (for me) two. First up, a telling one for AR:

Pokémon GO is 81% of the augmented reality game market -- which effectively means Pokémon GO is basically the entire AR game market.  

And one for VR:

Xiola Linden's Farewell Address to the Second Life Community: Be Open To Change, Be Informed, Be Welcoming

I told you last week that the tech worker formerly known as "Xiola Linden" recently left her role as Community Manager at Linden Lab to take a similar role with mixed reality startup Ubiquity 6. As she did, I asked her if she had any last message for the Second Life community she loves so much. I put it to Xiola this way:

If the SL community asked you the best way to improve itself and make it stronger, what would you suggest?

And this is what she told me -- her farewell address as a Linden, so to speak. 

"Be open to change, but never stop questioning it. Constructive criticism is always going to be received more enthusiastically than attacks. It is very easy to get emotional about something that means so much to us. I know, from my own experiences with Second Life, that it's sometimes difficult to keep calm and Second Life on -- but I also witnessed that sort of emotional response grow into a lot of misinformation and unnecessary panic. So, it's a balance. But it is important and key, I think."

The community should also strive to be more of a community in the best sense of the word, because there's still so much potential in Second Life:

Watch: Oculus Quest Demo Virtually Recreates Developer's Apartment at 1:1 Scale, Adds Interactive Surfaces

Unity Labs developer Greg Madison created this seriously impressive Oculus Quest demo in which he mapped out* his real life apartment with a virtual, 1:1 scale recreation of that apartment -- including the flat surfaces. That way, if you're wearing the Quest, any surface can instantly become an interface for games or other interactive apps:

Why Linden Lab's Beloved Community Manager Joined Mixed Reality Startup Ubiquity6

What you're looking at above is a demo of Display.Land, a mixed reality app from San Francisco-based startup Ubiquity 6, which just hired a new Community Lead: The tech worker formerly known "Xiola Linden", who was Linden Lab's much-loved Community Manager for many years. Just settling into her new office now, Xiola sees much possibility to create unique varieties of virtual social experiences with this technology:

 

"In my experiences with the communities I've had the opportunity to work with," as she puts it to me, "I've talked to a lot of creators who have explained to me the pain points of doing photogrammetry the old way. Seeing how the Displayland app can create a 3D representation of physical spaces and items with the use of a smartphone is so exciting to me.

 

"I think about the possibilities for social experiences within those spaces and I get a little giddy. When I saw the demo [above], I was struck by the idea that artists and professionals can revitalize their workflows with this app. When I got to play with the app, I started to think about what it could mean for creative and creator communities. You can already export your captures from Display.land as a 3D model and use them in compatible 3D software -- which is very exciting for creators of all levels.

 

"Now I am obsessed with the idea of capturing vignettes of my life and how amazing it will be to experience those memories in a three dimensional way... I've already seen some community people from SL checking it out -- which is such a delight to me. I'm really looking forward to so much to come!"

 

Speaking of which, she sees much overlap between the corporate culture of Linden Lab and this much younger startup: