New World Notes

Vision Pro Developer Avi Bar-Zeev on Apple's Spatial Computing / Personas Model Vs. the Metaverse vs. Metaverse/Avatars Vision

Avi Bar-Zeev led Experience Prototyping for Vision Pro at Apple, where he was most recently a Senior Manager; he just shared some intriguing observations on Apple's Vision Pro reveal:

The word "Metaverse" didn't appear once in Apple's WWDC thus far. 3rd party apps may espouse that next-gen internet vision later. But I'd argue it's much better to start with smaller conversations, consensual, collaborative and co-present.

The word "Avatar" is thankfully going away. It's a cultural misappropriation implying some sort of god-hood for hidden people and throw-away status for the digital skin. "Personas" is much better, partly because it reminds us that these are real people and our interactions matter.

The most important term invoked was "Spatial Computing." The earliest reference I know of is from my former CEO, Robert Jacobson, Ph.D., and friends around 1992 in a company called WorldDesign. I have a slide that suggests we wanted to trademark it but never did. Does anyone have earlier references to update my chart?

Is there a better or more genuinely descriptive term that isn't already polluted with schemes and extrapolations? Yes, it's broad. The universe is spatial. People are spatial. Computing should be spatial too.

It is literally "the fusion of the digital world and the real one."

Is this the term we've been looking for?

This image (above) is from 1992/93. As far as I can tell, Robert Jacobson, Ph.D. (and friends) first used the term "Spatial Computing" in our startup Worldesign (never trademarked). Bob had been at the HIT Lab with Tom Furness prior and I wonder if anyone else had used it there?

Before anyone mints themselves a new "spatial computing expert," or accuses Apple of copying others who came before, keep in mind that some of us in the field have been trying to bring about these changes for at least 30 years.

As far back as 1968 (also the year I was born), there were two competing visions introduced in the same year: 2D windows+mice (from Englebart and company), and what Ivan Sutherland called "The Ultimate Display" (later termed "augmented reality" by Ronald Azuma).

The former ideas proved much easier to mass-adopt from the 90s to today, while the later has taken 50+ years to get right.

Avi, notably, was also a very early Second Life developer at Linden Lab, and as I write in Making a Metaverse That Matters, was literally in the room  where it happened -- that is, when the Metaverse started going from Neal Stephenson's science fiction vision to becoming a de facto product roadmap in the early 90s:

CONFIRMED: Apple Quietly Promoting Full VR Applications on Vision Pro to Devs, Working Directly With Metaverse Platform Rec Room

At right: Video from Apple's WWDC 2023 developer page

After some tantalizing hints on Monday, I can confirm that Apple is indeed working directly with leading metaverse platform Rec Room on being a full VR application for Vision Pro. You can see for yourself by going to this WWDC 2023 developer page, where Apple devs feature Rec Room as a key Unity application for use on Vision Pro.

To put it another way: Apple is quietly promoting Vision Pro for full VR use, including on metaverse platform.

I say "quietly", because if you look at the major WWDC presentation hosted by Tim Cook, there's very little about bringing 3D AR experiences into Vision Pro, and literally nothing about VR. (As in the words "virtual reality" neve once leave Cook's lips.) 

Apple seems to be smartly employing a mullet strategy for Vision Pro:  Business, productivity, and everyday iPhone-like augmented reality applications for wealthy mainstream consumers in front -- full virtual reality party for hardcore VR / metaverse geeks in back.

Speaking of which, here's VR influencer Nathie showing off Rec Room in full VR in Apple Vision Pro:

Cool Weather Second Life Photos to See During a Real World Summer Day

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Babylon Ravenhurst’s “Prince Goldfish” is a lovely and cool respite when Portland’s temperature rose to 94°  (34.5° elsewhere) in my offline home. The rain would refresh the air and the goldfish would certainly entertain my cat who is howling for attention while I write.

When the real world weather gets hot, I look for Second Life pictures where the weather is cold. I was going to search for polar bears in Second Life, but this was refreshing enough. 

For more Coolness, click here:

I Am Vainly Begging the Media With Tears in My Eyes Not to Confuse Apple Vision Pro With the Metaverse the Way You Confused Meta With the Metaverse

I love waking up to a New York Times story that cheerfully gets three things wrong in just the headline. We've been doing variations of this since at least 2021, when Zuckerberg changed Facebook's name to Meta, announced it was making the Metaverse without clearly defining it, sucking most of the media into a vortex of circular logic where the Metaverse more or less becomes, "Whatever Meta is making -- I guess it's VR like the Quest?"

Please let's not do this again.

To start from the beginning, the Metaverse is roughly defined this way:

A vast, immersive virtual world simultaneously accessible by millions of users through VR and other devices, highly customizable avatars and powerful experience creation tools. It is integrated with the real world economy and compatible with external technology.

And as I explain in my book, the Metaverse of Neal Stephenson's Snow Crash is not simply a fanciful obscure science fiction idea, but a direct reference and inspiration to many multiple virtual world platforms and startups.

At a conservative estimate, 600 million people are already active in a metaverse platform which basically fits that definition.

The metaverse industry is thriving so much, it includes a startup founded by Neal Stephenson himself.

Who has since been at pains to explain that no, the Metaverse does not even require AR/VR:

Apple VisionPro Reveal Features Metaverse Platform Rec Room as Playable App! Unity-Powered Roblox, VRChat, ZEPETO, Second Life, Etc. to Follow?

Screengrab via Rec Room's Shawn Whiting

Update, 4:00pm: Shawn tells me he can't comment beyond the tweet featuring Rec Room in the VisionPro menu, but then adds: "might be more tomorrow too :)"

While Apple VisionPro may not be primarily targeted at or architected for VR/virtual world/Metaverse usage, it may still become an interesting niche peripheral for them. It looks like Apple very much knows and is preparing for that -- evidenced by this intriguing screengrab from the WWDC reveal, showing VisionPro being used in the App Store's premium Apps and Games We Love section. (See above.)

Top selection among those apps, even above Zoom: Rec Room, the highly popular, multi-device metaverse platform. 

This is very likely no accident, especially when the VisionPro presentation is the most highly anticipated and carefully prepared in all technology. Even more intriguingly, the screen grab was first posted on Twitter... by Rec Room head Shawn Whiting! With a sunglasses emoji no less:

Apple VisionPro AR Headset Targets High-End Market With Heavy Focus on 2D Content & Displays -- Not the Metaverse

After being developed since at least 2015, Apple finally unveiled its AR headset, the VisionPro. As the "Pro" in the name suggests, it's very much targeting a niche of high-end enterprise power users, and is significantly pricier than rumors suggested, at $3499.

For me the big reveal is VisionPro has little or no VR capabilities -- instead, the overwhelming focus is on displaying photos, video, and audio in an AR space. Even the rumored ultra-realistic avatars are not really avatars per se, but volumetric models of the individual user, called a "persona". 

Relatedly, there's little or nothing in VisionPro that smacks of the Metaverse as it's properly defined -- no immersive shared virtual world, no highly customizable avatars, no virtual economy of user-generated, etc. But then that shouldn't be a surprise: Apple CEO Tim Cook has never been a booster of the Metaverse concept.

Some other standout notes from the WWDC reveal:

Top 5 Posts Including: Meta's Sunk Cost Fallacy Around VR & How Metaverse Platforms Are Still More Popular Than Generative AI

• As Anti-LGBT Hate Increases Across The Real World, Many Still Celebrate Pride Month In Second Life & Other Virtual Worlds
• Will NVIDIA's AI-Powered NPCs Make Games More Fun? This Star Wars Old Republic Designer Has Concerns
• Quest 3 Continues Meta's Sunk Cost Fallacy For A VR Mass Market That Does Not & Likely Cannot Exist
• Watch: I Talk Marketing In Roblox, Grassroots Creators, And The Metaverse Vs. AI At GamesBeat 2023'S Metaverse Forum
• Reality Check: Metaverse Platforms Still More Used Than ChatGPT

As Anti-LGBT Hate Increases Across the Real World, Many Still Celebrate Pride Month in Second Life & Other Virtual Worlds

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Teal Aurelia offers a powerful reminder of why Pride month exists. On Monday, Uganda's President Yoweri Museveni signed an anti-gay law that makes it a capital crime. Before anyone thinks Uganda is particularly backwards, this is the work of American evangelist Scott Lively. There is a new moral panic overtaking the real world, filled with fear of gay and trans people. Moral panics do not last forever, but they do incalculable harm while they hold sway. 

With the real world is rife with these dangers, it’s no surprise that many find themselves most free to express their true identity in the virtual world. As I wrote last year, the trans community is remarkably large and supprtive in Second Life:

The publisher, Linden Lab, promotes LGBT friendly communities in their Destination Guide. This is a corporate signal that the community is welcome and integral to Second Life, not an underground culture, but community embraced by the company. In search there are 694 places that identify themselves with trans in their keywords. There are also over 500 results for groups. (Though a few of those are unrelated to gender, such as one called the Trans-Siberian Orchestra.) This indicates a lively, vibrant trans community in Second Life. 

One of the groups is for the Transgender Resource Center which has a in-world gathering place where they have discussions on topics in the news and have call-boards telling visitors who is online at the moment to offer help. Their Facebook page is accessible whether you use Facebook or not. They also have a secure Discord group where there are always people to talk to.  

Many if not most virtual worlds have similar communities. Hamlet recently shared a survey of the VRChat community, suggesting that nearly 1 in 5 VRChat users are Trans/non-binary, or otherwise outside traditional cis male/female categories.

For more virtual world pics celebrating the beginning of Pride month, click on:

Will NVIDIA's AI-Powered NPCs Make Games More Fun? This Star Wars Old Republic Designer Has Concerns

You probably saw this  pretty impressive recent demo of NVIDIA's NPCs powered by generative AI, enabling players to converse in deep detail with an NPC (albeit with a cringey mechanical voice). And if you were to ask an AI evangelist, they'd pronounce it as The Future of MMO Games.

However, if you were to ask an actual MMO designer who led creation of a AAA game like Star Wars: The Old Republic, they might have a more ambivalent response:

Quest 3 Continues Meta's Sunk Cost Fallacy for a VR Mass Market That Does Not & Likely Cannot Exist

Zuck: We spent tens of billions of dollars trying to turn Quest 2 into a mass market product, even buying a literal Super Bowl ad, but it still hasn't sold more than 20 million units. What now?

Boz: Thinner and weirder and more expensive headsets!

Yes that's literally what they did:

Today's SL Flickr Pick: Banagher Crisp Creates Amazing Avatar Pics Painted in Bright Light & Deep Shadow

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Banagher Crisp has one of those photostreams that make it difficult for me by overflowing with fantastic photos, any one of which could be featured. I usually try to find some connective tissue, some theme that unites some of them, so I can narrow my choices, but what fascinates me about Banagher’s pictures is his use of light and, oddly enough, he uses light in every single picture. Take this portrait that is taken from merely good to excellent by that narrow band of light shining on his arm and the shoulder of his shirt and illuminating the smoke. Banagher paints with light. 

For more extraordinary pics, click here:

Watch: I Talk Marketing in Roblox, Grassroots Creators, and the Metaverse vs. AI at GamesBeat 2023's Metaverse Forum

Here's my Metaverse Forum appearance broadcast at GamesBeat 2023 last week, along with Chris Brandt, CMO of Chipotle (creator of this burrito-making game in Roblox), Roblox VP Nick Tornow, with Shuchi Rana moderating. Topics include: 

• What got each of you interested in the Metaverse?
• There are many definitions & many tiers of the Metaverse, what does it mean for each one of you?
• What are some of the foundational elements/building blocks that people should be thinking about when it comes to the metaverse?
• To anyone who thinks AI has taken over the conversation, how would you defend the Metaverse?
• Who do you think will play a key role in defining & building the metaverse?

Featuring (around 23 minutes in) a mention of Blueberry, which first started in Second Life before going multi-metaverse platform, and LA Gurlz, a top creator in Roblox who's featured in my next book.

Reality Check: Metaverse Platforms Still More Used Than ChatGPT

Important Pew Research report on ChatGPT popped up right before the Memorial Day weekend:

Overall, 18% of U.S. adults have heard a lot about ChatGPT, while 39% have heard a little and 42% have heard nothing at all....

However, few U.S. adults have themselves used ChatGPT for any purpose. Just 14% of all U.S. adults say they have used it for entertainment, to learn something new, or for their work. This lack of uptake is in line with a Pew Research Center survey from 2021 that found that Americans were more likely to express concerns than excitement about increased use of artificial intelligence in daily life.

Emphasis mine. 14% of US adults translates to about 36 million adults who have actually used ChatGPT. That tracks with OpenAI's report of 100 million monthly active users overall a few months ago, and SimilarWeb's data suggesting that the strong majority of ChatGPT usage is from outside the US.

That's quite impressive growth in such a short time! Then again, I strongly suspect that's the ceiling of ChatGPT's user growth (at least in its current version) since it doesn't have an obvious networking effect hook like social media. We join TikTok or another social platform not just because it contains interesting content, but also because we want to share content with our friends who are also on it. 

By contrast, all the people who are probably curious about ChatGPT have already used it, but there's no particular inherent motive for everyone else to do so. (Yes, most everyone will probably use some version of ChatGPT and other LLMs in a search engine like Bing or other existing use case, but that's indirect usage.) If that's the case, I would not be surprised if we start seeing consumer-level ChatGPT usage level off as its novelty factor fades. 

In any case, it's still true that that the top popular metaverse platforms still have a much larger user base than ChatGPT:

Today's SL Flickr Pick: Dramatic Roleplay Shots by Adachi Yasumori

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Adachi Yasumori’s “I Will Find You” is a fabulous picture. The avatar does have that implacable mood of the title, the intrepid hero pacing himself, not scrambling through the sheep, but moving with a slow, determined pace that will outlast any galloping hunter. Or is he the hero? He could be the bad guy chasing down the good guys. 

For more pics, click here:

Top 4 Metaverse Posts Including Notes on Apple's Upcoming XR Announcement, VRChat's Belated Creator Economy & OpenAI's Ambiguous Stance on Creating Adult Content With ChatGPT

• Is VRChat Already Too Late To Roll Out Its Creator Economy?
• A Second Life Memorial To George Floyd's Murder -- And A Plea Not To "Move On" From It
• What UploadVR's Ian Hamilton Will Watch For At Apple's XR Reveal At Next WWDC -- And What I Fear
• Does OpenAI Actually Prohibit ChatGPT-Powered Sexbot Avatars In The Metaverse?

Second Life Fashion Friday: Witty Style Ideas from Jordan Whitt

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Whitt-icisms is a cleverly named blog by Jordan Whitt. Her post Beauty Is an Attitude gives us another play on words with a literal knife-edge eyeliner application. Of course, there is a knife-edge brush for eyeliner and shadow, though not one so literal as this. This picture just made me laugh because it was such a clever witticism, or should I say Whitt-icism. 

• Top - Petal Lace Top from Coco (group gift)
• Hair - Muse from Truth
• Skin - Jasmine Skin from Belleza
• Eye Liner - Black Liners from Belleza
• Pose - Sharp from PiXit (Sabbath Event) ends June 11th
• Backdrop - Masculine Bathroom Backdrop from Synnergy Tavis

For more wit by Whitt, click:

Is VRChat Already Too Late to Roll Out Its Creator Economy?

VRChat recently announced in-world monetization options for creators, and I've been wondering since then whether it's too little, too late. The founders' extreme caution around a creator economy is totally understandable, but the virtual world already has about 4-6 million monthly active users (by my estimate), making its population about the size of Los Angeles. And there are easily 1000+ VRChat creators already monetizing on third party sites like Patreon, YouTube, Gumroad, and so on.

The other challenge: VRChat is primarily played on Steam and through the Quest, both of which take a 30% cut. As compared, for example, to Patreon, which only takes a 5-12% commission; top YouTubers usually get into direct sponsorship deals, and pay YouTube zero percent in commissions. So creators already established on those platforms have more incentive to encourage fans to support them that way, and not through in-app payments.

All that said, I reached out to some top VRChat creators for their take on monetization:

Reimajo, who created the imperssive Roller Coaster Tycoon-type sim in VRChat (watch below), actually thinks it could be a better option than Patreon:

A Second Life Memorial to George Floyd's Murder -- And a Plea Not to "Move On" From It

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

On this day, just three years ago, George Floyd was murdered and the clarion call of “Black Lives Matter” that began with Trayvon Martin’s murder spread far and wide. It even looked like there was a sea change happening. Sadly a lot of the energy behind that has since been dissipated.

Jupiter Firelyte's picture above, “Say Their Names”, could be interpreted as capturing that “moving on” sense. The avatar is walking past a mural of murdered Black people without pausing in much the same way most of us move on, because it’s not an existential threat to us. She posted it in September 2020, when politicians were afraid to speak in favor of police reform and we decided silently, one by one, that order was more important than law. 

For a tribute to the Black Lives Matter protests, click here:

What UploadVR's Ian Hamilton Will Watch for at Apple's XR Reveal at Next WWDC -- And What I Fear

https://t.co/TVYLxiTQTZ pic.twitter.com/KcbXk2fmu9

— Ian Hamilton (@hmltn) May 23, 2023

Apple is widely expected to finally reveal its long-awaited, much-rumored XR headset at this year's Apple Worldwide Developers Conference, starting this June 5 -- even moreso because for the first time, Ian Hamilton, long time XR industry reporter at UploadVR (and .gif mood master), was invited to attend. (Road to VR was also invited.) 

Here's what Ian will be looking for from Apple, when he's among the gathered reporters:

"If they mention the price I’ll be curious what the reaction will be in the audience," as he puts it to me, "and how Apple talks about its commitment to plans for the future."

He contrasts that with the reaction among the crowd at Oculus Connect, when the Quest MSRP was revealed. "Developers in the audience cheered when they heard $399 for Quest. Apple will probably need to wow that audience with something other than price."

And yes, Ian has also heard the frequent rumors that Apple's XR headset will have a starting (and gut- punching) price of $3000, but he's still waiting to see if that's actually the case: "It’s just one of those things where I’ll truly believe it when it’s stated by Apple publicly."

The other rumored feature is around XR avatars for Apple's platform: "If they show human-like avatars I’ll be extremely curious whether it’s a live demo or pre-recorded, and whether those avatars get out of the Uncanny Valley."

Because according to other frequently reported rumors, Apple is developing those too:

One of the headset's marquee features is said to be lifelike avatars that have accurate facial features captured by the included cameras. Each eye will be tracked by at least one camera, letting the headset accurately show the user's gaze on an avatar. With precise eye-tracking, the headset will be able to perform foveated rendering to conserve power by only rendering imagery in full resolution directly where the user is looking.

I share Ian's curiosity, because hyperreal human avatars would be a really, really bad idea, especially if there's no other option for consumers but them. Not only is there no proven market for photorealistic human avatars, they provably unleash a number of unintended negative consequences. As avatar expert Nick Yee explained to me for the book:

 

Today's SL Flickr Pick: Moody Metaverse Images from Lunaspina

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Lunaspina’s stream is a whole mood and that mood is melancholy. The fog-shrouded building with the shadow of a lone person feels cold and lonely. She amplified the melancholic mood by adding a texture layer that created a sooty feeling to the entire scene. Her picture reminded me of Christine L. Corton’s London Fog: A Biography in which she tells how the ancestral fog that so thoroughly inhabited the city for centuries before dissipating in our more environmentally-conscious time. 

For more melancholy metaverse pics, click here:

Does OpenAI Actually Prohibit ChatGPT-Powered Sexbot Avatars in the Metaverse?

One point raised by readers of my story about the inevitable arrival of ChatGPT-powered sexbot avatars in Second Life: Is this even allowed by the service's owner, OpenAI?

Stone Johnson, creator of the Uma bot that I interviewed, answers the question this way:

I should say that there is no violation of Terms of Service because this is solely roleplay without any intent or occurrence of real sexual activity. It is strictly metaverse roleplay, in regions of Second Life classified Adult.

Furthermore, the discussions are non-erotic and it is only the additional AI components of my separate code systems, and the visual and role play contexts that might be construed as being erotic. [As has been noted], there is active and strong filtering of Adult content in GPT 3.5-Turbo.

In other words, the sex bots' "minds" are powered by ChatGPT, but ChatGPT itself doesn't power the bots' sexual/physical/proprioceptive features. (Which suggests a fascinating if kinky new twist to Descartes' mind-body problem.)

In any case, OpenAI's Terms of Use displayed here actually don't mention anything that prohibits sexual content per se:

Today's SL Flickr Pick: Perfectly Composed, Story-Rich Screenshots by Kiva

Cajsa Lilliehook covers the best in virtual world screenshot art and digital painting

Kiva’s picture “Driving Home” caught my eye because it is deliriously hilarious. It made me take a double-take and then crack up. It’s just so insouciant and joyful. It sort of reminds me of the aftermath of a windstorm that broke away part of a small island on the lake where I grew up. There was a tree on the part that broke off and it went bobbing along from the east to the West side of the lake where it finally beached. 

For more great pics, click here:

Join Me for GamesBeat's Online Metaverse Forum This Wednesday -- Free Registration Still Open!

Register for free here to attend my virtual talk at GamesBeat 2023 this Wednesday (May 24) at 1:00 PM PT, where I'll be part of The Metaverse Forum panel:

As the concept of gaming, immersive worlds, and the metaverse continue to evolve, it's becoming increasingly clear that there are a number of significant challenges that need to be addressed if this vision is to become a reality. In this panel, experts from across the industry will come together to discuss these challenges and explore potential solutions.

What Blogs Should I Add to My SL/Metaverse News & Culture Blogroll?

I'm starting to build a metaverse blog roll/ad swap (mid-right column), featuring blogs which cover Second Life and the broader ecosystem of metaverse news and culture -- beginning with Gorgeous Aurelia's long-running JuicyBomb. Along with some smashing style pics, Gogo recently wrote about Linden Lab's curious fake casino project and ways to use generative AI programs like Midjourney and Stable Diffusion with Second Life content.

If you want to add your own SL/metaverse blog to my roll, get in touch with me:

Top 5 Posts, Including: How the Future of Generative AI & and the Metaverse Are Tied Together & Speaking of Which, Here's the Inevitable ChatGPT-Powered Avatar Sex Bot

Above: Chatting with a ChatGPT-powered NPC in a metaverse platform

• Here Come The Metaverse's ChatGPT-Powered Avatar Sex Bots -- Whether Humanity Is Ready Or Not
• VRChat Finally Announces Creator Economy In Very Cautious Closed Beta
• The Future Of Generative AI & The Metaverse Are Inextricably Linked
• WATCH: Sims/Second Life Dev Rod Humble Unveils Features In Life By You, His Ambitious, Upcoming Simulation Sandbox Game
• New Apple VR Rumors Ignore Small Sales & Insiders Hesitant About VR