« What Questions Should I Ask SL Content Creators in My Upcoming Report of the Virtual World's UGC Economy? | Main | Cajsa's SL Choices: Chameleon Cyberpunk Style Photos by Vi Takeda »

Wednesday, May 15, 2024


Feed You can follow this conversation by subscribing to the comment feed for this post.


Summarization is when you provide text to the model and it generates a summary. LLMs are actually useful for that and it's a common application.

What you asked for, instead, was memory retrieval. LLMs are not databases. They generate responses based on patterns they've learned during training, not by retrieving specific pieces of information from their training data (that is many times larger than the model parameters, so it cannot remember everything precisely anyway).

Expecting an LLM to output a specific text verbatim from its training data is like asking an obscure painting to an image generator and expecting it to output a perfect replica.
To expect anything like that, you need at least the hyper-parameter temperature set to zero (to make it more deterministic) and the text you look for repeated a multitude of times in the training data. The more times it is repeated in the dataset, the more is reinforced.

Then you asked for web search. The free tier of ChatGPT is getting GPT-4o and also internet search, but ChatGPT internet search a little rudimentary, compared to Copilot. Copilot set as "more Precise" ( https://postimg.cc/5Qj1fFjz ) finds and outputs your definition correctly: https://postimg.cc/qg7psWQ7


As a developer, I find GPT-4o to be a truly remarkable advancement in the field.
Neural networks allow what was once nearly impossible, such as NLP (Natural Language Processing), as well as interacting by using natural language (not just a limited set of sentences) and image recognition. You can see a humorous take on this by xkcd: https://xkcd.com/1425/

GPT-4o is not just another LLM. It's fully multi-modal.
It's also faster and more cost-effective to operate than both the original GPT-4 and GPT-4 Turbo (optimizations aside, perhaps it's also a smaller model). It's weaker in certain areas, but an improvement in others. However, the most significant part is the multi-modal capabilities. It can process and generate any combination of text, audio, and image inputs and outputs without delegating that to other neural networks (the full capabilities will be released in the next weeks).

Hence, it can do what it did in the demo, but it can do much more, see "Explorations of capabilities" here: https://openai.com/index/hello-gpt-4o/


The only people who use this garbage are programmers which is why programmers think it will take over the world. They think coding is the pinnacle of human achievement and that if this thing can code, it can clearly do everything else.

What they don't realize is that this thing is a spinning jenny for coding. It's already putting record numbers of programmers out of work. Coding is now a pretty much worthless skill. You're more likely to find a job in the 21st century if you know how to use a loom.


"This new oven may seem impressive, but it still can't store and keep my fish fresh! Plus, you could burn your fingers! Ovens are bad."
Yeah, but do you also consider what it's designed for? Baking, roasting, broiling...? There are so many different possibilities to cook and process your food.

Nope, once again only testing ovens as refrigerators to dismiss them. LOL!

On the one hand, there are folks already expecting magical ovens that provide them with free food. On the other hand, there are confidently incorrect haters who cling to their prejudices and insist on parroting the pervasive and misleading arguments.
The competent devs who patiently try to explain that it's neither of the cases, and provide information, papers and examples are systematically ignored or told they don't understand, their work is called garbage.

I can understand how doctors felt when they tried to explain the basics of the immune system to anti-vaxxers.

Verify your Comment

Previewing your Comment

This is only a preview. Your comment has not yet been posted.

Your comment could not be posted. Error type:
Your comment has been posted. Post another comment

The letters and numbers you entered did not match the image. Please try again.

As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

Having trouble reading this image? View an alternate.


Post a comment

Your Information

(Name is required. Email address will not be displayed with the comment.)

Making a Metaverse That Matters Wagner James Au ad
Please buy my book!
Thumb Wagner James Au Metaverse book
Wagner James "Hamlet" Au
Wagner James Au Patreon
Equimake 3D virtual world web real time creation
Bad-Unicorn SL builds holdables HUD
Dutchie Evergreen Slideshow 2024
AWE USA discount code
Juicybomb_EEP ad
My book on Goodreads!
Wagner James Au AAE Speakers Metaverse
Request me as a speaker!
Making of Second Life 20th anniversary Wagner James Au Thumb
PC for SL
Recommended PC for SL
Macbook Second Life
Recommended Mac for SL

Classic New World Notes stories:

Woman With Parkinson's Reports Significant Physical Recovery After Using Second Life - Academics Researching (2013)

We're Not Ready For An Era Where People Prefer Virtual Experiences To Real Ones -- But That Era Seems To Be Here (2012)

Sander's Villa: The Man Who Gave His Father A Second Life (2011)

What Rebecca Learned By Being A Second Life Man (2010)

Charles Bristol's Metaverse Blues: 87 Year Old Bluesman Becomes Avatar-Based Musician In Second Life (2009)

Linden Limit Libertarianism: Metaverse community management illustrates the problems with laissez faire governance (2008)

The Husband That Eshi Made: Metaverse artist, grieving for her dead husband, recreates him as an avatar (2008)

Labor Union Protesters Converge On IBM's Metaverse Campus: Leaders Claim Success, 1850 Total Attendees (Including Giant Banana & Talking Triangle) (2007)

All About My Avatar: The story behind amazing strange avatars (2007)

Fighting the Front: When fascists open an HQ in Second Life, chaos and exploding pigs ensue (2007)

Copying a Controversy: Copyright concerns come to the Metaverse via... the CopyBot! (2006)

The Penguin & the Zookeeper: Just another unlikely friendship formed in The Metaverse (2006)

"—And He Rezzed a Crooked House—": Mathematician makes a tesseract in the Metaverse — watch the videos! (2006)

Guarding Darfur: Virtual super heroes rally to protect a real world activist site (2006)

The Skin You're In: How virtual world avatar options expose real world racism (2006)

Making Love: When virtual sex gets real (2005)

Watching the Detectives: How to honeytrap a cheater in the Metaverse (2005)

The Freeform Identity of Eboni Khan: First-hand account of the Black user experience in virtual worlds (2005)

Man on Man and Woman on Woman: Just another gender-bending avatar love story, with a twist (2005)

The Nine Souls of Wilde Cunningham: A collective of severely disabled people share the same avatar (2004)

Falling for Eddie: Two shy artists divided by an ocean literally create a new life for each other (2004)

War of the Jessie Wall: Battle over virtual borders -- and real war in Iraq (2003)

Home for the Homeless: Creating a virtual mansion despite the most challenging circumstances (2003)

Newstex_Author_Badge-Color 240px
JuicyBomb_NWN5 SL blog
Ava Delaney SL Blog
my site ... ... ...