OpenAGI, or why we shouldn't trust Open AI to protect us from the Singularity

OpenAGI, or why we shouldn't trust Open AI to protect us from the Singularity

Open AI just dropped a pretty remarkable blog post on their roadmap for not destroying civilization with their imminent artificial general intelligence (AGI):

"As our systems get closer to AGI, we are becoming increasingly cautious with the creation and deployment of our models. Our decisions will require much more caution than society usually applies to new technologies, and more caution than many users would like."

Now, I'm around 98% sure that Open AI mostly answers the question: What if we allocated unlimited resources to building a better auto-complete? ChatGPT is an amazing tool but it's amazing at guessing which word (token) is likely to appear next. Quite possibly their blog post is just an exercise in anchoring - if they're 95% of the way to AGI then GPT4 must be pretty amazing and therefore worth a lot of money. If everyone realized that they're more like 2% of the way there, and the next 1% is going to be exponentially difficult, then some of the froth would blow off.

But what if they really are close to the singularity? After all, we have no idea what causes non-artificial intelligence.

Their ideas for keeping us safe are a little disturbing:

"We think public standards about when an AGI effort should stop a training run, decide a model is safe to release, or pull a model from production use are important."

Given the lack of transparency around the inner workings of ML models, and the lack of knowledge around what intelligence even looks like, this is a pretty risible idea. And:

"Finally, we think it’s important that major world governments have insight about training runs above a certain scale."

We are facing down the prospect of a second Trump term while the UK has a Prime Minister who thinks that a homeless person might be 'in business'.

The most concerning part for me is:

"...we hope for a global conversation about three key questions: how to govern these systems, how to fairly distribute the benefits they generate, and how to fairly share access."

Creating AGI would be an amazing and terrifying accomplishment. Treating it as a slave feels like the most surefire way to usher in the most terrifying possible consequences, for us and for the AGIs.

Full disclosure: I use Open AI embeddings for related posts and site search. The words on this blog are my own though. I do occasionally generate a post image using Stable Diffusion like the rather strange one above.

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: OpenAGI, or why we shouldn't trust Open AI to protect us from the Singularity #etc #openai #ml What OpenAI got wrong in their blog post on AGI and how we should treat AGIs if they ever arrive. )

Links for February 2023

Server Migration Complete

2022

ITHCWY just migrated to a new server with more capacity. From clouds to pollution to covid monitoring there is a lot going on under the hood here these days. I can already see that search is a lot more snappy.

Man, moving Windows servers just sucks. Internal GDI error - that's a permissions issue obviously (not my first time). Can't publish? You must need to install Web Deploy twice and then uninstall it and install it one more time for luck. Web.config error at startup? Of course Windows Server 2022 still doesn't come with URL Rewriting and you need to install it from some corner of the MS website like an animal. Yes, I should use something else but my custom CMS is probably reaching the same level of complexity as an F16 and I'm just one person. Enjoy the fast search!

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: Server Migration Complete #etc #ithcwy #microsoft ITCHWY has migrated to a beefer box and a new OS and still seems to be working. Oh, and search is faster! )

Echo Show Me The Door

Dogs, Ability to Poop, Echo Show

I have had my Echo Show for a little over five years. That's an eternity in AI, you'd expect some amazing advances over half a decade but it's still a timer with a screen.

A timer that you can talk to while your hands are busy or dirty is actually an amazing thing, and it can switch off my Christmas lights without me having to vault a sofa and risk losing an eye. But apparently Amazon isn't making any money from it and so they're laying off staff and paring back their smart home additions.

Possibly they've been working on the wrong thing? When asking about dogs Alexa managed to put them firmly in the camp of things that can poop. ChatGPT says:

"A dog is a mammal and a common household pet, known for its loyalty and ability to be trained. It is a member of the Canidae family, which also includes wolves, coyotes, and foxes, and it is believed to have been the first domesticated animal. Dogs come in a wide variety of shapes and sizes, and they are used for a variety of purposes, such as hunting, herding, protection, and companionship."

That's just a funny bug somewhere. The real irritation is the device getting more aggressive every year. "By the way..." it says while everyone shouts at it to shut the fuck up. Worse, every couple of weeks now they push something new to the home screen. I just want to see my photos and there is now a list of 75,000 adverts to switch off first. And, they've started dropping promotions that can't be switched off in settings as well. So this thing that I bought is so aggravating now that I'll never buy another one.

It could have been different. No, I'm never going to say Alexa, buy me a printer (if you're using text to speech on this post my deepest apologies). But (just one idea) what if I could have a meal planning conversation that adds the ingredients to my shopping basket and the recipes to my home screen? I can then edit the cart before I order and have the instructions on a convenient screen while I cook and listen to a podcast.

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: Echo Show Me The Door #etc #amazon #alexa #ai Why I'll never buy an Echo Show again, and what Amazon could have done differently to make Alexa with a screen useful. )

San Francisco 311 Cases Animation

San Francisco 311 Cases Animation

This animation shows a random sample of 311 cases that have a photo and specific location. It covers July 4, 2013 to January 5, 2023. Created using the 311 dataset plotted over a street map of San Francisco.

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: San Francisco 311 Cases Animation #etc #video #animation #sanfrancisco #311 Animation of a sample of San Francisco 311 cases from 2013 to 2023 (photo and location) )

Assassination Coordinates

Testing out some shapefile code with a zoom into San Francisco. This uses five different shapefiles:

Country borders are from Eric Muller's fips-10 shapefile.

States and US Counties come from the United States Census Bureau.

San Francisco 5 foot elevation contours from DataSF.

Finally the street map for San Francisco is from data.gov.

These are almost all based on different projections and I did my best to actually line everything up but if you're heading over for coffee it's probably best to stick with Google Maps.

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: Assassination Coordinates #etc #video #sanfrancisco #shapefile #animation Animation that zooms from a global map to the streets of San Francisco using five different shapefiles. )

ITHCWY Newsletter for December 2022

WallpaperColors

In November ITHCWY reached 1,000 posts. Here are 17 of the best.

What happens if you ask Stable Diffusion to generate a typical person from every country in the world?

WebCamSaver 3.30 is available to download. Also Android Fortune Cookies 1.30 and Catfood Earth 4.30.

Timelapse of a plane landing at SFO. Also some more Bangalore Sunsets. And one from SF.

Get rid of the unhelpful word robot.

Animation of 20 years of shifts in the US Presidential vote.

Does anyone know why San Francisco felt the need to redistrict the Pacific Ocean?

You can now follow both ITHCWY and me on Mastodon.

Previously:

Links for December 2022

Add your comment...

Related Posts

(All Etc Posts)

Stable Diffusion Global Stereotypes

Stable Diffusion Global Stereotypes

What does Stable Diffusion think a typical person looks like from each country?

This image is composed of 248 faces generated with the following prompt:

"photo of a typical person from Vietnam, highly symmetrical face, portrait photography, highly detailed Vietnam background, 4k, 35mm, sharp focus, amazing photo, portrait of the year"

Using seed 960604, 50 iterations, 7.5 scale, and just varying the country name in the prompt text.

There is no gender implied in the prompt but it certainly seems more likely to generate a woman. It seems to find something distinctive about most countries. The region that surprises me the most is Eastern Europe which ends up being very similar. Click the image above for a larger version.

Add your comment...

Related Posts

(All Etc Posts)

(Published to the Fediverse as: Stable Diffusion Global Stereotypes #etc #ml #stablediffusion A composite image of 248 faces generated by Stable Diffusion for each country in the world. )

ITHCWY on Mastodon

By Robert Ellison. Updated on Thursday, February 16, 2023.

A Mastodon in a primordial forest

Well I picked a bad year to dabble back in Twitter. I'm not ready to delete it all again, but I am experimenting with Mastodon. There is an official ITHCWY account here, this is fully automated via the Mastodon API and will publish posts, comments and news shares. It's currently posting its way through the back catalog.  I also have a personal account here. So far Mastodon is a pretty good experience. There is some stress in picking a server but once you're on everything else is easy. Will just have to see if there is a regression to the mean as the number of users continues to increase.

Add your comment...

Related Posts

(All Etc Posts)

Links for December 2022

By Robert Ellison. Updated on Saturday, December 31, 2022.