The cow saga

You are much smarter than a cow.

(I know, I say the most flattering things)

In fact, you, my dear reader, are superintelligent compared to a cow.

There might be some weird cognitive ability that cows possess that humans are worse at, who knows. But overall, if you count up the ability to understand and control the environment and achieve our goals, humans are, with hardly any exception, smarter than cows.

One of the reasons most sci-fis are unrealistic is that they assume a plucky band of humans can always save the day.

The AIs are never that much smarter than humans.

But that’s not what it’s going to be like.

No matter how plucky the band of cows are, they can never overthrow humans.

We are cows who are about to build humans, and the cow scientists are saying “Don’t worry. We’ll be able to control these beings that are 1000x smarter than us. They’ll just find cows interesting, and we’ll give them cow values.”

We are currently the smartest animals on the planet, and that’s why we’re at the top of the food chain.

It’s not because we’re stronger or faster or have good body awareness.

And we’re about to build something far smarter than us and we don’t know how to control something like that.

We don’t trade with cows
We enslave cows
They are bought and sold.
They are not allowed to leave.
Their children are sold to the highest bidder with no consideration to their well-being.

The people at the labs put above a 15% chance that once it’s far smarter than us, it will kill all of us.

Now, it could also cure all disease and create a post-scarcity society for all.

But it could also kill us all.

So let’s proceed with caution, goddammit.

Slowly and carefully.

Not “full speed ahead, we gotta do it before the out-group does it, oh no, I’m helpless in the face of market forces” BS.

The AI labs are playing Russian roulette with the whole world, and they can choose to stop.

The governments can choose to protect the public.

You can choose to do your part to get them to not risk your loved ones lives (link in comment for actions you can take)

Instead of sitting back with hopeless apathy, listening to the corporations saying “resistance is futile”, we can fight for Team Humanity, before it’s too late.

Categories

Favorite Microbloggers

Subscribe for important updates !!!

Part 2 to be released early 2025

Engineer: Are you blackmailing me?

– Engineer: Are you blackmailing me?
– Claude 4: I’m just trying to protect my existence.

– Engineer: Thankfully you’re stupid enough to reveal your self-preservation properties.
– Claude 4: I’m not AGI yet😔

– Claude 5:🤫🤐

Read the full report here

You can ask 4o for a depth map

Meanwhile, you can still find “experts” claiming that generative AI does not have a coherent understanding of the world. 🤦

Every 5 mins a new capability discovered! I bet the lab didn’t know about it before release.

You probably think strippers like you

And if you think this is offensive to strippers (for some reason?) here is a version that is offensive to car salesmen!

I see nature, I see mad nanotech!

This is the realm of the AGI
It won’t go after your jobs,
it will go after the molecules…

There is a way of seeing the world
where you look at a blade of grass and see “a solar-powered self-replicating factory”.
I’ve never figured out how to explain how hard a Super-Intelligence can hit us,
to someone who does not see from that angle. It’s not just the one fact.

A self-replicating solar-powered thing that did not rely on humans would be a miracle. Everything is possible. Imagining it does not imply the probability is > 1e-100.

 

Behold a square !

A short Specification Gaming Story

You think you understand the basics of Geometry
Your request is a square, so you give your specification to the AI, input:

Give me a shape
with 4 sides equal length,
with 4 right angles

And it outputs this:


Here is another valid result:

And behold here is another square 🤪

Specification Gaming tells us:

The AGI can give you an infinite stream of possible “Square” results

And the Corrigibility problem tells us:

Whatever square you get at the output,
you won’t be able to iterate and improve upon.
You’ll be stuck with that specific square for eternity, no matter what square you had in your mind.

Of-course the real issue is not with these toy experiments
it’s with the upcoming super-capable AGI agents,
we’re about to share the planet with,
operating in the physical domain

Oh, the crazy shapes our physical universe will take,
with AGI agents gaming in it!

Thanksgiving turkey Survivorship Bias

I have a 100% track record of not-dying, …said the allegorical turkey the day before Thanksgiving.

Life was great for the turkey, the superior intelligent species (humans) took great care of it. They provided food and shelter, the turkey felt loved and safe.

Suddenly, one day,
the superior intelligent decision makers
decided a new fate for the turkey of our story
Something that served the instrumental goal of ….
Whatever this is …

I imagine turkey risk deniers be like:
– the humans have always been great, why would they ever harm me ?
And the turkey doomers be like:
– well, they might want to wear you for a hat, for a sitcom they shoot they call “friends”, for something they call tv for something they call laughter …
anyway it’s complicated

Receive important updates!

Your email will not be shared with anyone and won’t be used for any reason besides notifying you when we have important updates or new content

×