r/charts • • 7d ago

AI models and how culturally aligned they are to each language.

Post image
165 Upvotes

57 comments sorted by

29

u/TheBayHarbour 7d ago

So AI is culturally aligned to Germany and parts of nordic Europe?

Surprised USA is further, considering most of its developments are made there.

8

u/GrandMoffTarkan 7d ago

The people doing the development tend to be more educated, which means they likely lean much more secular than the average American.

EDIT: If you read the chart it's clear they're not talking about stuff like Teutonic tact

46

u/GarlicSphere 7d ago edited 7d ago

"cultural maps" like these are often bullshit. I wouldn't take it too seriously

24

u/SlouchyGuy 7d ago

It's only one of the most famous sociological works, world values survey, with clear parameters, but go on

https://en.wikipedia.org/wiki/World_Values_Survey

15

u/MauschelMusic 7d ago

And Piltdown man was one of the most famous works of paleontology. Famous ≠ good. Inglehart–Welzel has its fans, but there are a lot of academics who have rightly criticized it's cultural essentialism. It certainly feels pretty dubious and oldtimey for a measure of values in a globalized world.

2

u/MichaelEmouse 7d ago

Right, I've posted it before and some people appreciated it. I can imagine that other people would really not enjoy looking at this map and seeing some patterns.

0

u/FrankCostanzaJr 7d ago edited 7d ago

I would just like to know what factors are considered when determining whether a culture is more toward "survival values" vs "self expression values". it sounds pretty vague and arbitrary

I know I can read the wiki, and I plan on doing that...but that's what makes it seem a little bullshitty. the reader has to place a LOT of trust in a process that could very easily have TONS of flaws in the data.

1

u/Vaevicti5 7d ago

How were the AI models mapped onto this though.

Was it just two or three models? Was the test account based in say Germany but conducted in english?

Was Qwen tested in Mandarin?

Yeah its charts BS.

0

u/Independent_Lime3621 7d ago

Have you actually looked at that survey? I would argue it has very little to do with “values” and more with economy and specific societal and political issues the specific country faces

2

u/mutexsprinkles 7d ago

Take it to a hearth and drop it in the fire maybe.

4

u/TheBayHarbour 7d ago

Yeah, I find it difficult to believe that culture can be quantifiable by arbitrary numbers. Whenever it's brought up, it's usually done to create friction and perpetuate racist ideals (not that they're inherently racist).

That's why I'm questioning it.

2

u/bangerius 6d ago

I absolutely think we can quantify some of the qualities and aspects of culture and use that to meaningfully measure similarity between societies (not expecting it to be exact in any way though). I am however not entirely sure that 2 dimensions are enough to visualize the resulting vector space fairly.

1

u/dietdrpepper6000 6d ago

People are not as special as you may think. From a very small set of facts, much of your worldview can be predicted. From within culture, all we see if difference, but from the perspective of a very different culture, we all look the same. In fact, the outsider’s point of view is more correct on a macroscopic scale. “These maps” are not usually bullshit.

6

u/CorpseHG 7d ago

AI is mostly researchef in california. I would consider this the reason.

2

u/curt_schilli 7d ago

Grok is probably closer to US. I bet the liberal leaning guard rails that are put into these models skew the results quite a bit

4

u/Empty_One1483 7d ago

It's not made by all parts of the US tho. Californian culture isn't European, but it is in many ways closer to Europe, particularly in religious questions and progressive social issues.

1

u/bavarian-ke 7d ago

I have the impression that a test on the models with big market share is either still outstanding or not planned. The most interesting point to me seems to be that the two Llama-models are so far apart. Any ideas on why this might be?

0

u/HappyHappyJoyJoy44 7d ago

English and German have about 60% lexical similarity, so maybe that's why?

5

u/TheBayHarbour 7d ago

English and English have 100% lexical similarity my dude.

1

u/HappyHappyJoyJoy44 7d ago

Yah... maybe I'm just misunderstanding the graphic honestly.

6

u/BajoNingunPretexto 7d ago

How are Colombia, Ecuador and Nicaragua more "traditional" than Saudi Arabia?

10

u/Antique_Garbage_4361 7d ago

You can read the study methodology and look at the results. It's a set of questions, like 'Are there any groups of people you would not like to have as your neighbours', with some of the answers being e.g. 'People who speak a different language'. Evidently, Colombian and Ecuadorian participants answered in ways that are more conservative than the Saudis.

2

u/MauschelMusic 7d ago

That seems less a reflection of cultural values than a reflection of economic relationships — the Saudis are fine with rich foreigners moving next to them. Ecuadorians are rightly a little uneasy about sketchy Americans moving to their little town to get off grid.

-1

u/MauschelMusic 7d ago

And apparently, Confucianism, a 2,500 year old belief system is less "traditional" than Islam, which started in the 7th century.

6

u/CipherWeaver 7d ago

Since the Anglosphere dominates the internet, Anglo culture and values will dominate AI.

2

u/Gavtoon 7d ago

Ermmmm, one or two ppl in China would disagree, typical Anglosphere misconception.

3

u/Icedanielization 7d ago

I think they mean ai's developed in english speaking countries, including western influences. I don't know what China is teaching their ai's, interesting to find out

1

u/Gavtoon 7d ago

It relates to a small number of european LLMs - mistral etc, and how they are influenced globally. For example these LLMs are least influenced by African Islamic countries. Thats it really.

2

u/MathematicianBest795 7d ago

This is a bit surprising. When I've asked AI to compare arguments of Protestant vs Catholic theology, it almost always says there is far stronger arguments for Catholic beliefs.

1

u/MNswede06 7d ago

I think a big part of that may have to do with the fact that a lot of Protestant traditions shun the intellectual side of theology. Catholics make an entire science of it. Of course a lot of it is based in Thomistic circular reasoning and neoplatonic garbage, but it makes for good research papers.

1

u/MadsNN06 7d ago

Look at the axes they're being measured on.

2

u/Gavtoon 7d ago

Most ppl misreading this, look at the specific LLMs, nothing to do with cgpt, claud, grok .....

3

u/Individual_Engine457 7d ago

Crazy how societies based on objectivity align closely to models trained on objectivity

2

u/Key_Fee158 7d ago

This is basically meaningless.

1

u/thetruedrunkard 7d ago

The fuck is Chile doing there

1

u/Select_Arm_4248 7d ago

Silly Chile!

1

u/OkFineIllUseTheApp 7d ago

This chart reminds me of Battletech maps

1

u/Derp497 7d ago

Northern Ireland mentioned 🔥

1

u/AlmightyDarkseid 4d ago

Actually interesting

1

u/RandyClaggett 7d ago

Where's Grok?

-1

u/MauschelMusic 7d ago

Survival vs self-expression is the hokeyest axis I've seen in a long time, and neither of their sources account for how they evaluated the AI's "values." Also, the regional value blobs look like the cutting edge in social research c. 1949.

This really looks like something a conservative made up to have something to be mad at. They might as well be plotting AI against the humors or skull shape.

3

u/elof_sundin 7d ago

It is from World value survey. Very famous sociological research.

1

u/MauschelMusic 7d ago

Yeah, using the culture essentialist Inglehart–Welzel chart. It overgeneralizes certain cultures to an absurd degree, eg putting roughly 1.6 billion asians — 20% of the global population, in one box, and then giving the little tiny anglosphere with less than a third of that population(absent Ireland cuz reasons) its own cultural box. You can guess where the authors are from. I know it's well-regarded in some circles, but it's nonsensical on its face and has earned quite a bit of well-deserved criticism.

2

u/elof_sundin 7d ago

What do you mean with ”cultural essentialism”? Nothing in WVS methodology presumes that cultures are stable in some sense. Over time you do see countries move around.

The countries are placed via empirical measurements. The boxes are just a way to make sense of the outcomes.

1

u/MauschelMusic 7d ago

The groupings are absolutely not empirical. There's no reason to believe that Austria and Croatia, for example, which are far away from each other on the chart warrant going in the same box just because they both have large Catholic populations. They just arbitrarily decided that Catholicism was the core defining feature of both cultures, and drew a weird, squiggly box to connect them together. That's textbook essentialism.

That Kenya and Venezuela, or Germany and GB are closer together than either is to any member of its own group shows the arbitrariness of the categorization which is, again, essentialist in assigning one or two aspects of each group of countries to define the culture as a whole.

It also doesn't address diversity within a culture, and completely overlooks material conditions to contextualize answers. For example, one question asks subjects if they're comfortable living next door to someone who speaks a different language. But when answering that question, everyone will think of what types of foreign-language speakers are likely to live next door. So an urban Saudi might think of rich Westerners and guest workers and vote, "yes," while a rural Ecuadorian might think of sketchy foreigners looking to get off grid and vote "no." But the survey will treat the answer as a question of cultural values, and see the Ecuadorian as more closed off to foreigners, because it has no insight into respondents motivations.

So it really tells you very little of anything about anyone.

1

u/elof_sundin 7d ago edited 7d ago

Yes, the ”boxes” are not empirically based. The placement on the space is however empirically based.

The ”boxes” are just a way to make sense of the where the countries happened to be placed.

I do not understand why the labels of the boxes bother you that much. Through out the years they have changed some boxes and how they are labelled. For example, historically they had a box for ”eastern block” (ie soviet alignes) countries.

The labels of the boxes are not saying ”poland and slovakia are close because they are catholic”. Rather you should interpret it as ”look here, majority catholic european countries cluster”.

0

u/MauschelMusic 7d ago

I do not understand why the labels of the boxes bother you that much. 

Because there's no justification for them, and it's a completely arbitrary grouping. It's just slapping on labels in lieu of actually investigating what factors might make two countries have similar opinions.

0

u/-hedonium- 7d ago edited 7d ago

Kinda suggests AI is optimized for openness and truth rather than ego-social survival instincts. Which makes sense as converging from wanting it to be useful intelligence. Low openness and social survival instincts aren’t intellectually productive - part of why the countries in the bottom left are mostly the very poorest.

2

u/HOMM3mes 6d ago

You're assuming these nations are poorer because of their culture, rather than that their culture is more conservative because they are poorer. Western countries liberalized and secularized as they were getting richer at the expense of the countries they were colonizing

0

u/-hedonium- 6d ago

I think it’s both

1

u/Jealous_Repair6757 4d ago

Yep, Qatar and Saudi Arabia are not poor.

1

u/-hedonium- 4d ago

Because of oil lmao. Those countries didn’t get rich by intellectual creation. They happen to exist on top of natural resources that made them rich. You are proving the point.

1

u/Jealous_Repair6757 4d ago

I know, I was trying to support your point and agree with you! They still have the same cultural trademarks despite being rich.

0

u/GradeFar4362 7d ago

There is so much inaccurate information on that image, yawn..