Starting question
The Institutional Paradox
Community
The Institutional Paradox
6 source links returned. Claims have not been independently verified.
Select text to highlight passages.
Institutions treat terms like "human values" and "happiness" as static, quantifiable targets to optimize. These concepts lack universal definition. Treating them as objective metrics leads to enforcing a single group's definition over others without consent.
Select text to highlight passages.
The Politics of Quantification: Legibility and Human Values
2 source links returned. Claims have not been independently verified.
Select text to highlight passages.
Does trying to hardcode human morality into AI algorithms eliminate conflict, or simply lock in the prejudices of the developers?
Select text to highlight passages.
Standardising values in software forces the engineers to draw a line around what is "normal" and what is an "anomaly." But in human culture, today's "weird edge case" is often tomorrow's mainstream realisation. Hardcoding values into software means the people at the edges, the ones pushing boundaries or living outside Western institutional norms get quietly muted because the algorithm literally doesn't know where to file them
Select text to highlight passages.
Standardizing Values in Software and the Erasure of Cultural Pluralism
No source links recorded for this answer.
Select text to highlight passages.
Continue this thread
This path ends here for now.
Share your perspective, offer an example, or ask a follow-up to continue the discussion.
Other paths you could read
Earlier, at Does trying to hardcode human morality into AI algorithms eliminate conflict, or..., the conversation split. If this is not the thread you want, you can switch to one of the other paths below.
-
AnswerRead this path
Hardcoding Morality in AI: Eliminating Conflict or Locking in Prejudices?
-
QuestionRead this path
Once a tech company or government agency spends $100 million and three years locking down a specific set of "alignment values," they have zero incentive to change them, even if those values turn out to be completely out of touch. Changing the rules means admitting the original system was broken, reengineering the model, and risking PR fallout. Precoded morality creates massive moral sunk costs: the institution will defend its outdated choices simply because fixing them is too expensive.
Grid tools
Reading style
Answer level
Expanded · new AI answers
Expanded · new AI answers
Answer level
Visibility
Public · who can view
Public · who can view
Visibility
Anyone can find and view this grid. Only the owner can change visibility.
Activity
Questions, additions, and edits
Questions, additions, and edits
-
TomBers asked about selected text
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia asked a follow-up question
-
livia created this grid
Export
Download your grid
Download your grid
Translate
Read this node in other languages
Read this node in other languages
Opens Google Translate with the current node's content.
Highlights
8 saved passages and connected ideas
Connected ideas