Narrow optimization can lead to unintended consequences
Information scientist Steve Omohundro shows "that rational systems exhibit universal ‘drives’ towards self-preservation, replication, resource acquisition and efficiency and that those drives will lead to anti-social and dangerous behaviour if not explicitly countered."
CONTEXT(Help)
-
Sapiens Plurum: Evolving interconnections of people & their creations »Sapiens Plurum: Evolving interconnections of people & their creations
▲
The future of humankind »The future of humankind
▲
Survival Issues »Survival Issues
▲
Can we assure that meta-intelligences advance human interests? »Can we assure that meta-intelligences advance human interests?
▲
Need to incorporate bio-sensed data into AGI cores »Need to incorporate bio-sensed data into AGI cores
■
Narrow optimization can lead to unintended consequences
+Comments (0)
+Citations (1)
+About