Month: September 2022

NO CONTROL. “We must be sober about the fact that nothing in physics prohibits very bad outcomes. But we must also be sober about the fact that nothing in physics prohibits outcomes of greater joy and harmony than our primitive monkey brains can imagine.” https://lnkd.in/dg44j-e View in LinkedIn

BOUNDED RECURSIVE SELF-IMPROVEMENT. "Based on principles of autocatalysis, endogeny and reflectivity, the work provides an architectural blueprint for constructing systems with high levels of operational autonomy in underspecified circumstances, starting from only a small amount of designer-specified code -- a seed.” https://lnkd.in/ezNrCcA View in LinkedIn

NEW LEARNING. “Humans learn how to use language in a society of language users. No principles that might allow an artificial agents to learn language this way are known at present. We present work that addresses this challenge: Our auto-catalytic, endogenous, reflective architecture (AERA) supports the creation of agents that can learn natural language by observation.” https://lnkd.in/eTrCtpj View in LinkedIn

FOUR LEAPS. “Taking a long historical long view, we see steady total growth rates punctuated by rare transitions when new faster growth modes appeared with little warning. We know of perhaps four such “singularities”: animal brains (∼600 MYA), humans (∼2 MYA), farming (∼10 kYA), and industry (∼0.2 kYA).” http://intelligence.org/files/AIFoomDebate.pdf View in LinkedIn

SMARTS DEFINED. “Intelligence measures an agent’s ability to achieve goals in a wide range of environments. For our purposes, “intelligence” measures an agent’s capacity for efficient cross-domain optimization of the world according to the agent’s preferences.” https://lnkd.in/dAZH9Vg View in LinkedIn

MACHINE INTELLIGENCE RESEARCH INSTITUTE. "Humans may create human-level artificial intelligence (AI) this century. Shortly thereafter, we may see an “intelligence explosion” or “technological singularity”—a chain of events by which human-level AI leads, fairly rapidly, to intelligent systems whose capabilities far surpass those of biological humanity as a whole." https://lnkd.in/dAZH9Vg View in LinkedIn

CHANCE. “It seems unlikely that humans are near the ceiling of possible intelligences, rather than simply being the first such intelligence that happened to evolve.” https://lnkd.in/dAZH9Vg View in LinkedIn

NEW AI. "Since man’s near-monopoly of all higher forms of intelligence has been one of the most basic facts of human existence throughout the past history of this planet, such developments would clearly create a new economics, a new sociology, and a new history.” https://lnkd.in/dAZH9Vg View in LinkedIn

UNPACKING CLAIMS. “We review the evidence for and against three claims: that (1) there is a substantial chance we will create human-level AI before 2100, that (2) if human-level AI is created, there is a good chance vastly superhuman AI will follow via an “intelligence explosion,” and that (3) an uncontrolled intelligence explosion could destroy everything we value, but a controlled intelligence explosion would benefit humanity enormously if we can achieve it.” https://lnkd.in/dAZH9Vg View in LinkedIn

LOSING THE PATH. “We will not tell detailed stories about the future. Each step of a story may be probable, but if there are many such steps, the whole story itself becomes improbable.” https://lnkd.in/dAZH9Vg View in LinkedIn