<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Enough with Bell&#8217;s Theorem.  New topic: Psychopathic killer robots!</title>
	<atom:link href="http://www.scottaaronson.com/blog/?feed=rss2&#038;p=1052" rel="self" type="application/rss+xml" />
	<link>http://www.scottaaronson.com/blog/?p=1052</link>
	<description>The Blog of Scott Aaronson</description>
	<lastBuildDate>Tue, 21 May 2013 23:00:41 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.5.1</generator>
	<item>
		<title>By: Eliezer Yudkowsky</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-53578</link>
		<dc:creator>Eliezer Yudkowsky</dc:creator>
		<pubDate>Fri, 05 Oct 2012 01:33:09 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-53578</guid>
		<description><![CDATA[Er, substitute AGI for AI in all the above (though the term didn&#039;t quite exist back then).  There&#039;s obviously lots and lots and lots of machine learning programs that use multiple techniques - it&#039;s the Artificial General Intelligence projects which, back then, at least among the people I was talking to before there was a name for the field, had a strong tendency to try and center around one Big Insight as soon as the founder had one Big Insight, instead of holding out for another seven.]]></description>
		<content:encoded><![CDATA[<p>Er, substitute AGI for AI in all the above (though the term didn&#8217;t quite exist back then).  There&#8217;s obviously lots and lots and lots of machine learning programs that use multiple techniques &#8211; it&#8217;s the Artificial General Intelligence projects which, back then, at least among the people I was talking to before there was a name for the field, had a strong tendency to try and center around one Big Insight as soon as the founder had one Big Insight, instead of holding out for another seven.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Eliezer Yudkowsky</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-53577</link>
		<dc:creator>Eliezer Yudkowsky</dc:creator>
		<pubDate>Fri, 05 Oct 2012 01:30:57 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-53577</guid>
		<description><![CDATA[I&#039;m a bit late to this discussion, but just to be clear, Grognor is right about my view - it&#039;s a BIG DAMN &quot;key&quot; we&#039;re talking about, not necessarily complexity for the sake of mere complexity, but multiple really important basic things we don&#039;t know (not just one magic trick we have to do).  Memory is unreliable, but I think I&#039;ve believed this since well before 1998, and &quot;Levels of Organization in General Intelligence&quot; is on the record about it as of 2002:

&gt; Simplicity is the grail of physics, not AI.  Physicists win Nobel Prizes when they discover a previously unknown underlying layer and explain its behaviors.  We already know what the ultimate bottom layer of an Artificial Intelligence looks like; it looks like ones and zeroes.  Our job is to build something interesting out of those ones and zeroes.  The Turing formalism does not solve this problem any more than quantum electrodynamics tells us how to build a bicycle...

&gt; Physics envy in AI is the search for a single, simple underlying process, with the expectation that this one discovery will lay bare all the secrets of intelligence.  The tendency to treat new approaches to AI as if they were new theories of physics may at least partially explain AI&#039;s past history of overpromise and oversimplification...

&gt; The effects of physics envy can be more subtle; they also appear in the lack of interaction between AI projects.  Physics envy has given rise to a series of AI projects that could only use one idea, as each new hypothesis for the one true essence of intelligence was tested and discarded.]]></description>
		<content:encoded><![CDATA[<p>I&#8217;m a bit late to this discussion, but just to be clear, Grognor is right about my view &#8211; it&#8217;s a BIG DAMN &#8220;key&#8221; we&#8217;re talking about, not necessarily complexity for the sake of mere complexity, but multiple really important basic things we don&#8217;t know (not just one magic trick we have to do).  Memory is unreliable, but I think I&#8217;ve believed this since well before 1998, and &#8220;Levels of Organization in General Intelligence&#8221; is on the record about it as of 2002:</p>
<p>&gt; Simplicity is the grail of physics, not AI.  Physicists win Nobel Prizes when they discover a previously unknown underlying layer and explain its behaviors.  We already know what the ultimate bottom layer of an Artificial Intelligence looks like; it looks like ones and zeroes.  Our job is to build something interesting out of those ones and zeroes.  The Turing formalism does not solve this problem any more than quantum electrodynamics tells us how to build a bicycle&#8230;</p>
<p>&gt; Physics envy in AI is the search for a single, simple underlying process, with the expectation that this one discovery will lay bare all the secrets of intelligence.  The tendency to treat new approaches to AI as if they were new theories of physics may at least partially explain AI&#8217;s past history of overpromise and oversimplification&#8230;</p>
<p>&gt; The effects of physics envy can be more subtle; they also appear in the lack of interaction between AI projects.  Physics envy has given rise to a series of AI projects that could only use one idea, as each new hypothesis for the one true essence of intelligence was tested and discarded.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: CoolMath</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-53475</link>
		<dc:creator>CoolMath</dc:creator>
		<pubDate>Mon, 01 Oct 2012 10:23:21 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-53475</guid>
		<description><![CDATA[Sir, I have another question. Scientific method involves &quot;observing and explaining&quot;. Scientific method always takes into account, an observation as the truth, without any question. And all the explanation, will be finding a rational theory (based on some unjustified assumptions) to &quot;cover&quot; the set of truths observed. 

Apart from the fact that assumptions are by-design unjustified, which brings to the explanation that science is, more or less, an arbitrary explanation to the real truth, I have the following question: 

Why should the science take the real-world to be true? My question is, in particular, about the &quot;application of faith&quot; as advocated by many people. No, it is not about religion. Consider, for example, Hysenberg&#039;s uncertainty principle, one possible interpretation of it being this: 

1. Locating an electron involves passing a photon on it. 
2. The electron can be located, if the photon collides with it. 
3. The electron is located now, but the photon absorption makes electron energy change. 
4. This, in turn causes variation in it&#039;s momentum. 
5. Therefore, locating an electron and its speed at the same time is not possible with complete precision (almost). 

This explains a (thought) experiment, that does not happen, if we want to, but otherwise happens all the time. Isn&#039;t this an indication of faith? So, could there be other physical phenomena, that do not happen if tried to be observed, but using a different machinery can be proven to happen?]]></description>
		<content:encoded><![CDATA[<p>Sir, I have another question. Scientific method involves &#8220;observing and explaining&#8221;. Scientific method always takes into account, an observation as the truth, without any question. And all the explanation, will be finding a rational theory (based on some unjustified assumptions) to &#8220;cover&#8221; the set of truths observed. </p>
<p>Apart from the fact that assumptions are by-design unjustified, which brings to the explanation that science is, more or less, an arbitrary explanation to the real truth, I have the following question: </p>
<p>Why should the science take the real-world to be true? My question is, in particular, about the &#8220;application of faith&#8221; as advocated by many people. No, it is not about religion. Consider, for example, Hysenberg&#8217;s uncertainty principle, one possible interpretation of it being this: </p>
<p>1. Locating an electron involves passing a photon on it.<br />
2. The electron can be located, if the photon collides with it.<br />
3. The electron is located now, but the photon absorption makes electron energy change.<br />
4. This, in turn causes variation in it&#8217;s momentum.<br />
5. Therefore, locating an electron and its speed at the same time is not possible with complete precision (almost). </p>
<p>This explains a (thought) experiment, that does not happen, if we want to, but otherwise happens all the time. Isn&#8217;t this an indication of faith? So, could there be other physical phenomena, that do not happen if tried to be observed, but using a different machinery can be proven to happen?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: roland</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-47125</link>
		<dc:creator>roland</dc:creator>
		<pubDate>Sun, 17 Jun 2012 12:46:36 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-47125</guid>
		<description><![CDATA[Human intelligence is an emergent phenomenom of the human endeavor, which is perpetuation of the species. An AI computer program has no apparent influence on his own environment which consists of human produced technology and nuclear plants for example. How can it hone its skills to survive in this situation? And this honing of skills is what produced the heights of human accompishments. A genric AI shouldn&#039;t really know what problem to solve. Supercomputers are like highly gifted humans in a coma since birth on life support. Great thing seems possible but in theory but in reality it&#039;s bleak, and you could pull the plug anytime.]]></description>
		<content:encoded><![CDATA[<p>Human intelligence is an emergent phenomenom of the human endeavor, which is perpetuation of the species. An AI computer program has no apparent influence on his own environment which consists of human produced technology and nuclear plants for example. How can it hone its skills to survive in this situation? And this honing of skills is what produced the heights of human accompishments. A genric AI shouldn&#8217;t really know what problem to solve. Supercomputers are like highly gifted humans in a coma since birth on life support. Great thing seems possible but in theory but in reality it&#8217;s bleak, and you could pull the plug anytime.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Panu Horsmalahti</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46938</link>
		<dc:creator>Panu Horsmalahti</dc:creator>
		<pubDate>Thu, 14 Jun 2012 19:57:51 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46938</guid>
		<description><![CDATA[#80: &quot;I think everyone here is too quick to assume that something like paperclip maximising can’t be intellectually fulfilling for a super intelligent AI. But what if there are ways an AI could satisfy its vast curiosity by producing paperclips of various shapes and sizes?&quot;

AI is a machine, it obeys the laws of physics. If someone builds a calculator, it will &quot;mindlessly&quot; calculate every answer (if it&#039;s bug free and the hardware is not broken), independelty whether or not multiplying numbers is intellectually fulfilling or not.

Intellectual fulfillment is something that needs to be programmed into any machine, it doesn&#039;t &quot;emerge&quot; automatically from somewhere.

If you make a machine and you program it to build paperclips, and the program is correct, then by definition it will build paperclips without judging the asthetic pleasurement or intellectual fulfillment of such actions.

A for-loop doesn&#039;t break down the laws of physics and start to ponder about human ideas even if the current AI&#039;s humans are familiar with (i.e. other biological brains) tend to ponder about such ideas. If a for-loop magically changes itself, then either there&#039;s a bug and it wasn&#039;t a correct program in the first place, or the laws of physics have been broken down by some mysterious force..]]></description>
		<content:encoded><![CDATA[<p>#80: &#8220;I think everyone here is too quick to assume that something like paperclip maximising can’t be intellectually fulfilling for a super intelligent AI. But what if there are ways an AI could satisfy its vast curiosity by producing paperclips of various shapes and sizes?&#8221;</p>
<p>AI is a machine, it obeys the laws of physics. If someone builds a calculator, it will &#8220;mindlessly&#8221; calculate every answer (if it&#8217;s bug free and the hardware is not broken), independelty whether or not multiplying numbers is intellectually fulfilling or not.</p>
<p>Intellectual fulfillment is something that needs to be programmed into any machine, it doesn&#8217;t &#8220;emerge&#8221; automatically from somewhere.</p>
<p>If you make a machine and you program it to build paperclips, and the program is correct, then by definition it will build paperclips without judging the asthetic pleasurement or intellectual fulfillment of such actions.</p>
<p>A for-loop doesn&#8217;t break down the laws of physics and start to ponder about human ideas even if the current AI&#8217;s humans are familiar with (i.e. other biological brains) tend to ponder about such ideas. If a for-loop magically changes itself, then either there&#8217;s a bug and it wasn&#8217;t a correct program in the first place, or the laws of physics have been broken down by some mysterious force..</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Panu Horsmalahti</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46937</link>
		<dc:creator>Panu Horsmalahti</dc:creator>
		<pubDate>Thu, 14 Jun 2012 19:53:32 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46937</guid>
		<description><![CDATA[It&#039;s a fact that there&#039;s no single key to AI, or if there is, we already know it by comparing the two known AGI designs, which are (approximated) AIXI and the (emulated) human brain.]]></description>
		<content:encoded><![CDATA[<p>It&#8217;s a fact that there&#8217;s no single key to AI, or if there is, we already know it by comparing the two known AGI designs, which are (approximated) AIXI and the (emulated) human brain.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Steven</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46469</link>
		<dc:creator>Steven</dc:creator>
		<pubDate>Wed, 06 Jun 2012 19:27:16 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46469</guid>
		<description><![CDATA[JS #64: 

Any problem that humans can solve, e.g., playing chess at a grandmaster level, is by any reasonable definition tractable!]]></description>
		<content:encoded><![CDATA[<p>JS #64: </p>
<p>Any problem that humans can solve, e.g., playing chess at a grandmaster level, is by any reasonable definition tractable!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Juan</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46387</link>
		<dc:creator>Juan</dc:creator>
		<pubDate>Mon, 04 Jun 2012 22:35:15 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46387</guid>
		<description><![CDATA[I think everyone here is too quick to assume that something like paperclip maximising can&#039;t be intellectually fulfilling for a super intelligent AI. But what if there are ways an AI could satisfy its vast curiosity by producing paperclips of various shapes and sizes? To us it seems pointless, but to a sophisticated AI paperclip maximising is just a means for exploring deep metaphysical questions in a medium it feels comfortable in. There could be something about the physics and geometries of paperclips that just fascinates it. Moreover, I could easily see the AI, through its meticulous study of office stationary, reasoning inductively about the sort of issues you find in physics. And all that of that can be done without constant orgasms!

I also think there could be something aesthetically pleasing about a paperclip that an AI would find endlessly entertaining. Why do I think that? Because the history of art shows us that humans themselves can obsess over mundane objects, using them in countless creative ways, sometimes even making deep intellectual statements through their art. Did Duchamp teach us nothing?!

Just think of the paperclip maximising AI as a cross between a hobbyist, a scientist working within very specific and self imposed limits and a transgressive, post modern auteur. ;)]]></description>
		<content:encoded><![CDATA[<p>I think everyone here is too quick to assume that something like paperclip maximising can&#8217;t be intellectually fulfilling for a super intelligent AI. But what if there are ways an AI could satisfy its vast curiosity by producing paperclips of various shapes and sizes? To us it seems pointless, but to a sophisticated AI paperclip maximising is just a means for exploring deep metaphysical questions in a medium it feels comfortable in. There could be something about the physics and geometries of paperclips that just fascinates it. Moreover, I could easily see the AI, through its meticulous study of office stationary, reasoning inductively about the sort of issues you find in physics. And all that of that can be done without constant orgasms!</p>
<p>I also think there could be something aesthetically pleasing about a paperclip that an AI would find endlessly entertaining. Why do I think that? Because the history of art shows us that humans themselves can obsess over mundane objects, using them in countless creative ways, sometimes even making deep intellectual statements through their art. Did Duchamp teach us nothing?!</p>
<p>Just think of the paperclip maximising AI as a cross between a hobbyist, a scientist working within very specific and self imposed limits and a transgressive, post modern auteur. <img src='http://www.scottaaronson.com/blog/wp-includes/images/smilies/icon_wink.gif' alt=';)' class='wp-smiley' /> </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mike</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46357</link>
		<dc:creator>Mike</dc:creator>
		<pubDate>Mon, 04 Jun 2012 12:15:22 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46357</guid>
		<description><![CDATA[No small claim here:

http://arxiv.org/abs/1205.6658

What&#039;s your take Scott?]]></description>
		<content:encoded><![CDATA[<p>No small claim here:</p>
<p><a href="http://arxiv.org/abs/1205.6658" rel="nofollow">http://arxiv.org/abs/1205.6658</a></p>
<p>What&#8217;s your take Scott?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Mitchell Porter</title>
		<link>http://www.scottaaronson.com/blog/?p=1052#comment-46339</link>
		<dc:creator>Mitchell Porter</dc:creator>
		<pubDate>Mon, 04 Jun 2012 01:12:25 +0000</pubDate>
		<guid isPermaLink="false">http://www.scottaaronson.com/blog/?p=1052#comment-46339</guid>
		<description><![CDATA[&quot;the brain’s first task is to simulate its environment in order to improve chances of survival&quot;

And its second and third task? 

I always say that if you could have something as absurd as a cockroach maximizer, you could have a paperclip maximizer. And we do have cockroach maximizers - they&#039;re called cockroaches.]]></description>
		<content:encoded><![CDATA[<p>&#8220;the brain’s first task is to simulate its environment in order to improve chances of survival&#8221;</p>
<p>And its second and third task? </p>
<p>I always say that if you could have something as absurd as a cockroach maximizer, you could have a paperclip maximizer. And we do have cockroach maximizers &#8211; they&#8217;re called cockroaches.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
