FUTURE FEEDBACK LOOP. “But for the most part, humans still haven’t figured out how their own cognitive algorithms work, or how to rewrite them. And the computers we program don’t understand their own cognitive algorithms, either (for the most part). But one day they will.”
http://intelligenceexplosion.com/en/2012/intelligence-explosion/