Note: The reason this post took three weeks to finish is that as I dug into research on Artificial Intelligence, I could not believe what I was reading. It hit me pretty quickly that what’s happening in the world of AI is not just an important topic, but by far THE most important topic for our future. So I wanted to learn as much as I could about it, and once I did that, I wanted to make sure I wrote a post that really explained this whole situation and why it matters so much. Not shockingly, that became outrageously long, so I broke it into two parts. This is Part 1—Part 2 is here.
We are on the edge of change comparable to the rise of human life on Earth.
— Vernor Vinge
There are some problems with ASI:
- All information processing system’s outputs and development is restricted by the information they have. This means, all human-like robots can’t make intelligent solutions for human problems, for which they don’t have true models. In order to have true models of reality they need to have experience of this reality: they must learn in a real time and in a real social groups of people. It will take time not less than human education.
- Information can’t be generated by information or some algorithms: ASI machines can’t create true models of reality reading some internet texts. The only way of acquiring knowledge is by taking part in a real human life. It will take time.
- ASI will be able to solve human problems only when they understand humans. For this they will need emotions and other human values. This is not simple anymore, because many if not the most contemporary humans don’t have long-term survival-useful values.