What would happen to society and the world and tech and science development if computers and AI get so smart and intelligent?
closed as too broad by Cort Ammon, L.Dutch♦, jdunlop, Secespitus, Rekesoft Jun 25 '18 at 7:59
Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.
Not as much as you'd think
As a researcher in the AI field, I can tell you that intelligence and power are not the same thing. When you get right down to it, intelligence is just another name for pattern matching.
All the things we 'learn' in life is really just familiarity with a specific 'pattern'. That pattern might be a sequence of tasks to get a larger job complete (temporal pattern) it might be the ability to differentiate between a sparrow's call and a wren's call, it might even be noticing that the stick on the ground beside you is sharp and could extend your reach just beyond those of the claws of the animal hunting you; everything we do, know, recognise or learn is a pattern in some form.
So; the larger the IQ, the more complex patterns you can recognise, and the faster you can put different patterns together for comparison to come up with a new way of using an existing one or a new pattern entirely that you can use in a known way (remembering something useful or coming up with a new idea that can be used to solve a known problem).
One of the smartest people I know works as an office cleaner. Just because you're intelligent, it doesn't mean you're driven to be powerful, or even intelligent in the way that will make you rich or powerful. AIs in particular are not driven by the biological imperatives (survival, hunger, procreation, etc.) that we humans are and therefore are even less likely to turn into something like Skynet. Computers don't experience emotion, so they aren't driven by passion, curiosity, fear, etc. They only 'learn' when we drive them to.
Finally, the Intelligence Quotient (IQ) is not linear. The difference between IQs of 85 and 100 is much bigger than the difference between (say) 150 and 165. IQs of over 200 sound very impressive (and I guess they are) but the truth of it is that you need a larger and larger figure above 100 to get the same quantity of intelligence. Once you get above around 180, the number really loses all meaning anyway.
It IS possible that such a computer would be capable of learning knowledge at an exponential rate that goes 'vertical' and all possible knowledge is within reach, but the truth is that as an AI, we would still have to drive it in the key directions to harness that access to new knowledge.
As for power, well the people who control the AI may use the superior access to knowledge and patterns to take power for themselves, but the AI won't do that unless it's specifically programmed to do so.
So, let's not do that. Please.
The singularity would happen.
Man and machine would merge. VR and RL would be interchangeable. People could become functionally immortal. Artificial humanity would spread out among the stars.
Humanity becomes extinct most likely from the creation of sexbots which replace all human relationships.
Killer robots hunt humanity to extinction because we pose a threat to everything
Everyone gets cyrogeneticly frozen and forgotten because we programmed the machines to keep us safe and the machines figured out that was the safest option.
We become basically a pet to our robot overlords. AI does everything and runs everything and we get looked after but really have no meaningful say in anything including our own lives.
The moral of the story is the future is whatever you say it is because it's your story.