I don’t see why AGI must be conscious, and the fact that you even bring it up makes me think you haven’t thought too hard about any of this.
When you say “novel answers” what is it you mean? The questions on the IMO have never been asked to any human before the Math Olympiad, and almost all humans cannot answer those quesion.
Why does answering those questions not count as novel? What is a question whose answer you would count as novel, and which you yourself could answer? Presuming that you count yourself as intelligent.
What is a question whose answer you would count as novel, and which you yourself could answer?
AI does not have genetics and therefore no instincts that was shaped by billions of years of evolution,
so when presented with a challenge that doesn’t appear in its training data, such as whether to love your neighbor or not, it might not be able to answer because that exact scenario doesn’t appear in its training data.
humans can answer it instinctively because we have billions of years of experience behind us backing us up and providing us with a solid long-term positive decision-making capability.
I don’t see why AGI must be conscious, and the fact that you even bring it up makes me think you haven’t thought too hard about any of this.
When you say “novel answers” what is it you mean? The questions on the IMO have never been asked to any human before the Math Olympiad, and almost all humans cannot answer those quesion.
Why does answering those questions not count as novel? What is a question whose answer you would count as novel, and which you yourself could answer? Presuming that you count yourself as intelligent.
AI does not have genetics and therefore no instincts that was shaped by billions of years of evolution,
so when presented with a challenge that doesn’t appear in its training data, such as whether to love your neighbor or not, it might not be able to answer because that exact scenario doesn’t appear in its training data.
humans can answer it instinctively because we have billions of years of experience behind us backing us up and providing us with a solid long-term positive decision-making capability.