Can a Robotic Eyeball Be Created that Perfectly Replicates Human Vision?

Question

In my world, a "perfect" robotic eyeball has been created. This eyeball is electronic, but it emulates a human eye perfectly.

This does not necessarily mean that it has millions of synthetic cones and rods and is physically identically to a normal eye; it just means that whatever it sees, a human with average eye sight would see as well.

A common problem I have seen with cameras is that they never seem to capture the world exactly the way that people see it; there's always something wrong. Whether it's slightly off-color, the brightness or contrast is wrong, etc.

This robotic eye would avoid all of those problems. It would even avoid that weird moiré effect when pointed at a computer screen.

---

Is this at all possible?

I am aware some people are colorblind; these robotic eyes would see all of the colors the way an average healthy human being without any eye conditions would see them.

Assume that technology is like that of modern-day. Also assume that money and resources are no object.

---

UPDATE: The eyeball isn't intended to interact with human beings. The whole point is to have robots and cameras that work the same way human eyes do or even better.

This robotic eye would even be able to emulate peripheral vision.

---

In my story, an eye like this is important for several reasons:

• Robots being able to understand humans and how they perceive the world
• Being able to render captured footage (whether on a screen, or with virtual reality, etc.) in a way that can be visualized as though you saw it yourself through your own eyes

Footage through a camera like this should look real. There should not be a "This is just a video, I can tell because X,Y,Z". It should be virtually indistinguishable from reality to human beings. (assuming that high enough resolutions are available)

Answer 1

Is this at all possible?

Yes. Eyes demonstrate that such a thing is possible. Making photosensors equivalent to our rods and cones is a Simple Matter Of Science And Engineering.

Assume that technology like that of modern-day

No. We can't even transplant a real eye yet. Emulating a whole eye in hardware and splicing it into an optic nerve is clearly a more difficult task.

---

edit following question update

The whole point is to have robots and cameras that work the same way human eyes do

You've conflated two things here... having cameras that give identical performance to human eyes, and having a vision system that works as well as a human's.

The camera bit is an engineering problem... getting the exact same colour response might be a bit fiddly, but entirely solvable. Getting the same dynamic range would be harder, but there's no obvious reason that could not be solved either.

The vision bit is an AI-hard problem, and with all the power and money in the world we haven't been able to crack it. Eyes are, for the most part, a bit rubbish. They work so well for us because they are attached to a fairly powerful bit of image processing wetware.

or even better.

Then don't make them work like human eyes. What's the point? You're not piping the output into a human brain, so there's nothing to gain.

Answer 2

We can already make cameras way better than human eyes

Human eyes are piss poor optical devices. Our problem with transplanting eyes is the electronics and neural connection not the eye itself, that part is easy.

You don't want a camera that sees as well as the human eye, the human eye is shit, it is full of artifacts, distortion, and limitation that have to be edited out by the brain. the moire effect can be solved just by not using digital output for your camera or scanning, just have it output continuously and have dedicated integration after the effect. Human eyes feel better because our brain is used to our existing editing if it has to do more it stands out. If you transplanted an eye from one human to another it will also feel horribly distorted until their brain learns to edit the information coming from the new eye.

Color is even more obvious, human color vision is crap, cameras can be built to detect many many discrete colors while the human eye/brain has to composite together what is basically only 2.5-3 vague colors. Even many animals (birds and reptiles) have better color vision than humans, just because they see base 4 colors. we build cameras to compliment human eye color bias but we don't have to build them that way.

Don't confuse the average video with what video is capable of, most video suffers because they are projected on a flat surface which then has to be resenses by our eyes, while normally our eyes see independent 3D objects, it is an issue of playback not the cameras.

Now the human eye does have a few advantages a curved sensor combined with a curved lens gives less distortion, and only the highest end cameras can compete with human pixel density (not that we use it all). but those are all fixable. But most of what you mention is software not hardware, peripheral vision for instance is software not hardware.

Answer 3

No, it's not possible, but only because you defined it that way.

You focus greatly on an optical device with precisely the optical behaviors of an organic object. As a general pattern, this cannot be done. Given a particular metric as to what sort of imaging you want, you may be able to do better, but to do precisely the same as an organic eyeball calls for an organic eyeball.

This answer is predicated on your requirement of not post-processing the image. With that requirement in place, you're basically stuck. The particular quirks of any organic system are hard to mimic. It's much easier to post process the effects in.

For example, consider the rods. The pigment responsible for our low light vision is Rhodopsin. It's in a fantastic feedback loop with very precise behaviors. A flash of bright light ruins the calibration of these systems, which is why you lose night vision if exposed to a bright light. It's basically insensitive to red, which is why red lights don't hurt your dark vision. Once tuned, these rods are so sensitive that biologists seriously consider that it might be meaningfully sensitive to single photons.

This precise behavior will be almost completely impossible to replicate. It's too exacting of a system. What we would do instead is come up with a system with better performance than rods and their Rhodopsin, and post-process some of the fidelity away.

Any robotic eye meeting your criteria would be, in fact, a synthetically grown human eyeball grown from human cells, just like ours. That's just the best you can do.

As an aside. You mention the color is wrong. Most of the time the color is more correct than it is for your eyeballs. What you're experiencing is the extraordinary color balancing abilities of our visual cortex. The visual cortex covers for the eyeball a lot!