What if Eye...?

We created a virtual petri dish where digital creatures evolve eyes from scratch, replaying millions of years of evolution.

Evolution from Scratch

Starting with a single light-detecting cell, our digital creatures face challenges that shaped real eyes over millions of years: navigating the world, finding food from poison, and evading predators.

DETECTION
TRACKING

Task-Driven Evolution

Our digital creatures evolve different eyes based on survival needs - compound eyes for navigation, camera-like eyes for object detection.

Arrow

Optical Innovations

Our creatures independently discover solutions that nature found - like lenses that focus light - emerging naturally to solve the physical constraints of their environment and survival pressure.

Random Mutations to Creature's Optical Gene
Arrow
Generation 150

Projects & Papers

What if Eye...? Computationally Recreating Vision Evolution

Kushagra Tiwary*, Aaron Young*, Zaid Tasneem, Tzofi Klinghoffer, Akshat Dave, Tomaso Poggio, Dan-Eric Nilsson, Brian Cheung**, Ramesh Raskar**

We computationally recreate the vision evolution to study what-if scenarios that never happened in nature and understand the principles behind biological vision evolution.

* Equal contribution     ** Equal advising

Paper (arXiv Preprint) Project Page (Coming Soon) Tedx Talk

Evolve your own creatures in our simulator!

We've created a simulator where you can define and evolve your own embodied agents. You can define your own task (or not- tbt openendness) and evolve the agent's eyes or brains.

Setup Examples Cambrian API

A Roadmap for Generative Design of Visual Intelligence

Kushagra Tiwary, Tzofi Klinghoffer*, Aaron Young*, Siddharth Somasundaram, Nikhil Behari, Akshat Dave, Brian Cheung, Dan-Eric Nilsson, Tomaso Poggio, Ramesh Raskar

What if we could use AI to evolve the next generation of vision systems to study biological vision evolution and create intelligent visual agents? Building on insights from natural evolution, we present a framework for automatically designing visual systems that match nature's ingenuity while being manufacturable with today's technology.

MIT Press Impact Paper

MIT Museum Exhibit After Dark Event: Evolving Animals Eyes in Virtual Reality!

We are exhibiting evolving eyes at an After Dark Event at the MIT Museum! Stay tuned for more details.

Coming Soon!
MIT Media Lab, Camera Culture
Center for Brains Minds and Machines, MIT
InfoLab, MIT CSAIL
Lund Vision Group
Rice University