An interactive journey through multisensory integration in the zebrafish brain
Imagine you are a tiny fish larva, just 4 millimeters long. A shadow grows above you -- something is diving toward you. At the same time, you feel a shockwave rip through the water. You have less than 10 milliseconds to decide: flee or freeze?
Animals constantly face these decisions. Their survival depends on combining information from different senses -- sight, hearing, touch -- to build a complete picture of the threat. This process is called multisensory integration.
This expanding dark circle is a "looming stimulus" -- it simulates a predator diving toward a fish. In this thesis, these stimuli were used to trigger escape responses in zebrafish larvae.
The zebrafish (Danio rerio) is one of neuroscience's most powerful model organisms. These small freshwater fish from South Asia have a remarkable advantage: their larvae are completely transparent.
This transparency, combined with genetically encoded fluorescent proteins (GFP) that glow green when neurons fire, allows scientists to watch the entire brain think in real time -- something impossible in almost any other vertebrate.
Larvae are see-through, enabling live brain imaging without surgery
GCaMP6f proteins glow green when neurons fire, acting as a real-time activity sensor
Escape responses begin in under 5 ms, among the fastest in the animal kingdom
Zebrafish share ~70% of their genes with humans, making findings broadly relevant
The zebrafish brain is only about 500 micrometers long, yet it contains all the fundamental regions found in human brains. One structure particularly fascinated us: the Tectum.
The Tectum (called Superior Colliculus in mammals) was historically considered a purely visual processing center. It receives direct input from the eyes and creates a map of the visual world. But we suspected it might do much more.
Everyone assumed the Tectum was just for vision. Our first major discovery was that abrupt, danger-signaling sounds activate neurons deep inside the Tectum. This had never been clearly demonstrated before in zebrafish.
Using calcium imaging in live, transparent larvae, we watched neurons glow green as they responded to sudden sounds -- the kind that would signal a predator splashing into the water.
The deep layers of the Tectum respond to abrupt sounds. When combined with visual stimuli, the response is dramatically enhanced.
Here is where it gets remarkable. When we presented visual and auditory danger signals simultaneously, the brain response was not simply the sum of each individual signal. The Tectum showed a dramatic multisensory enhancement -- significantly more neurons were recruited, and they responded more intensely.
This enhancement translated directly into behavior: zebrafish were significantly more likely to escape when they received both signals at once compared to either signal alone.
One of the most elegant principles of multisensory integration is called inverse effectiveness: when individual signals are weak and ambiguous, combining them produces the greatest proportional improvement.
Think of it like this: in a quiet room, you can understand speech easily with just hearing. But in a noisy party, seeing the speaker's lips moving suddenly makes a huge difference. That is inverse effectiveness -- and we found it in the zebrafish Tectum.
When each signal alone is barely noticeable, combining them produces a disproportionately large improvement. This is exactly what we observed in both neural activity and escape behavior.
Zebrafish larvae do not just escape -- they choose how. We discovered that two distinct escape behaviors are differentially triggered by the type of sensory signal:
Short Latency C-start
Long Latency C-start
When both signals arrive together, the fish selects its escape type based on which signal is more salient. If the sound is louder, it performs a fast SLC. If the visual loom is more obvious, it opts for a flexible LLC. The brain is not just detecting danger -- it is choosing the best strategy for survival.
By linking brain activity to behavior, this thesis proposes a model for how the zebrafish brain transforms sensory signals into life-saving actions:
The Tectum is not just visual -- it robustly processes danger-signaling sounds, challenging decades of assumptions.
Combining sight and sound produces a multisensory enhancement in the Tectum, recruiting more neurons with stronger responses.
This enhancement follows inverse effectiveness: weak, ambiguous signals benefit the most from combination.
Tectal integration links directly to hindbrain motor circuits and predicts escape behavior.
Fish choose between fast (SLC) or flexible (LLC) escapes based on which sensory signal dominates -- a form of real-time survival strategy selection.
The Tectum of zebrafish is homologous to the Superior Colliculus in humans. The same multisensory integration principles discovered here operate in your brain right now, every time you combine what you see and hear to make sense of the world around you.
Understanding these circuits at a fundamental level -- neuron by neuron, in an intact living brain -- opens the door to understanding how sensory processing goes wrong in conditions like autism spectrum disorders, where multisensory integration is often altered.
This work also pioneered new methods: deep learning for animal tracking, semi-automatic neuron segmentation, and novel analysis pipelines -- tools now being used by other researchers in the lab to tackle new questions.
Watching hundreds of neurons fire in real time in living larvae
Training neural networks to track zebrafish pose at 437 fps
Mapping every neuron to a standardized brain reference
This PhD thesis was conducted at the SPIN Lab (Neural Processing and Integration Systems Lab), IFIBYNE (UBA/CONICET), Buenos Aires, Argentina, under the supervision of Dr. Violeta Medan.
Part of this work was carried out in the laboratory of Dr. German Sumbre at the Ecole Normale Superieure (IBENS), Paris, France.
Thanks for exploring. The zebrafish escapes to swim another day.