PhD Thesis

How do tiny fish decode danger using multiple senses?

An interactive journey through multisensory integration in the zebrafish brain

Nicolas Martorell · Universidad de Buenos Aires · 2025

Scroll to explore

Life-or-death decisions in milliseconds

Imagine you are a tiny fish larva, just 4 millimeters long. A shadow grows above you -- something is diving toward you. At the same time, you feel a shockwave rip through the water. You have less than 10 milliseconds to decide: flee or freeze?

Animals constantly face these decisions. Their survival depends on combining information from different senses -- sight, hearing, touch -- to build a complete picture of the threat. This process is called multisensory integration.

Try to escape the looming predator!
Click anywhere before the shadow fills the screen

This expanding dark circle is a "looming stimulus" -- it simulates a predator diving toward a fish. In this thesis, these stimuli were used to trigger escape responses in zebrafish larvae.

Meet the zebrafish

The zebrafish (Danio rerio) is one of neuroscience's most powerful model organisms. These small freshwater fish from South Asia have a remarkable advantage: their larvae are completely transparent.

This transparency, combined with genetically encoded fluorescent proteins (GFP) that glow green when neurons fire, allows scientists to watch the entire brain think in real time -- something impossible in almost any other vertebrate.

Click the fish to reveal its brain

Transparent

Larvae are see-through, enabling live brain imaging without surgery

Fluorescent neurons

GCaMP6f proteins glow green when neurons fire, acting as a real-time activity sensor

Lightning-fast escapes

Escape responses begin in under 5 ms, among the fastest in the animal kingdom

70% shared genes

Zebrafish share ~70% of their genes with humans, making findings broadly relevant

Zebrafish model advantages and lifecycle
Advantages of the zebrafish model and its lifecycle. Adapted from Garg & Geurten, 2024 and D'Costa & Shepherd, 2009.

A tiny brain with big answers

The zebrafish brain is only about 500 micrometers long, yet it contains all the fundamental regions found in human brains. One structure particularly fascinated us: the Tectum.

The Tectum (called Superior Colliculus in mammals) was historically considered a purely visual processing center. It receives direct input from the eyes and creates a map of the visual world. But we suspected it might do much more.

Hover over the brain regions to explore
Telencephalon Tectum Cerebellum Hindbrain Eyes Eyes Front Back

The Tectum hears danger

Everyone assumed the Tectum was just for vision. Our first major discovery was that abrupt, danger-signaling sounds activate neurons deep inside the Tectum. This had never been clearly demonstrated before in zebrafish.

Using calcium imaging in live, transparent larvae, we watched neurons glow green as they responded to sudden sounds -- the kind that would signal a predator splashing into the water.

Toggle the stimuli to see how the Tectum responds

The deep layers of the Tectum respond to abrupt sounds. When combined with visual stimuli, the response is dramatically enhanced.

1 + 1 = 3

Here is where it gets remarkable. When we presented visual and auditory danger signals simultaneously, the brain response was not simply the sum of each individual signal. The Tectum showed a dramatic multisensory enhancement -- significantly more neurons were recruited, and they responded more intensely.

This enhancement translated directly into behavior: zebrafish were significantly more likely to escape when they received both signals at once compared to either signal alone.

Mix the signals and watch the escape probability change
Off Low High
Off Low High
Escape probability
7%
No stimulus (baseline)
Multisensory integration probability matrix
Escape probability for each combination of visual (contrast) and auditory (amplitude) stimuli. Combined stimuli consistently outperform either component alone, especially at low intensities.

The weaker the signals, the stronger the boost

One of the most elegant principles of multisensory integration is called inverse effectiveness: when individual signals are weak and ambiguous, combining them produces the greatest proportional improvement.

Think of it like this: in a quiet room, you can understand speech easily with just hearing. But in a noisy party, seeing the speaker's lips moving suddenly makes a huge difference. That is inverse effectiveness -- and we found it in the zebrafish Tectum.

Watch how the multisensory boost changes with stimulus strength
V
A
V+A
Strong signals
+7%
V
A
V+A
Weak signals
+120%

When each signal alone is barely noticeable, combining them produces a disproportionately large improvement. This is exactly what we observed in both neural activity and escape behavior.

Two ways to flee

Zebrafish larvae do not just escape -- they choose how. We discovered that two distinct escape behaviors are differentially triggered by the type of sensory signal:

SLC

Short Latency C-start

  • Triggered mostly by sudden sounds
  • Ultra-fast: begins in ~5 ms
  • Powered by the giant Mauthner neuron
  • Explosive, stereotyped movement

LLC

Long Latency C-start

  • Triggered mostly by visual looming
  • Slower but still fast: ~20-30 ms
  • Driven by smaller hindbrain neurons
  • More flexible, adaptable movement

When both signals arrive together, the fish selects its escape type based on which signal is more salient. If the sound is louder, it performs a fast SLC. If the visual loom is more obvious, it opts for a flexible LLC. The brain is not just detecting danger -- it is choosing the best strategy for survival.

Reaction game: Match the right escape to each stimulus!
SLC and LLC behavior classification
Dimensionality reduction of kinematic features reveals two distinct clusters of escape behaviors: SLC (fast, sound-triggered) and LLC (flexible, vision-triggered). Data from 40 zebrafish larvae.

A new model for survival decisions

By linking brain activity to behavior, this thesis proposes a model for how the zebrafish brain transforms sensory signals into life-saving actions:

Vision
Tectum
Integration
Hindbrain
Escape!
Hearing

Key Findings

1

The Tectum is not just visual -- it robustly processes danger-signaling sounds, challenging decades of assumptions.

2

Combining sight and sound produces a multisensory enhancement in the Tectum, recruiting more neurons with stronger responses.

3

This enhancement follows inverse effectiveness: weak, ambiguous signals benefit the most from combination.

4

Tectal integration links directly to hindbrain motor circuits and predicts escape behavior.

5

Fish choose between fast (SLC) or flexible (LLC) escapes based on which sensory signal dominates -- a form of real-time survival strategy selection.

Beyond the fish tank

The Tectum of zebrafish is homologous to the Superior Colliculus in humans. The same multisensory integration principles discovered here operate in your brain right now, every time you combine what you see and hear to make sense of the world around you.

Understanding these circuits at a fundamental level -- neuron by neuron, in an intact living brain -- opens the door to understanding how sensory processing goes wrong in conditions like autism spectrum disorders, where multisensory integration is often altered.

This work also pioneered new methods: deep learning for animal tracking, semi-automatic neuron segmentation, and novel analysis pipelines -- tools now being used by other researchers in the lab to tackle new questions.

In vivo calcium imaging

Watching hundreds of neurons fire in real time in living larvae

Deep learning tracking

Training neural networks to track zebrafish pose at 437 fps

Brain atlas alignment

Mapping every neuron to a standardized brain reference

About this thesis

This PhD thesis was conducted at the SPIN Lab (Neural Processing and Integration Systems Lab), IFIBYNE (UBA/CONICET), Buenos Aires, Argentina, under the supervision of Dr. Violeta Medan.

Part of this work was carried out in the laboratory of Dr. German Sumbre at the Ecole Normale Superieure (IBENS), Paris, France.

Author: Lic. Nicolas Martorell

Advisor: Dra. Violeta Medan

University: Universidad de Buenos Aires, Facultad de Ciencias Exactas y Naturales

Year: 2025

Thanks for exploring. The zebrafish escapes to swim another day.