Realistic sound effects imply physical material by matching its harmonic signature

What it is

A button click can sound "metallic" or "plasticky," and an interface feedback tone can sound "solid" or "thin," without any accompanying image — people make material judgments from sound alone. Sound design that fabricates this sense of realism by reproducing the harmonic signature real materials produce when they vibrate is generally called foley or material-based sound design, and its effect rests on a real auditory capacity for inferring material from sound.

It's easy to treat this as a vague question of "does the effect sound realistic," but there is a concrete, actionable physical correspondence behind it: harmonic structure itself carries material information — this isn't association or metaphor.

Why it happens

When a real object is struck, scraped, or collided with, it produces a resonance pattern shaped by its own physical properties — mass, stiffness, whether it's hollow: hard, dense materials vibrate at higher frequencies with fast harmonic decay; hollow or soft materials vibrate at lower frequencies, concentrate more energy in low harmonics, and decay more slowly and "muddier." These differences show up in the sound's harmonic structure and decay curve, forming a distinct acoustic signature for each material.

Through long-term interaction with the physical world, the auditory system has built a stable mapping between this harmonic-decay pattern and material properties, so even with sound alone and no visual input, listeners can infer physical judgments — hard/soft, hollow/solid, metal/wood — from harmonic distribution and decay rate. A synthesized or sampled sound effect that reproduces the harmonic and decay signature of a target material triggers this same inference mechanism, producing the illusion of "this is that material."

Studying it

A typical approach plays sound alone to participants, with no visual information, and has them rate or choose material properties (soft/hard, hollow/solid, metal/wood, etc.); correlation or regression analysis then links those ratings to the sound's physical parameters (harmonic decay rate, spectral centroid, formant frequencies) to identify which acoustic features material judgments actually rely on.

Common independent variables: harmonic decay rate, spectral centroid location, formant frequency. Common dependent variables: material property ratings, judgment response time, judgment consistency.

Where it stops holding

• This inference relies on the listener's prior experience with real-world material-sound relationships; children or listeners with little exposure to the relevant materials typically show lower judgment accuracy and consistency.
• If a realistic sound effect matches harmonic structure but ignores onset-transient detail (the attack character of an impact) or the fine shape of the decay curve, the material illusion weakens — timbre isn't a single dimension, and harmonic distribution is just one layer of it; a full material illusion usually requires harmonics, transient, and decay to all be matched together.
• When a realistic sound effect conflicts with the material implied by accompanying visuals (metallic sound, plastic-looking image), how the auditory and visual information get integrated, and which one dominates, is a separate multisensory integration question outside the scope of this mechanism.

Applying it

• When designing interaction feedback sounds meant to convey a sense of material (simulating a physical switch, paper rustling, metal-on-glass contact), prioritize matching the harmonic decay rate and spectral centroid of the real target material over adjusting volume or simple pitch by intuition alone.
• If a product wants to use sound to imply a quality positioning (low frequency, long decay implying "solid and reliable"; high frequency, short decay implying "light and agile"), the corresponding material's harmonic-decay pattern is a directly usable starting point for the design, to be fine-tuned subjectively afterward.
• Verification: play the candidate sound effect alone, with no visuals, and ask listeners to name the material or texture it brings to mind, checking whether it matches the design intent; if most listeners' associations don't match expectations, the problem is usually in the harmonic decay curve, not the loudness or pitch setting.

Related

• Same group: A3.12.1 Timbre is set by the harmonic structure above the fundamental, and is the primary cue for telling sources apart · A3.12.2 Lossy compression that discards harmonic detail changes timbre, not just loudness · A3.12.4 Voice quality shapes listeners' subjective judgment of content credibility
• Nearby: A3.07 Distinguishability of alarm sounds
• Search terms: foley · sound synthesis of materials · auditory material perception · spectral centroid