A look at the auditory scene analysis from the window of event related potentials
Abstract
Background and Aim: Foundations and mechanisms of auditory scene analysis (ASA) including segregation and integration were especially reviewed in the study. I focused on the related studies using event-related potentials (ERPs).
Recent Findings: Publications on ASA using ERPs from 1971 to 2014 indicate neural mechanisms of ASA in central auditory system.
Conclusion: ASA results in recognition of different sound stimuli in the competing sound environment. The neural mechanisms of this process could be studied comprehensively using ERPs with good temporal resolution.
1. Bregman AS. Auditory scene analysis: the perceptual organization of sound. 1st ed. Cambridge, MA: MIT Press; 1994.
2. Bregman AS. Auditory scene analysis. In: Basbaum IA, Kaneko A, Shepherd GM, Westheimer G, editors. The senses: a comprehensive reference. San Diego, CA: Academic Press; 2008. p. 861-70.
3. Koffka K. International library of psychology: principles of gestalt psychology. 1st ed. New York: Routledge; 1999.
4. Winkler I, Kushnerenko E, Horváth J, Ceponiene R, Fellman V, Huotilainen M, et al. Newborn infants can organize the auditory world. Proc Natl Acad Sci U S A. 2003;100(20):11812-5.
5. Hulse SH, MacDougall-Shackleton SA, Wisniewski AB. Auditory scene analysis by songbirds: stream segregation of birdsong by European starlings (Sturnus vulgaris). J Comp Psychol. 1997;111(1):3-13.
6. MacDougall-Shackleton SA, Hulse SH, Ball GF. Neural correlates of singing behavior in male zebra finches (Taeniopygia guttata). J Neurobiol. 1998;36(3):421-30.
7. Fishman YI, Reser DH, Arezzo JC, Steinschneider M. Neural correlates of auditory stream segregation in primary auditory cortex of the awake monkey. Hear Res. 2001;151(1-2):167-87.
8. Talebi H, Moossavi A, Lotfi Y, Faghihzadeh S. Effects of vowel auditory training on concurrent speech segregation in hearing impaired children. Ann Otol Rhinol Laryngol. 2015;124(1):13-20.
9. Talebi H, Mehrkian S. Auditory attention: foundations, theories, and mechanisms. Audiol. 2013;22(2):1-16. Persian.
10. Hillyard SA, Squires KC, Bauer JW, Lindsay PH. Evoked potential correlates of auditory signal detection. Science. 1971;172(3990):1357-60.
11. Martin BA, Sigal A, Kurtzberg D, Stapells DR. The effects of decreased audibility produced by high-pass noise masking on cortical event-related potentials to speech sounds /ba/ and /da/. J Acoust Soc Am. 1997;101(3):1585-99.
12. Martin BA, Boothroyd A. Cortical, auditory, event-related potentials in response to periodic and aperiodic stimuli with the same spectral envelope. Ear Hear. 1999;20(1):33-44.
13. Martin BA, Tremblay KL, Stapells DR. Principles and applications of cortical auditory evoked potentials. In: Burkard RF, Eggermont JJ, Don M editors. Auditory evoked potentials: basic principles and clinical application. 1st ed. Philadelphia: Lippincott Williams & Wilkins; 2007. p. 482-507.
14. Sharma A, Dorman MF. Cortical auditory evoked potential correlates of categorical perception of voice-onset time. J Acoust Soc Am. 1999;106(2):1078-83.
15. Sharma A, Dorman MF. Neurophysiologic correlates of cross-language phonetic perception. J Acoust Soc Am. 2000;107(5 Pt 1):2697-703.
16. Vaughan HG Jr, Ritter W. The sources of auditory evoked responses recorded from the human scalp. Electroencephalogr Clin Neurophysiol. 1970;28(4):360-7.
17. Wood CC, Wolpaw JR. Scalp distribution of human auditory evoked potentials. II. Evidence for overlapping sources and involvement of auditory cortex. Electroencephalogr Clin Neurophysiol. 1982;54(1):25-38.
18. Woods D. The component structure of the N1 wave of the human auditory evoked potential. In: Karmos G, Molnar M, Csepe V, Czigler I, Desmedt J, editors. Perspectives of event-related potentials research. Amstrdam: Elsevier; 1995. p. 102-9.
19. Escera C, Grau C. Short-term replicability of the mismatch negativity. Electroencephalogr Clin Neurophysiol. 1996;100(6):549-54.
20. Tremblay K, Kraus N, McGee T, Ponton C, Otis B. Central auditory plasticity: changes in the N1-P2 complex after speech-sound training. Ear Hear. 2001;22(2):79-90.
21. Näätänen R, Picton T. The N1 wave of the human electric and magnetic response to sound: A review and analysis of the component structure. Psychophysiology. 1987;24(4):375-425.
22. Wolpaw JR, Penry JK. A temporal component of the auditory evoked response. Electroencephalogr Clin Neurophysiol. 1975;39(6):609-20.
23. Ostroff JM, Martin BA, Boothroyd A. Cortical responses to acoustic change within a syllable. Ear Hear. 1998;19(4):290-7.
24. Whiting KA, Martin BA, Stapells DR. The effects of broadband noise masking on cortical event-related potentials to speech sounds /ba/ and /da/. Ear Hear. 1998;19(3):218-31.
25. Talebi H, Moossavi A, Lotfi Y, Faghihzadeh S. Concurrent speech segregation problems in hearing impaired children. Journal of Rehabilitation. 2014;15(1):77-84.
26. Ohl FW, Scheich H. Orderly cortical representation of vowels based on formant interactron. Proc Natl Acad Sci U S A. 1997;94(17):9440-4.
27. Gutschalk A, Micheyl C, Melcher JR, Rupp A, Scherg M, Oxenham AJ. Neuromagnetic correlates of streaming in human auditory cortex. J Neurosci. 2005;25(22):5382-8.
28. Näätänen R, Tervaniemi M, Sussman E, Paavilainen I, Winkler I. Pre–attentive cognitive processing (“primitive intelligence”) in the auditory cortex as revealed by the mismatch negativity (MMN). Trends in Neuroscience. 2001;24(5):283-8.
29. Javitt DC, Steinschneider M, Schroeder CE, Vaughan HG Jr, Arezzo JC. Detection of stimulus deviance within primate primary auditory cortex: intracortical mechanisms of mismatch negativity (MMN) generation. Brain Res. 1994;667(2):192-200.
30. Javitt DC, Steinschneider M, Schroeder CE, Arezzo JC. Role of cortical N-methyl-D-aspartate receptors in auditory sensory memory and mismatch-negativity generation: Implications for schizophrenia. Proc Natl Acad Sci U S A. 1996;93(21):11962-7.
31. Sussman E, Ritter W, Vaughan HG Jr. Attention affects the organization of auditory input associated with the mismatch negativity system. Brain Res. 1998;789(1):130-8.
32. Sussman E , Ritter W, Vaughan HG Jr. An investigation of the auditory streaming effect using event-related brain potentials. Psychophysiology. 1999;36(1):22-34.
33. Ritter W, Sussman E, Molholm S. Evidence that the mismatch negativity system works on the basis of objects. Neuroreport. 2000;11(1):61-3.
34. Sussman E, Winkler I. Dynamic sensory updating in the auditory system. Brain Res Cogn Brain Res. 2001;12(3):431-9.
35. Snyder JS, Alain C. Age-related changes in neural activity associated with concurrent vowel segregation. Brain Res Cogn Brain Res. 2005;24(3):492-9.
36. Sussman E, Ceponiene R, Shestakova A, Näätänen R, Winkler I. Auditory stream segregation processes operate similarly in school-aged children and adults. Hear Res. 2001;153(1-2):108-14.
37. Sussman E, Winkler I, Huoutilainen M, Ritter W, Näätänen R. Top-down effects can modify the initially stimulus-driven auditory organization. Brain Res Cogn Brain Res. 2002;13(3):393-405.
38. Tiitinen H, May P, Reinikainen K, Näätänen R. Attentive novelty detection in humans is governed by pre-attentive sensory memory. Nature. 1994;372(6501):90-2.
39. Kujala T, Halmetoja J, Näätänen R, Alku P, Lyytinen H, Sussman E. Speech- and sound-segmentation in dyslexia: evidence for a multiple-level cortical impairment. Eur J Neurosci. 2006;24(8):2420-7.
40. Lepistö T, Kuitunen A, Sussman E, Saalasti S, Jansson-Verkasalo E, Nieminen-von Wendt T, et al. Auditory stream segregation in children with Asperger syndrome. Biol Psychol. 2009;82(3):301-7.
41. Hartmann WM. Pitch, periodicity. and auditory organization. J Acoust Soc Am. 1996;100(6):3491-502.
42. Hartmann WM, McAdams S, Smith BK. Hearing a mistuned harmonic in an otherwise periodic complex tone. J Acoust Soc Am. 1990;88(4):1712-24.
43. Alain C, McDonald KL, Ostroff JM, Schneider B. Age-related changes in detecting a mistuned harmonic. J Acoust Soc Am. 2001;109(5 Pt 1):2211-6.
44. Alain C, Theunissen EL, Chevalier H, Batty M, Taylor MJ. Developmental changes in distinguishing concurrent auditory objects. Brain Res Cogn Brain Res. 2003;16(2):210-8.
45. Alain C, Arnott SR, Picton TW. Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials. J Exp Psychol Hum Percept Perform. 2001;27(5):1072-89.
46. Picton TW, Alain C, Otten L, Ritter W, Achim A. Mismatch negativity: different water in the same river. Audiol Neurootol. 2000;5(3-4):111-39.
47. Alain C, Izenberg A. Effects of attentional load on auditory scene analysis. J Cogn Neurosci. 2003;15(7):1063-73.
48. Assmann PF, Summerfield Q. Modeling the perception of concurrent vowels: vowels with different fundamental frequencies. J Acoust Soc Am. 1990;88(2):680-97.
49. Assmann PF, Summerfield Q. The contribution of waveform interactions to the perception of concurrent vowels. J Acoust Soc Am. 1994;95(1):471-84.
50. Talebi H, Moossavi A, Faghihzadeh S. Concurrent auditory perception difficulties in older adults with right hemisphere cerebrovascular accident. MJIRI. 2014;28(130):1-7.
51. Reinke KS, He Y, Wang C, Alain C. Perceptual learning modulates sensory evoked response during vowel segregation. Brain Res Cogn Brain Res. 2003;17(3):781-91.
52. Divenyi PL, Haupt KM. Audiological correlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. I. Age and lateral asymmetry effects. Ear Hear. 1997;18(1):42-61.
53. Divenyi PL, Haupt KM. Audiological correlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. II. Correlation analysis. Ear Hear. 1997;18(2):100-13.
54. Divenyi PL, Haupt KM. . Audiological comlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. III. Factor represenlation. Ear Hear. 1997;18(3):189-201.
55. Grimault N, Micheyl C, Carlyon RP, Arthaud P, Collet L Perceptual auditory stream segregation of sequences of complex sounds in subjects with normal and impaired hearing. Br J Audiol. 2001;35(3):173-82.
56. Helenius P, Tarkiainen A, Cornelissen P, Hansen PC, Salmelin R. Dissociation of normal feature analysis and deficient processing of letter-strings in dyslexic adults. Cereb Cortex. 1999;9(5):476-83.
57. Sutter ML, Petkov C, Baynes K, O'Connor KN. Auditory scene analysis in dyslexics. Neuroreport. 2000;11(9):1967-71.
58. Burkard RF, Don M, Eggermont JJ. Auditory evoked potentials: basic principles and clinical application. 1st. ed. Baltimore: Point Lippincott Williams & Wilkins; 2007.
59. Hall JW. New Handbook of Auditory Evoked Responses. 1st ed. Boston: Pearson; 2006.
60. Alain C, Bernstein LJ. From sounds to meaning: the role of attention during auditory scene analysis. Curr Opin Otolaryngol Head Neck Surg. 2008;16(5):485-9.
2. Bregman AS. Auditory scene analysis. In: Basbaum IA, Kaneko A, Shepherd GM, Westheimer G, editors. The senses: a comprehensive reference. San Diego, CA: Academic Press; 2008. p. 861-70.
3. Koffka K. International library of psychology: principles of gestalt psychology. 1st ed. New York: Routledge; 1999.
4. Winkler I, Kushnerenko E, Horváth J, Ceponiene R, Fellman V, Huotilainen M, et al. Newborn infants can organize the auditory world. Proc Natl Acad Sci U S A. 2003;100(20):11812-5.
5. Hulse SH, MacDougall-Shackleton SA, Wisniewski AB. Auditory scene analysis by songbirds: stream segregation of birdsong by European starlings (Sturnus vulgaris). J Comp Psychol. 1997;111(1):3-13.
6. MacDougall-Shackleton SA, Hulse SH, Ball GF. Neural correlates of singing behavior in male zebra finches (Taeniopygia guttata). J Neurobiol. 1998;36(3):421-30.
7. Fishman YI, Reser DH, Arezzo JC, Steinschneider M. Neural correlates of auditory stream segregation in primary auditory cortex of the awake monkey. Hear Res. 2001;151(1-2):167-87.
8. Talebi H, Moossavi A, Lotfi Y, Faghihzadeh S. Effects of vowel auditory training on concurrent speech segregation in hearing impaired children. Ann Otol Rhinol Laryngol. 2015;124(1):13-20.
9. Talebi H, Mehrkian S. Auditory attention: foundations, theories, and mechanisms. Audiol. 2013;22(2):1-16. Persian.
10. Hillyard SA, Squires KC, Bauer JW, Lindsay PH. Evoked potential correlates of auditory signal detection. Science. 1971;172(3990):1357-60.
11. Martin BA, Sigal A, Kurtzberg D, Stapells DR. The effects of decreased audibility produced by high-pass noise masking on cortical event-related potentials to speech sounds /ba/ and /da/. J Acoust Soc Am. 1997;101(3):1585-99.
12. Martin BA, Boothroyd A. Cortical, auditory, event-related potentials in response to periodic and aperiodic stimuli with the same spectral envelope. Ear Hear. 1999;20(1):33-44.
13. Martin BA, Tremblay KL, Stapells DR. Principles and applications of cortical auditory evoked potentials. In: Burkard RF, Eggermont JJ, Don M editors. Auditory evoked potentials: basic principles and clinical application. 1st ed. Philadelphia: Lippincott Williams & Wilkins; 2007. p. 482-507.
14. Sharma A, Dorman MF. Cortical auditory evoked potential correlates of categorical perception of voice-onset time. J Acoust Soc Am. 1999;106(2):1078-83.
15. Sharma A, Dorman MF. Neurophysiologic correlates of cross-language phonetic perception. J Acoust Soc Am. 2000;107(5 Pt 1):2697-703.
16. Vaughan HG Jr, Ritter W. The sources of auditory evoked responses recorded from the human scalp. Electroencephalogr Clin Neurophysiol. 1970;28(4):360-7.
17. Wood CC, Wolpaw JR. Scalp distribution of human auditory evoked potentials. II. Evidence for overlapping sources and involvement of auditory cortex. Electroencephalogr Clin Neurophysiol. 1982;54(1):25-38.
18. Woods D. The component structure of the N1 wave of the human auditory evoked potential. In: Karmos G, Molnar M, Csepe V, Czigler I, Desmedt J, editors. Perspectives of event-related potentials research. Amstrdam: Elsevier; 1995. p. 102-9.
19. Escera C, Grau C. Short-term replicability of the mismatch negativity. Electroencephalogr Clin Neurophysiol. 1996;100(6):549-54.
20. Tremblay K, Kraus N, McGee T, Ponton C, Otis B. Central auditory plasticity: changes in the N1-P2 complex after speech-sound training. Ear Hear. 2001;22(2):79-90.
21. Näätänen R, Picton T. The N1 wave of the human electric and magnetic response to sound: A review and analysis of the component structure. Psychophysiology. 1987;24(4):375-425.
22. Wolpaw JR, Penry JK. A temporal component of the auditory evoked response. Electroencephalogr Clin Neurophysiol. 1975;39(6):609-20.
23. Ostroff JM, Martin BA, Boothroyd A. Cortical responses to acoustic change within a syllable. Ear Hear. 1998;19(4):290-7.
24. Whiting KA, Martin BA, Stapells DR. The effects of broadband noise masking on cortical event-related potentials to speech sounds /ba/ and /da/. Ear Hear. 1998;19(3):218-31.
25. Talebi H, Moossavi A, Lotfi Y, Faghihzadeh S. Concurrent speech segregation problems in hearing impaired children. Journal of Rehabilitation. 2014;15(1):77-84.
26. Ohl FW, Scheich H. Orderly cortical representation of vowels based on formant interactron. Proc Natl Acad Sci U S A. 1997;94(17):9440-4.
27. Gutschalk A, Micheyl C, Melcher JR, Rupp A, Scherg M, Oxenham AJ. Neuromagnetic correlates of streaming in human auditory cortex. J Neurosci. 2005;25(22):5382-8.
28. Näätänen R, Tervaniemi M, Sussman E, Paavilainen I, Winkler I. Pre–attentive cognitive processing (“primitive intelligence”) in the auditory cortex as revealed by the mismatch negativity (MMN). Trends in Neuroscience. 2001;24(5):283-8.
29. Javitt DC, Steinschneider M, Schroeder CE, Vaughan HG Jr, Arezzo JC. Detection of stimulus deviance within primate primary auditory cortex: intracortical mechanisms of mismatch negativity (MMN) generation. Brain Res. 1994;667(2):192-200.
30. Javitt DC, Steinschneider M, Schroeder CE, Arezzo JC. Role of cortical N-methyl-D-aspartate receptors in auditory sensory memory and mismatch-negativity generation: Implications for schizophrenia. Proc Natl Acad Sci U S A. 1996;93(21):11962-7.
31. Sussman E, Ritter W, Vaughan HG Jr. Attention affects the organization of auditory input associated with the mismatch negativity system. Brain Res. 1998;789(1):130-8.
32. Sussman E , Ritter W, Vaughan HG Jr. An investigation of the auditory streaming effect using event-related brain potentials. Psychophysiology. 1999;36(1):22-34.
33. Ritter W, Sussman E, Molholm S. Evidence that the mismatch negativity system works on the basis of objects. Neuroreport. 2000;11(1):61-3.
34. Sussman E, Winkler I. Dynamic sensory updating in the auditory system. Brain Res Cogn Brain Res. 2001;12(3):431-9.
35. Snyder JS, Alain C. Age-related changes in neural activity associated with concurrent vowel segregation. Brain Res Cogn Brain Res. 2005;24(3):492-9.
36. Sussman E, Ceponiene R, Shestakova A, Näätänen R, Winkler I. Auditory stream segregation processes operate similarly in school-aged children and adults. Hear Res. 2001;153(1-2):108-14.
37. Sussman E, Winkler I, Huoutilainen M, Ritter W, Näätänen R. Top-down effects can modify the initially stimulus-driven auditory organization. Brain Res Cogn Brain Res. 2002;13(3):393-405.
38. Tiitinen H, May P, Reinikainen K, Näätänen R. Attentive novelty detection in humans is governed by pre-attentive sensory memory. Nature. 1994;372(6501):90-2.
39. Kujala T, Halmetoja J, Näätänen R, Alku P, Lyytinen H, Sussman E. Speech- and sound-segmentation in dyslexia: evidence for a multiple-level cortical impairment. Eur J Neurosci. 2006;24(8):2420-7.
40. Lepistö T, Kuitunen A, Sussman E, Saalasti S, Jansson-Verkasalo E, Nieminen-von Wendt T, et al. Auditory stream segregation in children with Asperger syndrome. Biol Psychol. 2009;82(3):301-7.
41. Hartmann WM. Pitch, periodicity. and auditory organization. J Acoust Soc Am. 1996;100(6):3491-502.
42. Hartmann WM, McAdams S, Smith BK. Hearing a mistuned harmonic in an otherwise periodic complex tone. J Acoust Soc Am. 1990;88(4):1712-24.
43. Alain C, McDonald KL, Ostroff JM, Schneider B. Age-related changes in detecting a mistuned harmonic. J Acoust Soc Am. 2001;109(5 Pt 1):2211-6.
44. Alain C, Theunissen EL, Chevalier H, Batty M, Taylor MJ. Developmental changes in distinguishing concurrent auditory objects. Brain Res Cogn Brain Res. 2003;16(2):210-8.
45. Alain C, Arnott SR, Picton TW. Bottom-up and top-down influences on auditory scene analysis: evidence from event-related brain potentials. J Exp Psychol Hum Percept Perform. 2001;27(5):1072-89.
46. Picton TW, Alain C, Otten L, Ritter W, Achim A. Mismatch negativity: different water in the same river. Audiol Neurootol. 2000;5(3-4):111-39.
47. Alain C, Izenberg A. Effects of attentional load on auditory scene analysis. J Cogn Neurosci. 2003;15(7):1063-73.
48. Assmann PF, Summerfield Q. Modeling the perception of concurrent vowels: vowels with different fundamental frequencies. J Acoust Soc Am. 1990;88(2):680-97.
49. Assmann PF, Summerfield Q. The contribution of waveform interactions to the perception of concurrent vowels. J Acoust Soc Am. 1994;95(1):471-84.
50. Talebi H, Moossavi A, Faghihzadeh S. Concurrent auditory perception difficulties in older adults with right hemisphere cerebrovascular accident. MJIRI. 2014;28(130):1-7.
51. Reinke KS, He Y, Wang C, Alain C. Perceptual learning modulates sensory evoked response during vowel segregation. Brain Res Cogn Brain Res. 2003;17(3):781-91.
52. Divenyi PL, Haupt KM. Audiological correlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. I. Age and lateral asymmetry effects. Ear Hear. 1997;18(1):42-61.
53. Divenyi PL, Haupt KM. Audiological correlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. II. Correlation analysis. Ear Hear. 1997;18(2):100-13.
54. Divenyi PL, Haupt KM. . Audiological comlates of speech understanding deficits in elderly listeners with mild-to-moderate hearing loss. III. Factor represenlation. Ear Hear. 1997;18(3):189-201.
55. Grimault N, Micheyl C, Carlyon RP, Arthaud P, Collet L Perceptual auditory stream segregation of sequences of complex sounds in subjects with normal and impaired hearing. Br J Audiol. 2001;35(3):173-82.
56. Helenius P, Tarkiainen A, Cornelissen P, Hansen PC, Salmelin R. Dissociation of normal feature analysis and deficient processing of letter-strings in dyslexic adults. Cereb Cortex. 1999;9(5):476-83.
57. Sutter ML, Petkov C, Baynes K, O'Connor KN. Auditory scene analysis in dyslexics. Neuroreport. 2000;11(9):1967-71.
58. Burkard RF, Don M, Eggermont JJ. Auditory evoked potentials: basic principles and clinical application. 1st. ed. Baltimore: Point Lippincott Williams & Wilkins; 2007.
59. Hall JW. New Handbook of Auditory Evoked Responses. 1st ed. Boston: Pearson; 2006.
60. Alain C, Bernstein LJ. From sounds to meaning: the role of attention during auditory scene analysis. Curr Opin Otolaryngol Head Neck Surg. 2008;16(5):485-9.
| Files | ||
| Issue | Vol 24 No 3 (2015) | |
| Section | Review Article(s) | |
| Keywords | ||
| Auditory scene analysis event-related potentials segregation integration | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
How to Cite
1.
Talebi H. A look at the auditory scene analysis from the window of event related potentials. Aud Vestib Res. 2015;24(3):110-119.
