nemo
/
hn-classics
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
hn-classics/_stories/2007/10093257.md

16 KiB
Raw Permalink Blame History

created_at title url author points story_text comment_text num_comments story_id story_title story_url parent_id created_at_i _tags objectID year
2015-08-20T17:19:53.000Z An Introduction to Sine-Wave Speech (2007) http://www.mrc-cbu.cam.ac.uk/people/matt.davis/sine-wave-speech/ codezero 63 16 1440091193
story
author_codezero
story_10093257
10093257 2007

Source

People

skip to primary navigation skip to content

[View menu][3] [Search][4] [ ![University of Cambridge][5] ][6]

  • [Study at Cambridge][7]
  • [About the University][8]
  • [Research at Cambridge][9]

Quick LinksFor staff For alumni For business Colleges & departments Libraries & facilities Museums & collections Email & phone search

Search site

[Home][3]

  • [Study at Cambridge][10]
  • [Undergraduate][11]
    • [Courses][12]
    • [Applying][13]
    • [Events and open days][14]
    • [Fees and finance][15]
    • [Student blogs and videos][16]
  • [Graduate][17]
    • [Why Cambridge][18]
    • [Qualifications directory][19]
    • [How to apply][20]
    • [Fees and funding][21]
    • [Frequently asked questions][22]
  • [International students][23]
  • [Continuing education][24]
  • [Executive and professional education][25]
  • [Courses in education][26]
  • [About the University][27]
  • [How the University and Colleges work][28]
  • [History][29]
  • [Visiting the University][30]
  • [Term dates and calendars][31]
  • [Map][32]
  • [For media][33]
  • [Video and audio][34]
  • [Find an expert][35]
  • [Publications][36]
  • [International Cambridge][37]
  • [News][38]
  • [Events][39]
  • [Public engagement][40]
  • [Jobs][41]
  • [Giving to Cambridge][42]
  • [Research at Cambridge][3]
  • [For staff][43]
  • [For current students][44]
  • [For alumni][45]
  • [For business][46]
  • [Colleges & departments][47]
  • [Libraries & facilities][48]
  • [Museums & collections][49]
  • [Email & phone search][50]

[Home][6] / [MRC Cognition and Brain Sciences Unit][51] / People

[ Home][51]

![][52]MRC Cognition and Brain Sciences Unit

Using cognitive theory and innovations in neuroscience to understand and improve mental wellbeing across the lifespan

  • [Home][53]
  • [The Unit][54]
    • [About us][55]
    • [Our mission][56]
    • [Centre for Attention, Learning and Memory (CALM)][57]
    • [Cambridge Centre for Ageing & Neuroscience (CamCAN)][58]
    • [Cambridge Clinical Research Centre for Affective Disorders (C2AD)][59]
    • [Facilities][60]
    • [Unit history][61]
    • [Visiting the unit][62]
    • [Equality][63]
    • [Vacancies][64]
    • [Working at the MRC CBU][65]
  • [Research][66]
    • [Our research][66]
    • [Improving health and wellbeing][67]
    • [Publications][68]
    • [Methods and resources][69]
    • [Imaging analysis][70]
    • [Open Science at the MRC CBU][71]
  • [People][72]
    • [All][72]
    • [Programme Leaders][73]
    • [Research staff][74]
    • [Students][75]
    • [Support staff][76]
    • [Honorary Members][77]
    • [Alumni][78]
  • [Take part][79]
  • [Studentships][80]
  • [News][81]
  • [Events][82]
    • [Seminar information][83]
    • [Chaucer club][84]
    • [Wednesday lunchtime seminars][85]
    • [Cambridge graduate programme][86]
    • [Statistics seminars][87]
    • [External conferences][88]
    • [Calendar][89]
  • [Contact us][90]

People

*** PLEASE READ ************************************** THIS PAGE HAS BEEN IMPORTED FROM THE OLD SITE. FORMATTING IS MAINTAINED BY AN EXTERNAL STYLESHEET. WHEN YOU EDIT THIS PAGE, YOU MAY WANT TO REMOVE THE REFERENCE TO THIS STYLESHEET AND UPDATE THE FORMATTING. ******************************************************

**An Introduction to Sine-Wave Speech
**Matt Davis

MRC Cognition and Brain Sciences Unit
Chaucer Road
Cambridge CB2 7EF.

1) Introduction:

Sine-wave speech is a form of artificially degraded speech first developed at [Haskins Laboratory][91]. Several seminal experiments on the perception of sine-wave speech are described here:

Remez, R.E., Rubin, P.E., Pisoni, D.B., Carrell, T.D. (1981) Speech perception without traditional speech cues. Science, 212, 947-9. [PubMed][92]

In this work, Remez and colleagues demonstrated a dramatic change in the way in which sine-wave speech sentences are perceived, depending on listener's specific prior knowledge. For instance, listen to this sound:

![SWS][93]

Most naive listeners hear this as a set of simultaneous whistles, or science fiction sounds. However, for listeners that have previously heard this sound:

![SWS][93]

Listening to the sine-wave speech sound again produces a very different percept of a fully intelligible spoken sentence. This dramatic change in perception is an example of "perceptual insight" or pop-out. We have argued that this form of pop-out is an example of a top-down perceptual process produced by higher-level knowledge and expectations concerning sounds that can potentially be heard as speech:

Davis, M.H., Johnsrude, I.S. (2007) "Hearing speech sounds: Top-down influences on the interface between audition and speech perception." Hearing Research, 229(1-2), 132-147. [PDF][94].

There are four more example pairs of sine-wave and clear speech in the table below:

| ----- | |

Sine-Wave Speech

|

Clear Speech

|
|

![SWS][93]

|

![SWS][93]

|
|

![SWS][93]

|

![SWS][93]

|
|

![SWS][93]

|

![SWS][93]

|
|

![SWS][93]

|

![SWS][93]

|

As you listen to these four examples, you may find that you get better at understanding the sine-wave speech first time around. This is an example of perceptual learning. Having heard several examples of sine-wave speech, your perceptual system has tuned into this form of distortion, so as to be able to perceive new sine-wave speech sentences more clearly.

To my knowledge, no one has done controlled experiments to demonstrate that pop-out helps with learning sine-wave speech. However, for another form of distortion (noise-vocoded speech), we have shown that pop-out enhances perceptual learning so that people more rapidly learn to understand new distorted sentences. These experiments with [vocoded speech][95] suggest that perceptual learning is also a top-down process:

Davis, M.H., Johnsrude, I.S., Hervais-Adelman, A., Taylor, K. & McGettigan, C.M. (2005) Lexical information drives perceptual learning of distorted speech: Evidence from the comprehension of noise-vocoded sentences. Journal of Experimental Psychology: General, 134(2), 222-241. [PDF][96].

2) Generating Sine-Wave Speech:

Sine-wave speech is generated by using a formant tracker to detect the formant frequencies found in an utterance, and then synthesising sine waves that track the centre of these formants. This is illustrated in the figures below:

![Stages _fcksavedurl=figure.jpg alt=][97]

A number of pieces of software exist for generating sine-wave versions of utterances. These sentences shown above were generated using [Praat software][98] and a [script][99] written by [Chris Darwin.][99] There's also [Matlab][100] code to [generate sine-wave speech][101] written by [Dan Ellis][102].

3) Other forms of perceptual insight:

There are a number of examples of perceptual insight in the visual domain that have been documented. For instance, turning grey-scale images into high contrast, black/white images can produce a similar phenomenon to sine-wave speech. This manipulation was originally described by Craig Mooney (1957).

![Mooney Figure][103]

Click on the image to receive a visual hint about the content of this image. This form of visual perceptual insight is discussed in greater detail by [Nava Rubin][104] in this paper:

Rubin, N., Nakayama, K. and Shapley, R. (2002), The role of insight in perceptual learning: evidence from illusory contour perception. In: Perceptual Learning, Fahle, M. and Poggio, T. (Eds.), MIT Press.

Which is where the example image above comes from. I'd be keen to hear of forms of perceptual insight, in other sensory modalities.

4) Media reports of this work:

[New Scientist][105], [Mind Hacks][106], [Boing Boing][107]

This page was last updated on 24th November 2007. Comments and suggestions to matt.davis@mrc-cbu.cam.ac.uk.

![calm][108]

Quick links

  • [Contact Us][90]
  • [Home][53]
  • [News][109]
  • [Vacancies][64]

Useful information

  • [Cookies][110]
  • [policies][111]
  • [Wireless Access][112]

Our research sites

![calm][113]

The Centre for Attention, Learning and Memory (CALM)

![c2ad][114]

The Cambridge Clinical Research Centre in Affective Disorders.

![cancan][115]

Cambridge Centre for Ageing and Neuroscience.

Contact us

[15 Chaucer Road, Cambridge, CB2 7EF][116]

Email: info@mrc-cbu.cam.ac.uk
Tel: (+44) (0)1223 355294

Follow us on social media

![facebookcbsu][117]![twittercbsu][118]

![University of Cambridge][5]

© 2018 University of Cambridge

  • [University A-Z][119]
  • [Contact the University][120]
  • [Accessibility][121]
  • [Freedom of information][122]
  • [Terms and conditions][123]

[Study at Cambridge][10]

  • [Undergraduate][11]
  • [Graduate][17]
  • [International students][23]
  • [Continuing education][24]
  • [Executive and professional education][25]
  • [Courses in education][26]

[About the University][27]

  • [How the University and Colleges work][28]
  • [Visiting the University][30]
  • [Map][32]
  • [News][38]
  • [Events][39]
  • [Jobs][41]
  • [Giving to Cambridge][42]

[Research at Cambridge][9]

  • [News][124]
  • [Features][125]
  • [Discussion][126]
  • [Spotlight on...][127]
  • [About research at Cambridge][128]

genesis();

[3]: [4]: http://www.mrc-cbu.cam.ac.uk# [5]: http://www.mrc-cbu.cam.ac.uk/wp-content/themes/Project-Light-WP-master%204/images/interface/main-logo-small.png [6]: https://www.cam.ac.uk [7]: http://www.mrc-cbu.cam.ac.uk#study-with-us [8]: http://www.mrc-cbu.cam.ac.uk#about-the-university [9]: https://www.cam.ac.uk/research [10]: https://www.cam.ac.uk/study-at-cambridge [11]: https://www.study.cam.ac.uk/undergraduate/ [12]: https://www.study.cam.ac.uk/undergraduate/courses/ [13]: https://www.study.cam.ac.uk/undergraduate/apply/ [14]: https://www.study.cam.ac.uk/undergraduate/events/ [15]: https://www.study.cam.ac.uk/undergraduate/finance/ [16]: https://www.becambridge.com/ [17]: https://www.admin.cam.ac.uk/students/gradadmissions/prospec/ [18]: https://www.admin.cam.ac.uk/students/gradadmissions/prospec/whycam/ [19]: https://www.admin.cam.ac.uk/students/gradadmissions/prospec/studying/qualifdir/ [20]: https://www.admin.cam.ac.uk/students/gradadmissions/prospec/apply/ [21]: https://www.admin.cam.ac.uk/students/studentregistry/fees/ [22]: https://www.admin.cam.ac.uk/students/gradadmissions/prospec/faq/index.html [23]: https://www.cam.ac.uk/about-the-university/international-cambridge/studying-at-cambridge [24]: https://www.ice.cam.ac.uk [25]: https://www.admin.cam.ac.uk/offices/education/epe/ [26]: https://www.educ.cam.ac.uk [27]: https://www.cam.ac.uk/about-the-university [28]: https://www.cam.ac.uk/about-the-university/how-the-university-and-colleges-work [29]: https://www.cam.ac.uk/about-the-university/history [30]: https://www.cam.ac.uk/about-the-university/visiting-the-university [31]: https://www.cam.ac.uk/about-the-university/term-dates-and-calendars [32]: https://map.cam.ac.uk [33]: https://www.cam.ac.uk/for-media [34]: https://www.cam.ac.uk/video-and-audio [35]: https://webservices.admin.cam.ac.uk/faesearch/map.cgi [36]: https://www.cam.ac.uk/about-the-university/publications [37]: https://www.cam.ac.uk/about-the-university/international-cambridge [38]: https://www.cam.ac.uk/news [39]: https://www.admin.cam.ac.uk/whatson [40]: https://www.cam.ac.uk/public-engagement [41]: https://www.jobs.cam.ac.uk [42]: https://www.philanthropy.cam.ac.uk [43]: https://www.cam.ac.uk/for-staff [44]: https://www.admin.cam.ac.uk/students/gateway [45]: https://www.alumni.cam.ac.uk [46]: https://www.cam.ac.uk/for-business [47]: https://www.cam.ac.uk/colleges-and-departments [48]: https://www.cam.ac.uk/libraries-and-facilities [49]: https://www.cam.ac.uk/museums-and-collections [50]: https://www.cam.ac.uk/email-and-phone-search [51]: http://www.mrc-cbu.cam.ac.uk [52]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/2012/11/WG10-CMYK-CBSU-2-012.png [53]: http://www.mrc-cbu.cam.ac.uk/ [54]: http://www.mrc-cbu.cam.ac.uk/about-us/ "The Unit" [55]: http://www.mrc-cbu.cam.ac.uk/about-us/ [56]: http://www.mrc-cbu.cam.ac.uk/our-mission/ [57]: http://calm.mrc-cbu.cam.ac.uk [58]: http://www.cam-can.org/ [59]: http://c2ad.mrc-cbu.cam.ac.uk/ [60]: http://www.mrc-cbu.cam.ac.uk/facilities/ [61]: http://www.mrc-cbu.cam.ac.uk/history/ [62]: http://www.mrc-cbu.cam.ac.uk/visiting-the-unit/ [63]: http://www.mrc-cbu.cam.ac.uk/equality/ [64]: http://www.mrc-cbu.cam.ac.uk/vacancies/ [65]: http://www.mrc-cbu.cam.ac.uk/working-at-the-mrc-cbu/ [66]: http://www.mrc-cbu.cam.ac.uk/our-research/ [67]: http://www.mrc-cbu.cam.ac.uk/improving-health-and-wellbeing/ [68]: http://www.mrc-cbu.cam.ac.uk/publications/ [69]: http://www.mrc-cbu.cam.ac.uk/methods-and-resources/ [70]: http://imaging.mrc-cbu.cam.ac.uk/methods/WikiOverview [71]: http://www.mrc-cbu.cam.ac.uk/openscience/ [72]: http://www.mrc-cbu.cam.ac.uk/people/ [73]: http://www.mrc-cbu.cam.ac.uk/people/programme.leaders [74]: http://www.mrc-cbu.cam.ac.uk/people/research.staff [75]: http://www.mrc-cbu.cam.ac.uk/people/students [76]: http://www.mrc-cbu.cam.ac.uk/people/support.staff [77]: http://www.mrc-cbu.cam.ac.uk/people/honorary-members/ [78]: http://www.mrc-cbu.cam.ac.uk/people/alumni/ [79]: http://www.mrc-cbu.cam.ac.uk/take-part/ [80]: http://www.mrc-cbu.cam.ac.uk/studentships/ [81]: http://www.mrc-cbu.cam.ac.uk/news/ "News" [82]: http://www.mrc-cbu.cam.ac.uk/menus/events/ [83]: http://www.mrc-cbu.cam.ac.uk/seminar-information/ [84]: http://www.mrc-cbu.cam.ac.uk/seminar-information/chaucer-club/ [85]: http://www.mrc-cbu.cam.ac.uk/seminar-information/wednesday-lunchtime-seminars/ [86]: http://www.mrc-cbu.cam.ac.uk/seminar-information/cambridge-graduate-programme/ [87]: http://www.mrc-cbu.cam.ac.uk/seminar-information/statistics-seminars/ [88]: http://www.mrc-cbu.cam.ac.uk/external-conferences/ [89]: http://www.mrc-cbu.cam.ac.uk/calendar/ [90]: http://www.mrc-cbu.cam.ac.uk/contact-us/ [91]: http://www.haskins.yale.edu/ [92]: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=pubmed&cmd=Retrieve&dopt=AbstractPlus&list_uids=7233191&itool=iconabstr&query_hl=1&itool=pubmed_docsum [93]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/sine-wave-speech/icon.gif [94]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/pubs/davis+johnsrude.hearing_research2007.pdf [95]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/vocode/ [96]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/pubs/davis_et_al_JEPG_2005.pdf [97]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/sine-wave-speech/figure.jpg [98]: http://www.praat.org [99]: http://www.lifesci.sussex.ac.uk/home/Chris_Darwin/Praatscripts [100]: http://www.mathworks.com/products/matlab/ [101]: http://labrosa.ee.columbia.edu/matlab/sws/ [102]: http://www.ee.columbia.edu/~dpwe/ [103]: http://www.mrc-cbu.cam.ac.uk/people/matt.davis/sine-wave-speech/mooney_figure.jpg [104]: http://www.cns.nyu.edu/corefaculty/Rubin.php [105]: http://www.newscientist.com/article/mg19526221.300-mind-tricks-six-ways-to-explore-your-brain.html?full=true [106]: http://www.mindhacks.com/blog/2008/11/sinewave_speech.html [107]: http://www.boingboing.net/2008/11/04/fun-with-sinewave-sp.html [108]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/logos/AS_CMYK_Bronze%20Award.png [109]: http://www.mrc-cbu.cam.ac.uk/news/ [110]: http://www.mrc-cbu.cam.ac.uk/cookies/ [111]: http://www.mrc-cbu.cam.ac.uk/policies/ [112]: http://www.mrc-cbu.cam.ac.uk/wireless-access/ [113]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/logos/calmlogowhite.png [114]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/logos/c2adwhite.png [115]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/2017/06/camcan.png [116]: http://www.mrc-cbu.cam.ac.uk/contact-us [117]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/2017/06/facebook.png [118]: http://www.mrc-cbu.cam.ac.uk/wp-content/uploads/2017/06/twitter.png [119]: https://www.cam.ac.uk/university-a-z [120]: https://www.cam.ac.uk/contact-the-university [121]: https://www.cam.ac.uk/about-this-site/accessibility [122]: https://www.admin.cam.ac.uk/univ/information/foi/ [123]: https://www.cam.ac.uk/about-this-site/terms-and-conditions [124]: https://www.cam.ac.uk/research/news [125]: https://www.cam.ac.uk/research/features [126]: https://www.cam.ac.uk/research/discussion [127]: https://www.cam.ac.uk/research/spotlight-on [128]: https://www.cam.ac.uk/research/research-at-cambridge