Click here to Skip to main content
Click here to Skip to main content

Sound Activated Recorder with Spectrogram in C#

By , 27 Jan 2008
 
SoundCatcher

Introduction

This project demonstrates an implementation of the waterfall spectrogram and use of statistical data to trigger events in near real-time. This code is an elaboration of my previous submission (SoundViewer). This demonstration utilizes the Wave classes developed by Ianier Munoz.

Using the Code

Audio is supplied by the default input device which is typically the microphone. Events are triggered when audio amplitude exceeds the desired threshold value, which can be set under Options on the menu bar. To make this more useful, I've added functionality to save the stream to disk which results in a nice sound activated recorder.

Points of Interest

In order to draw the spectrogram fast enough to allow for near real-time operation, I needed to write directly to memory using unsafe code.

// lock image
PixelFormat format = canvas.PixelFormat;
BitmapData data = 
    canvas.LockBits(new Rectangle(0, 0, width, height), ImageLockMode.ReadOnly, format);
int stride = data.Stride;
int offset = stride - width * 4;

// draw image
try
{
  unsafe
  {
    byte* pixel = (byte*)data.Scan0.ToPointer();
    // for each column
    for (int y = 0; y <= height; y++)
    {
      if (y < _fftLeftSpect.Count)
      {
        // for each row
        for (int x = 0; x < width; x++, pixel += 4)
        {
          double amplitude = ((double[])_fftLeftSpect[_fftLeftSpect.Count - y - 1])
                [(int)(((double)(_fftLeft.Length) / (double)(width)) * x)];
          double color = GetColor(min, max, range, amplitude);
          pixel[0] = (byte)0;
          pixel[1] = (byte)color;
          pixel[2] = (byte)0;
          pixel[3] = (byte)255;
        }
        pixel += offset;
      }
    }
  }
}
catch (Exception ex)
{
  Console.WriteLine(ex.ToString());
}

// unlock image
canvas.UnlockBits(data);

I noticed that the results vary wildly depending on the hardware and associated drivers being used.

Some things I'd like to experiment with further when I get the time:

  1. Use of frequency domain to produce "motion" detector equivalent
  2. Use of spectrogram in sound identification
  3. Improving performance/robustness

History

  • 01/16/2008: Created

License

This article, along with any associated source code and files, is licensed under The GNU General Public License (GPLv3)

About the Author

Jeff Morton
Systems / Hardware Administrator
United States United States
Member
No Biography provided

Sign Up to vote   Poor Excellent
Add a reason or comment to your vote: x
Votes of 3 or less require a comment

Comments and Discussions

 
You must Sign In to use this message board.
Search this forum  
    Spacing  Noise  Layout  Per page   
QuestionHelp for operation on a modulated signal Pinmembergalbandrea14 Apr '13 - 22:13 
Bug"В экземпляре объекта не задана ссылка на объект." [modified] PinmemberMember 99607234 Apr '13 - 1:54 
Questionis there a way to select the iinput device (directx name ?) Pinmemberpatrick zuili17 Mar '13 - 18:34 
Generalamazing one PinmemberMember 810718412 Jan '13 - 5:07 
GeneralMy vote of 5 Pinmemberjavcastaalm23 Nov '12 - 9:08 
GeneralThanks PinmemberLeviButler3 Nov '12 - 13:27 
GeneralMy vote of 5 PinmemberMember 806726522 May '12 - 0:47 
Questiondraw spectrogram with a wav file. Pinmemberjacky_zz4 Feb '12 - 18:27 
QuestionLocking up when closing if there is activity [modified] Pinmemberprogrammerdon17 Jan '12 - 5:46 
QuestionObject reference not set to an instance of an object Pinmemberdeepak thomas5 Dec '11 - 4:01 
QuestionSound Catcher freezes on Exit in Win 7 32-bit PinmemberMember 836994911 Nov '11 - 11:13 
QuestionPlease how can i make the recording every 1 hour PinmemberTimothy Ayodele2 Nov '11 - 7:26 
QuestionVote 5 Pinmemberserega4675 Aug '11 - 0:41 
GeneralIn VB.NET Pinmemberemicroxxx23 May '11 - 2:55 
GeneralMy vote of 5 Pingroupabdillahi26 Apr '11 - 22:23 
QuestionHow can i save output to .txt ? Pinmemberstefan_brato27 Nov '10 - 16:48 
QuestionSpectrogram Disappears PinmemberGeoNav12 Jul '10 - 18:26 
QuestionGPLv2 PinmemberMember 42771197 Jul '10 - 10:00 
QuestionHow to generate wave-form if we have the byte-array with us. PinmemberMark0211 Mar '10 - 23:06 
GeneralIntegration Time PinmemberGeoNav17 Feb '10 - 4:17 
GeneralSound Equalizer PinmemberBazKhan25 Jan '10 - 19:34 
GeneralAmplitude -sound loudness Pinmemberginwithlime9 Jan '10 - 4:10 
QuestionHow to stop the thread if a invoke methode gets called in the DataArrived Event PinmemberMichael Muehllehner7 Dec '09 - 3:57 
QuestionHow to make the IFFT? Pinmemberafmf3 Nov '09 - 5:33 
QuestionHow to reduce the noise? PinmemberGeoNav31 Oct '09 - 1:55 
Generallineout audio PinmemberGeoNav28 Oct '09 - 23:10 
QuestionChange Source to wav file PinmemberGeoNav21 Oct '09 - 21:36 
GeneralError in Program PinmemberPiligrim200720 Oct '09 - 11:04 
QuestionCan't run the program in Vista 64bit PinmemberYasir Salih Osman7 Aug '09 - 22:36 
Questionhow can i do it reverse? [modified] Pinmembermojimoj2 Aug '09 - 21:05 
GeneralExcellent piece of work Jeff Pinmembermaxima1204 Jul '09 - 12:17 
GeneralThrows exception when using Freq &lt; 11025 Hz Pinmemberk^s10 Jun '09 - 7:07 
QuestionHow do I get it to work? PinmemberMaiden Computer Company22 Apr '09 - 10:48 
QuestionError in Frequency domain? PinmemberElysium8 Mar '09 - 11:17 
QuestionQuestion on how to get the frequencies Pinmemberkyanmark_johnwill2 Mar '09 - 13:52 
Questionspectrogram of a wav file Pinmemberplouvou12 Jan '09 - 9:59 
GeneralDraw waveform for already existing wave file Pinmemberjugal_piet@indiatimes.com5 Jan '09 - 20:26 
GeneralVery great app PinmemberMr. Yi26 Nov '08 - 4:31 
GeneralBug in event detection - left channel only is used PinmemberAtis Straujums9 Oct '08 - 10:43 
GeneralAnother hi! Pinmemberstano24 Sep '08 - 18:16 
GeneralAnger detection software Pinmember100,000 Cold Calls12 Aug '08 - 11:44 
Generalthe file is not saving ...!! PinmemberAshok Nalam9 Jul '08 - 1:05 
QuestionDisplay Of Frequencies PinmemberRonD25 May '08 - 4:17 
QuestionHow can i make it faster? Pinmemberpauloricca16 May '08 - 6:20 
GeneralTwo Questions Pinmemberrodriguesd23 Mar '08 - 0:45 
GeneralThis is great stuff Pinmemberpeter.roca6 Mar '08 - 9:34 
GeneralHi Pinmembercircass4 Mar '08 - 6:32 
GeneralJust a thought... PinmemberEd.Poore29 Jan '08 - 13:53 
QuestionProblem with Solution file? PinmemberEitsopGmail28 Jan '08 - 23:41 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Permalink | Advertise | Privacy | Mobile
Web04 | 2.6.130516.1 | Last Updated 28 Jan 2008
Article Copyright 2008 by Jeff Morton
Everything else Copyright © CodeProject, 1999-2013
Terms of Use
Layout: fixed | fluid