Click here to Skip to main content
Click here to Skip to main content

Sound Activated Recorder with Spectrogram in C#

By , 27 Jan 2008
 
SoundCatcher

Introduction

This project demonstrates an implementation of the waterfall spectrogram and use of statistical data to trigger events in near real-time. This code is an elaboration of my previous submission (SoundViewer). This demonstration utilizes the Wave classes developed by Ianier Munoz.

Using the Code

Audio is supplied by the default input device which is typically the microphone. Events are triggered when audio amplitude exceeds the desired threshold value, which can be set under Options on the menu bar. To make this more useful, I've added functionality to save the stream to disk which results in a nice sound activated recorder.

Points of Interest

In order to draw the spectrogram fast enough to allow for near real-time operation, I needed to write directly to memory using unsafe code.

// lock image
PixelFormat format = canvas.PixelFormat;
BitmapData data = 
    canvas.LockBits(new Rectangle(0, 0, width, height), ImageLockMode.ReadOnly, format);
int stride = data.Stride;
int offset = stride - width * 4;

// draw image
try
{
  unsafe
  {
    byte* pixel = (byte*)data.Scan0.ToPointer();
    // for each column
    for (int y = 0; y <= height; y++)
    {
      if (y < _fftLeftSpect.Count)
      {
        // for each row
        for (int x = 0; x < width; x++, pixel += 4)
        {
          double amplitude = ((double[])_fftLeftSpect[_fftLeftSpect.Count - y - 1])
                [(int)(((double)(_fftLeft.Length) / (double)(width)) * x)];
          double color = GetColor(min, max, range, amplitude);
          pixel[0] = (byte)0;
          pixel[1] = (byte)color;
          pixel[2] = (byte)0;
          pixel[3] = (byte)255;
        }
        pixel += offset;
      }
    }
  }
}
catch (Exception ex)
{
  Console.WriteLine(ex.ToString());
}

// unlock image
canvas.UnlockBits(data);

I noticed that the results vary wildly depending on the hardware and associated drivers being used.

Some things I'd like to experiment with further when I get the time:

  1. Use of frequency domain to produce "motion" detector equivalent
  2. Use of spectrogram in sound identification
  3. Improving performance/robustness

History

  • 01/16/2008: Created

License

This article, along with any associated source code and files, is licensed under The GNU General Public License (GPLv3)

About the Author

Jeff Morton
Systems / Hardware Administrator
United States United States
Member
No Biography provided

Sign Up to vote   Poor Excellent
Add a reason or comment to your vote: x
Votes of 3 or less require a comment

Comments and Discussions

 
You must Sign In to use this message board.
Search this forum  
    Spacing  Noise  Layout  Per page   
QuestionHelp for operation on a modulated signalmembergalbandrea14 Apr '13 - 22:13 
Someone can help me for made an operation: I'd like to extract a signal modulated on a carrier signal of 1800 MHz.
Any suggestions?
 
Andrea Galbarini
Bug"В экземпляре объекта не задана ссылка на объект." [modified]memberMember 99607234 Apr '13 - 1:54 
При запуске программы. На этой строке кода "WaveNative.waveInOpen(out m_WaveIn, device, format, m_BufferProc, IntPtr.Zero, WaveNative.CALLBACK_FUNCTION)" вылетает и выдает ошибку "В экземпляре объекта не задана ссылка на объект."
Что делать??

modified 4 Apr '13 - 8:07.

Questionis there a way to select the iinput device (directx name ?)memberpatrick zuili17 Mar '13 - 18:34 
Thank you for your code very nice.
 
is there a way to select the input device (in case of multiple input devices) instead of the default one ?
 
thank you again for your code.
Generalamazing onememberMember 810718412 Jan '13 - 5:07 
Its a brilliant code...... thank you Smile | :)
GeneralMy vote of 5memberjavcastaalm23 Nov '12 - 9:08 
Excelent. Thanks
GeneralThanksmemberLeviButler3 Nov '12 - 13:27 
Very useful source
Thanks Smile | :)
GeneralMy vote of 5memberMember 806726522 May '12 - 0:47 
this source code is usefull
and crete share
Questiondraw spectrogram with a wav file.memberjacky_zz4 Feb '12 - 18:27 
if input source is wav file, how to draw it's spectrogram with a limit width like 800 pixel?
QuestionLocking up when closing if there is activity [modified]memberprogrammerdon17 Jan '12 - 5:46 
Firstly, great example…
If there is no noise/sound the application closes fine, if there is a high level of noise and you try to close the application, it hangs… any suggestions?
 
i think ive traced it back to the DataArrived() sub, when you call your delagate: Invoke(new MethodInvoker(AmplitudeEvent));
 
it looks like this method is still getting fired even when the object is disposed, i removed _recorder.Dispose(); to invoke this error... im trying to figure this threading issue out myself but i would appreciate it if you took a look and gave some advice.
 
Thank you

modified 17 Jan '12 - 12:09.

QuestionObject reference not set to an instance of an objectmemberdeepak thomas5 Dec '11 - 4:01 
Hi,
 
I am getting Object reference not set to an instance of an object error in WaveIn.cs function WaveInRecorder in the following code
WaveInHelper.Try( WaveNative.waveInOpen(out m_WaveIn, device, format, m_BufferProc, IntPtr.Zero, WaveNative.CALLBACK_FUNCTION));
?

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Permalink | Advertise | Privacy | Mobile
Web01 | 2.6.130523.1 | Last Updated 28 Jan 2008
Article Copyright 2008 by Jeff Morton
Everything else Copyright © CodeProject, 1999-2013
Terms of Use
Layout: fixed | fluid