Click here to Skip to main content
Click here to Skip to main content

VideoTexture Class and Webcam Application for XNA

, 31 Jul 2007 CPOL
Rate this:
Please Sign up or sign in to vote.
A managed C# video texture class, demonstrated in an XNA WebCamComponent and used in a webcam application

Screenshot - XnaWebcamScreenshot.jpg

Figure 1. Screenshot of the xnaVideoViewer application in action

Introduction

"Video textures" are an important class of multimedia objects with interesting uses in video conferencing, visualization, gaming, robotics and image analysis. The most obvious use -- and therefore the usage that I have focused on in this project -- is to map streaming video from a webcam onto a Texture2D object. This is then applied to a sprite and presented as a live video window within an XNA application. In addition to consuming live video from any of your DirectX video devices, the VideoTexture class is also able to consume AVI, MPEG and WMV format video clips.

The VideoTexture class exposes a property called VideoTexture2D, which is intended to be usable wherever a normal Texture2D object might be used within XNA. This means that it can be used to apply a dynamic video texture onto both sprites and geometric meshes/models. It can also be manipulated by pixel, vertex and geometry shaders, just like any other texture.

Using the code

To use the VideoTexture class, you should:

  1. Copy the VideoTexture.cs file into your own project.
  2. Change the namespace in the VideoTexture.cs file to the name of your project namespace.
  3. Add a reference to DirectShowLib-2005.dll from the DirectShow.NET library.
  4. Compile it. The VideoTexture class should now be available in your project.

The XnaVideoViewer application demonstrates the usage of VideoComponent, which in turn demonstrates the usage of the VideoTexture class.

Points of interest

  • The VideoTexture class depends upon the managed DirectShow.NET library.
  • The VideoTexture.VideoTexture2D property can be polled by other classes to get the most current frame of video. This is what happens, for example, in the VideoComponent.Draw() method. Alternatively, classes that want to use VideoTexture can subscribe to VideoTexture.NewVideoTextureEvent and have the current frame of video pushed to them in NewVideoTextureEventArgs each time a new frame is grabbed from the video stream.
  • VideoComponent automatically registers itself as a service within the game application that uses it. It can be referenced through the Services collection via any other components used by the application.
  • Due to framework limitations within XNA -- specifically, the absence of the System.Windows namespace -- the desired source of video input (i.e. cameras or files) needs to be coded manually in the xnaVideoViewer application. This is done in the LoadComponents() method.
  • The xnaVideoViewer application maps the following commands to the XBox 360 controller: Run = A (Green); Pause = Y (Yellow); Stop = B (Red); Exit = Back.
  • The VideoTexture class has been used to provide the video stream for an experimental HUD application. It has recently been used to stream video textures through vertex shaders to correct lens distortions in real-time as a prelude to stitching the streams into a video mosaic.

History

  • 30 July 2007 - Version 1.1.0.0 uploaded to CodeProject. Changes include renaming and significant refactoring of the xnaVideoViewer, VideoComponent and VideoTexture classes. Support for AVI, MPEG and WMV video files was added. Support for Run, Pause and Stop was added. Support for Looping video clips was added. Two separate methods for capturing and handling DirectShow Filter Graph events were added. Additional error handling code was added.
  • 21 July 2007 - Version 1.0.0.0 uploaded to CodeProject.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

Stephen Bogner
Engineer Defence R&D Canada
Canada Canada
Stephen Bogner is a Senior Research Engineer with Defence R&D Canada. As the Head Autonomous Applications Group, Autonomous Intelligent Systems Section, he only programs when it can't be avoided, and then only in C#.

Comments and Discussions

 
GeneralTinting a region... Pinmemberb0iNg4-Sep-10 4:41 
GeneralWebcam problem: A first chance exception of type 'System.InvalidOperationException' occurred in Microsoft.Xna.Framework.dll Pinmemberjrbosch20-Nov-09 23:48 
GeneralRe: Webcam problem: A first chance exception of type 'System.InvalidOperationException' occurred in Microsoft.Xna.Framework.dll Pinmemberbarcsik18-Dec-09 13:52 
GeneralFramerate issues on a Macbook Pro running XP (boot-camp) PinmemberYossi Landesman26-Aug-09 8:25 
QuestionHow to make a webcam texture? PinmemberKim Seonghyune29-Jul-09 20:27 
GeneralVideo in 3D Pinmemberoleksii.mdr10-Mar-09 3:35 
GeneralVS2008, XNA 3.0, DirectShow.NET 2.0 ... almost working Pinmemberajdto2342-Jan-09 6:24 
GeneralRe: VS2008, XNA 3.0, DirectShow.NET 2.0 ... almost working PinmemberMrDytmire31-Jan-09 3:55 
QuestionHow to dump a Frame? Pinmemberyipling14-Oct-08 5:09 
GeneralDirectShowLib-2005.dll Heeeeelp Pinmembersashdude7-Jul-08 17:30 
GeneralRe: DirectShowLib-2005.dll Heeeeelp PinmemberStephen Bogner8-Jul-08 4:25 
GeneralRe: DirectShowLib-2005.dll Heeeeelp Pinmembersashdude9-Jul-08 5:14 
GeneralRe: DirectShowLib-2005.dll Heeeeelp PinmemberStephen Bogner9-Jul-08 5:45 
GeneralToggleFullScreen problem. Pinmemberamar219-Jun-08 12:37 
Generalproblem capturing the screen Pinmembercheskochesko23-May-08 0:56 
GeneralProblem with the new xna release 2.0 PinmemberMert Ozdag16-Mar-08 18:46 
GeneralRe: Problem with the new xna release 2.0 PinmemberStephen Bogner17-Mar-08 4:03 
GeneralAudio PinmemberAlexandre Ribeiro de Sá21-Feb-08 16:58 
GeneralRe: Audio Pinmembereclere8-Sep-09 11:30 
GeneralComposite video input Pinmembercheskochesko5-Feb-08 21:57 
GeneralChanges Necessary for XNA 2.0 PinmemberStephen Bogner14-Jan-08 10:28 
Generalcompile error Pinmemberodinlai10-Jan-08 10:24 
GeneralRe: compile error PinmemberStephen Bogner14-Jan-08 5:14 
GeneralRe: compile error PinmemberStephen Bogner14-Jan-08 8:04 
QuestionHow to play two avi files simultaneously? PinmemberOmid.Q.Rose24-Dec-07 7:30 
GeneralHigher Resolution [modified] PinmemberStephen Bogner11-Oct-07 7:29 
Generalhigher resolution for webcam Pinmembersccorpius10-Oct-07 13:45 
GeneralIntegration problem Pinmembercheskochesko5-Oct-07 0:08 
QuestionParameters problem Pinmembercheskochesko2-Oct-07 22:06 
AnswerRe: Parameters problem (solved) Pinmembercheskochesko2-Oct-07 23:10 
GeneralRe: Parameters problem (solved) Pinmembercheskochesko3-Oct-07 1:07 
GeneralNetwork Webcam PinmemberfreshonlineMax5-Sep-07 20:28 
GeneralRe: Network Webcam PinmemberStephen Bogner6-Sep-07 12:12 
GeneralRe: Network Webcam Pinmemberalhambra-eidos6-May-08 0:43 
GeneralJodo, que trasto Pinmemberchemita_cpu31-Aug-07 3:06 
GeneralRe: Jodo, que trasto PinmemberStephen Bogner4-Sep-07 4:32 
GeneralVoice PinmemberOmid.Q.Rose19-Aug-07 12:19 
GeneralRe: Voice PinmemberStephen Bogner20-Aug-07 10:16 
GeneralRe: Voice PinmemberOmid.Q.Rose20-Aug-07 12:17 
GeneralVideoTexture2D PinmemberOmid.Q.Rose19-Aug-07 9:21 
GeneralRe: VideoTexture2D PinmemberStephen Bogner20-Aug-07 10:11 
AnswerRe: VideoTexture2D PinmemberOmid.Q.Rose20-Aug-07 11:56 
Questionhelp please Pinmemberk_hammami20059-Aug-07 0:03 
AnswerRe: help please PinmemberStephen Bogner9-Aug-07 4:35 
GeneralCrush!!! Debugger error Pinmemberjan10241881-Aug-07 10:47 
GeneralRe: Crush!!! Debugger error Pinmemberjan10241881-Aug-07 11:24 
GeneralRe: Crush!!! Debugger error PinmemberStephen Bogner1-Aug-07 11:54 
GeneralRe: Crush!!! Debugger error PinmemberStephen Bogner1-Aug-07 11:53 
GeneralRe: Crush!!! Debugger error Pinmemberjan10241881-Aug-07 12:04 
GeneralRe: Crush!!! Debugger error PinmemberStephen Bogner1-Aug-07 12:20 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Terms of Use | Mobile
Web01 | 2.8.150326.1 | Last Updated 31 Jul 2007
Article Copyright 2007 by Stephen Bogner
Everything else Copyright © CodeProject, 1999-2015
Layout: fixed | fluid