Click here to Skip to main content
15,867,141 members
Articles / Programming Languages / C#
Article

VideoTexture Class and Webcam Application for XNA

Rate me:
Please Sign up or sign in to vote.
4.72/5 (19 votes)
31 Jul 2007CPOL3 min read 224K   8K   52   75
A managed C# video texture class, demonstrated in an XNA WebCamComponent and used in a webcam application

Screenshot - XnaWebcamScreenshot.jpg

Figure 1. Screenshot of the xnaVideoViewer application in action

Introduction

"Video textures" are an important class of multimedia objects with interesting uses in video conferencing, visualization, gaming, robotics and image analysis. The most obvious use -- and therefore the usage that I have focused on in this project -- is to map streaming video from a webcam onto a Texture2D object. This is then applied to a sprite and presented as a live video window within an XNA application. In addition to consuming live video from any of your DirectX video devices, the VideoTexture class is also able to consume AVI, MPEG and WMV format video clips.

The VideoTexture class exposes a property called VideoTexture2D, which is intended to be usable wherever a normal Texture2D object might be used within XNA. This means that it can be used to apply a dynamic video texture onto both sprites and geometric meshes/models. It can also be manipulated by pixel, vertex and geometry shaders, just like any other texture.

Using the code

To use the VideoTexture class, you should:

  1. Copy the VideoTexture.cs file into your own project.
  2. Change the namespace in the VideoTexture.cs file to the name of your project namespace.
  3. Add a reference to DirectShowLib-2005.dll from the DirectShow.NET library.
  4. Compile it. The VideoTexture class should now be available in your project.

The XnaVideoViewer application demonstrates the usage of VideoComponent, which in turn demonstrates the usage of the VideoTexture class.

Points of interest

  • The VideoTexture class depends upon the managed DirectShow.NET library.
  • The VideoTexture.VideoTexture2D property can be polled by other classes to get the most current frame of video. This is what happens, for example, in the VideoComponent.Draw() method. Alternatively, classes that want to use VideoTexture can subscribe to VideoTexture.NewVideoTextureEvent and have the current frame of video pushed to them in NewVideoTextureEventArgs each time a new frame is grabbed from the video stream.
  • VideoComponent automatically registers itself as a service within the game application that uses it. It can be referenced through the Services collection via any other components used by the application.
  • Due to framework limitations within XNA -- specifically, the absence of the System.Windows namespace -- the desired source of video input (i.e. cameras or files) needs to be coded manually in the xnaVideoViewer application. This is done in the LoadComponents() method.
  • The xnaVideoViewer application maps the following commands to the XBox 360 controller: Run = A (Green); Pause = Y (Yellow); Stop = B (Red); Exit = Back.
  • The VideoTexture class has been used to provide the video stream for an experimental HUD application. It has recently been used to stream video textures through vertex shaders to correct lens distortions in real-time as a prelude to stitching the streams into a video mosaic.

History

  • 30 July 2007 - Version 1.1.0.0 uploaded to CodeProject. Changes include renaming and significant refactoring of the xnaVideoViewer, VideoComponent and VideoTexture classes. Support for AVI, MPEG and WMV video files was added. Support for Run, Pause and Stop was added. Support for Looping video clips was added. Two separate methods for capturing and handling DirectShow Filter Graph events were added. Additional error handling code was added.
  • 21 July 2007 - Version 1.0.0.0 uploaded to CodeProject.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


Written By
Engineer Defence R&D Canada
Canada Canada
Stephen Bogner is a Senior Research Engineer with Defence R&D Canada. As the Head Autonomous Applications Group, Autonomous Intelligent Systems Section, he only programs when it can't be avoided, and then only in C#.

Comments and Discussions

 
GeneralHigher Resolution [modified] Pin
Stephen Bogner11-Oct-07 6:29
Stephen Bogner11-Oct-07 6:29 
Generalhigher resolution for webcam Pin
LarsQ10-Oct-07 12:45
LarsQ10-Oct-07 12:45 
GeneralIntegration problem Pin
cheskochesko4-Oct-07 23:08
cheskochesko4-Oct-07 23:08 
QuestionParameters problem Pin
cheskochesko2-Oct-07 21:06
cheskochesko2-Oct-07 21:06 
AnswerRe: Parameters problem (solved) Pin
cheskochesko2-Oct-07 22:10
cheskochesko2-Oct-07 22:10 
GeneralRe: Parameters problem (solved) Pin
cheskochesko3-Oct-07 0:07
cheskochesko3-Oct-07 0:07 
GeneralNetwork Webcam Pin
freshonlineMax5-Sep-07 19:28
freshonlineMax5-Sep-07 19:28 
GeneralRe: Network Webcam Pin
Stephen Bogner6-Sep-07 11:12
Stephen Bogner6-Sep-07 11:12 
GeneralRe: Network Webcam Pin
kiquenet.com5-May-08 23:43
professionalkiquenet.com5-May-08 23:43 
GeneralJodo, que trasto Pin
chemita_cpu31-Aug-07 2:06
chemita_cpu31-Aug-07 2:06 
GeneralRe: Jodo, que trasto Pin
Stephen Bogner4-Sep-07 3:32
Stephen Bogner4-Sep-07 3:32 
GeneralVoice Pin
Omid Q.Rose19-Aug-07 11:19
Omid Q.Rose19-Aug-07 11:19 
GeneralRe: Voice Pin
Stephen Bogner20-Aug-07 9:16
Stephen Bogner20-Aug-07 9:16 
GeneralRe: Voice Pin
Omid Q.Rose20-Aug-07 11:17
Omid Q.Rose20-Aug-07 11:17 
GeneralVideoTexture2D Pin
Omid Q.Rose19-Aug-07 8:21
Omid Q.Rose19-Aug-07 8:21 
GeneralRe: VideoTexture2D Pin
Stephen Bogner20-Aug-07 9:11
Stephen Bogner20-Aug-07 9:11 
AnswerRe: VideoTexture2D Pin
Omid Q.Rose20-Aug-07 10:56
Omid Q.Rose20-Aug-07 10:56 
Questionhelp please Pin
k_hammami20058-Aug-07 23:03
k_hammami20058-Aug-07 23:03 
AnswerRe: help please Pin
Stephen Bogner9-Aug-07 3:35
Stephen Bogner9-Aug-07 3:35 
GeneralCrush!!! Debugger error Pin
jan10241881-Aug-07 9:47
jan10241881-Aug-07 9:47 
GeneralRe: Crush!!! Debugger error Pin
jan10241881-Aug-07 10:24
jan10241881-Aug-07 10:24 
GeneralRe: Crush!!! Debugger error Pin
Stephen Bogner1-Aug-07 10:54
Stephen Bogner1-Aug-07 10:54 
GeneralRe: Crush!!! Debugger error Pin
Stephen Bogner1-Aug-07 10:53
Stephen Bogner1-Aug-07 10:53 
GeneralRe: Crush!!! Debugger error Pin
jan10241881-Aug-07 11:04
jan10241881-Aug-07 11:04 
GeneralRe: Crush!!! Debugger error Pin
Stephen Bogner1-Aug-07 11:20
Stephen Bogner1-Aug-07 11:20 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.