Click here to Skip to main content
Click here to Skip to main content

Using the DirectShow Video Mixing Renderer 9 filter

By , 1 Feb 2005
Rate this:
Please Sign up or sign in to vote.

Sample Image - DirectShowVMR91.jpg

Introduction

This article shows the steps involved in creating and configuring DirectShow’s Video Mixing Renderer Filter 9 (VMR9). The two video streams, one on top of the other, are rendered on a single surface. This surface, in our case, is a PictureBox control. Each stream's alpha value, position and height/width can be adjusted at runtime.

How VMR9 is different

The following diagrams show the difference between rendering two videos with VMR9 and without VMR9.

Without VMR9

Rendering without VMR9

We notice that simply rendering two videos will result in two separate Video Renderers, which means that the videos are being played on two separate surfaces.

With VMR9

Rendering with VMR9

In this case, the VMR9 filter directs both video streams into its own input pins. This means there is only one renderer, and thus a single rendering surface for both video streams.

The Working

To enhance reusability and readability factors, the functionality of the VMR9 filter has been encapsulated inside a class named myVMR9.

The myVMR9 class

This class has the following private data members:

  • VMR9NormalizedRect *r;
  • IVMRWindowlessControl9 *pWC;
  • IVMRMixerControl9 *pMix;
  • IGraphBuilder *pGB;
  • IBaseFilter *pVmr;
  • IVMRFilterConfig9 *pConfig;
  • IMediaControl *pMC;
  • IMediaSeeking *pMS;

The constructor

The constructor receives a PictureBox's coordinates of type System::Drawing::Rectangle, along with its handler of type HWND. These two attributes are used by VMR9 for rendering purposes.

public: myVMR9(System::Drawing::Rectangle rect, HWND hwnd)
{
    // initialize video coordinates with normal values
    r = new VMR9NormalizedRect;
    r->left = 0;
    r->top = 0;
    r->right = 1;
    r->bottom = 1;

    pWC = NULL;
    pMix = NULL;
    pGB = NULL;
    pVmr = NULL;
    pConfig = NULL;
    pMC = NULL;
    pMS = NULL;
    // create an instance of the Filter Graph Manager
    CoCreateInstance(CLSID_FilterGraph, NULL, CLSCTX_INPROC_SERVER, 
        IID_IGraphBuilder, (void **)&pGB);
    // create an instance of the VMR9 filter
    CoCreateInstance(CLSID_VideoMixingRenderer9, NULL, CLSCTX_INPROC,
        IID_IBaseFilter, (void**)&pVmr);
    // add the VMR9 filter to the Graph Manager
    pGB->AddFilter(pVmr, L"Video");    
    // get a pointer to the IVMRFilterConfig9 interface
    pVmr->QueryInterface(IID_IVMRFilterConfig9, (void**)&pConfig);
    // make sure VMR9 is in windowless mode
    pConfig->SetRenderingMode(VMR9Mode_Windowless);
    // get a pointer to the IVMRWindowlessControl9 interface 
    pVmr->QueryInterface(IID_IVMRWindowlessControl9, (void**)&pWC);
    // explicitly convert System::Drawing::Rectangle type to RECT type
    RECT rcDest = {0};
    rcDest.bottom = rect.Bottom;
    rcDest.left = rect.Left;
    rcDest.right = rect.Right;
    rcDest.top = rect.Top;

    // set destination rectangle for the video
    pWC->SetVideoPosition(NULL, &rcDest);

    // specify the container window that the video should be clipped to    
    pWC->SetVideoClippingWindow(hwnd);
    // IVMRMixerControl manipulates video streams
    pVmr->QueryInterface(IID_IVMRMixerControl9, (void**)&pMix);
    // IMediaSeeking seeks to a position in the video stream
    pGB->QueryInterface(IID_IMediaSeeking, (void **)&pMS);
    // IMediaControl controls flow of data through the graph
    pGB->QueryInterface(IID_IMediaControl, (void **)&pMC);
}

The methods

HRESULT play()
{
    pMC->Run(); return
    S_OK;
}

HRESULT pause()
{
    pMC->Pause();
    return S_OK;
}

HRESULT stop()
{
    LONGLONG pos = 0;
    pMC->Stop();
    pMS->SetPositions(&pos, AM_SEEKING_AbsolutePositioning, 
                      NULL,AM_SEEKING_NoPositioning);
    pMC->Pause();
    return S_OK;
}

HRESULT close()
{
    // make sure resources are freed
    SAFE_RELEASE(pWC);
    SAFE_RELEASE(pMix);
    SAFE_RELEASE(pGB);
    SAFE_RELEASE(pVmr);
    SAFE_RELEASE(pConfig);
    SAFE_RELEASE(pMC);
    SAFE_RELEASE(pMS);
    return S_OK;
}

HRESULT setAlpha(DWORD stream, float alpha)
{
    // set alpha of specified video stream
    pMix->SetAlpha(stream, alpha);
    return S_OK;
}

HRESULT setX(DWORD stream, float x)
{
    // video displacement along x-axis
    r->right = x + (r->right - r->left);
    r->left = x;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setY(DWORD stream, float y)
{
    // video displacement along y-axis
    r->bottom = y + (r->bottom - r->top);
    r->top = y;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setW(DWORD stream, float w)
{
    // video stretching/shrinking along x-axis
    r->right = r->left + w;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setH(DWORD stream, float h)
{
    // video stretching/shrinking along y-axis
    r->bottom = r->top + h;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT renderFiles(String* file1, String* file2)
{
    // convert String type to LPCSTR type and render the videos
    LPCTSTR lFile;
    lFile = 
      static_cast<LPCTSTR>(const_cast<void*>(static_cast<const void*>
      (System::Runtime::InteropServices::Marshal::StringToHGlobalAuto(file1))));
    pGB->RenderFile((LPCWSTR)lFile, NULL);
    lFile = 
      static_cast<LPCTSTR>(const_cast<void*>(static_cast<const void*>
      (System::Runtime::InteropServices::Marshal::StringToHGlobalAuto(file2))));
    pGB->RenderFile((LPCWSTR)lFile, NULL);
    System::Runtime::InteropServices::Marshal::FreeHGlobal
      (static_cast<IntPtr>(const_cast<void*>
      (static_cast<const void*>(lFile))));
    pMC->StopWhenReady();
    return S_OK;
}

Now that the VMR9's functionality has been separated from the GUI, Button and TrackBar handlers can simply create a pointer to a myVMR9 object and call the required methods.

Sample screenshot

Additional Information

  • The second video stream opened is on top of the first one, i.e., file-2 video is rendered on top of file-1 video. Therefore, if the first video's alpha value is a 100% and the second video's alpha value is 50%, then both videos will be equally (50%) visible.
  • It should be noted that the values of Width and Height of trackbars can run into negative values. So when a video stream's width is -100%, it is laterally inverted. Similarly, when a video stream's height is -100%, the video is upside down.

License

This article has no explicit license attached to it but may contain usage terms in the article text or the download files themselves. If in doubt please contact the author via the discussion board below.

A list of licenses authors might use can be found here

About the Author

Sameer Ahmed
Software Developer
Pakistan Pakistan
No Biography provided

Comments and Discussions

 
GeneralRe: VB6 or VB.NET? PinmemberSameer Ahmed3-Sep-07 12:39 
GeneralRe: VB6 or VB.NET? PinmemberXristos20004-Sep-07 0:56 
Questionlnk error: _check_commonlanguageruntime_version Pinmemberjz.tan15-Aug-07 23:51 
i m using vc2003 to compile ur project.
but i get a linking error,
 
Form1.obj : error LNK2001: unresolved external symbol __check_commonlanguageruntime_version
D:\DirectShowVMR9_src\Release\DirectShowVMR9.exe : fatal error LNK1120: 1 unresolved externals

 
when i was trying to compile a release build.
in debug build, everything is running well.
 
can u give me any suggestion ?
many many thanks.
 
jztan
AnswerRe: lnk error: _check_commonlanguageruntime_version PinmemberSameer Ahmed16-Aug-07 10:48 
GeneralRe: lnk error: _check_commonlanguageruntime_version Pinmemberjz.tan16-Aug-07 15:40 
GeneralRe: lnk error: _check_commonlanguageruntime_version PinmemberSameer Ahmed17-Aug-07 0:07 
GeneralRe: lnk error: _check_commonlanguageruntime_version Pinmemberjz.tan23-Aug-07 20:04 
GeneralMerit Pinmemberjdsc5-Jun-07 0:16 
GeneralRe: Merit PinmemberSameer Ahmed6-Jun-07 4:45 
GeneralLINKER errors in VC++6.0 Pinmembermanas_hit30-May-07 23:49 
GeneralRe: LINKER errors in VC++6.0 PinmemberSameer Ahmed31-May-07 1:10 
QuestionCan a filter graph both VMR7 and VMR9? PinmemberManu Ranjana7-Jan-07 18:59 
QuestionIssue with continuously adding and deleting VMR9s PinmemberManu Ranjana5-Jan-07 22:30 
AnswerRe: Issue with continuously adding and deleting VMR9s PinmemberManu Ranjana7-Jan-07 18:54 
GeneralSend the result of VMR9 to an .avi file PinmemberMember #187253427-Dec-06 8:01 
GeneralRe: Send the result of VMR9 to an .avi file Pinmembertanvon malik25-Sep-07 2:09 
QuestionRe: Send the result of VMR9 to an .avi file PinmemberBoopathi S25-Sep-07 20:04 
AnswerRe: Send the result of VMR9 to an .avi file Pinmembertanvon malik25-Sep-07 21:14 
Generalgreenish lines on video using VMR9 Pinmembershovit25-Oct-06 20:29 
GeneralFull Screen [modified] Pinmemberalanmark5-Oct-06 4:02 
Questionenumerate pins PinmemberFariha Atta1-Oct-06 17:57 
AnswerRe: enumerate pins PinmemberSameer Ahmed2-Oct-06 11:08 
GeneralSound PinmemberTharkunius26-Sep-06 23:38 
GeneralRe: Sound PinmemberSameer Ahmed2-Oct-06 10:29 
QuestionUrgent !!! No errors in code but still cant see the video :-( [modified] Pinmember~Jabeen~3-Sep-06 21:21 
AnswerRe: Urgent !!! No errors in code but still cant see the video :-( PinmemberSameer Ahmed5-Sep-06 1:58 
Questionvideo mixing problem [modified] Pinmemberfariha atta17-Aug-06 16:06 
AnswerRe: video mixing problem [modified] PinmemberSameer Ahmed17-Aug-06 18:22 
GeneralRe: video mixing problem Pinmemberfariha atta18-Aug-06 5:04 
GeneralRe: vmr9 PinmemberSameer Ahmed15-Aug-06 23:55 
Questionproblem in implementing a filter graph thru Filter Graph Manager Pinmemberfariha atta28-Jul-06 16:22 
AnswerRe: problem in implementing a filter graph thru Filter Graph Manager PinmemberSameer Ahmed29-Jul-06 1:36 
GeneralFull screen switching mode Pinmembergabrilestrimtu9-Jun-06 7:45 
GeneralRe: Full screen switching mode Pinmemberjimerino18-Apr-07 7:35 
Generalsir,i got some error complied in .net Pinmemberchenhuasheng8-May-06 18:44 
GeneralText Mixing Pinmemberjeykumars27-Apr-06 23:11 
GeneralRe: Text Mixing PinmemberSameer Ahmed28-Apr-06 2:06 
GeneralRe: AoA Sameer! PinmemberSameer Ahmed29-Jul-06 1:49 
GeneralGreat stuff PinmemberRYoung4-Mar-06 7:36 
GeneralRe: Great stuff PinmemberSameer Ahmed4-Mar-06 8:14 
Generaloops PinmemberGraceNetwork23-Feb-06 6:35 
Questionoutput render video to file? PinmemberGraceNetwork22-Feb-06 14:10 
GeneralI am getting erros trying to compile/ PinmemberGraceNetwork22-Feb-06 14:04 
QuestionVideo looping Pinmemberel3gans26-Jan-06 5:19 
QuestionVideo synchronized ? Pinmembertomprout23-Nov-05 6:35 
AnswerRe: Video synchronized ? PinmemberSameer Ahmed2-Dec-05 23:33 
QuestionStreaming results? PinmemberGeert van Horrik1-Oct-05 22:28 
AnswerRe: Streaming results? [modified] PinmemberSameer Ahmed2-Oct-05 6:04 
GeneralRe: Streaming results? PinmemberGeert van Horrik2-Oct-05 9:02 
GeneralRe: Streaming results? PinmemberSameer Ahmed7-Oct-05 7:47 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web02 | 2.8.140415.2 | Last Updated 1 Feb 2005
Article Copyright 2005 by Sameer Ahmed
Everything else Copyright © CodeProject, 1999-2014
Terms of Use
Layout: fixed | fluid