5,666,132 members and growing! (13,670 online)
Email Password   helpLost your password?
Multimedia » DirectX » General     Intermediate

Using the DirectShow Video Mixing Renderer 9 filter

By Sameer Ahmed

This article describes how to dynamically mix two video files (.mpeg, .mpg, .avi and .dat). Mixing involves alpha-blending and stretching/shrinking and positioning of the two video streams, individually, using DirectShow's VMR9 filter.
C++/CLI, VC7.1, C++Windows, .NET, .NET 1.0, .NET 1.1, Win2K, WinXP, Win2003, Vista, DirectX, VS.NET2003, Visual Studio, Dev

Posted: 3 Jan 2005
Updated: 1 Feb 2005
Views: 151,977
Bookmarked: 52 times
Announcements
Loading...



Search    
Advanced Search
Sitemap
25 votes for this Article.
Popularity: 6.06 Rating: 4.33 out of 5
1 vote, 4.0%
1
1 vote, 4.0%
2
1 vote, 4.0%
3
2 votes, 8.0%
4
20 votes, 80.0%
5

Sample Image - DirectShowVMR91.jpg

Introduction

This article shows the steps involved in creating and configuring DirectShow’s Video Mixing Renderer Filter 9 (VMR9). The two video streams, one on top of the other, are rendered on a single surface. This surface, in our case, is a PictureBox control. Each stream's alpha value, position and height/width can be adjusted at runtime.

How VMR9 is different

The following diagrams show the difference between rendering two videos with VMR9 and without VMR9.

Without VMR9

Rendering without VMR9

We notice that simply rendering two videos will result in two separate Video Renderers, which means that the videos are being played on two separate surfaces.

With VMR9

Rendering with VMR9

In this case, the VMR9 filter directs both video streams into its own input pins. This means there is only one renderer, and thus a single rendering surface for both video streams.

The Working

To enhance reusability and readability factors, the functionality of the VMR9 filter has been encapsulated inside a class named myVMR9.

The myVMR9 class

This class has the following private data members:

  • VMR9NormalizedRect *r;
  • IVMRWindowlessControl9 *pWC;
  • IVMRMixerControl9 *pMix;
  • IGraphBuilder *pGB;
  • IBaseFilter *pVmr;
  • IVMRFilterConfig9 *pConfig;
  • IMediaControl *pMC;
  • IMediaSeeking *pMS;

The constructor

The constructor receives a PictureBox's coordinates of type System::Drawing::Rectangle, along with its handler of type HWND. These two attributes are used by VMR9 for rendering purposes.

public: myVMR9(System::Drawing::Rectangle rect, HWND hwnd)
{
    // initialize video coordinates with normal values

    r = new VMR9NormalizedRect;
    r->left = 0;
    r->top = 0;
    r->right = 1;
    r->bottom = 1;

    pWC = NULL;
    pMix = NULL;
    pGB = NULL;
    pVmr = NULL;
    pConfig = NULL;
    pMC = NULL;
    pMS = NULL;
    // create an instance of the Filter Graph Manager

    CoCreateInstance(CLSID_FilterGraph, NULL, CLSCTX_INPROC_SERVER, 
        IID_IGraphBuilder, (void **)&pGB);
    // create an instance of the VMR9 filter

    CoCreateInstance(CLSID_VideoMixingRenderer9, NULL, CLSCTX_INPROC,
        IID_IBaseFilter, (void**)&pVmr);
    // add the VMR9 filter to the Graph Manager

    pGB->AddFilter(pVmr, L"Video");    
    // get a pointer to the IVMRFilterConfig9 interface

    pVmr->QueryInterface(IID_IVMRFilterConfig9, (void**)&pConfig);
    // make sure VMR9 is in windowless mode

    pConfig->SetRenderingMode(VMR9Mode_Windowless);
    // get a pointer to the IVMRWindowlessControl9 interface 

    pVmr->QueryInterface(IID_IVMRWindowlessControl9, (void**)&pWC);
    // explicitly convert System::Drawing::Rectangle type to RECT type

    RECT rcDest = {0};
    rcDest.bottom = rect.Bottom;
    rcDest.left = rect.Left;
    rcDest.right = rect.Right;
    rcDest.top = rect.Top;

    // set destination rectangle for the video

    pWC->SetVideoPosition(NULL, &rcDest);

    // specify the container window that the video should be clipped to    

    pWC->SetVideoClippingWindow(hwnd);
    // IVMRMixerControl manipulates video streams

    pVmr->QueryInterface(IID_IVMRMixerControl9, (void**)&pMix);
    // IMediaSeeking seeks to a position in the video stream

    pGB->QueryInterface(IID_IMediaSeeking, (void **)&pMS);
    // IMediaControl controls flow of data through the graph

    pGB->QueryInterface(IID_IMediaControl, (void **)&pMC);
}

The methods

HRESULT play()
{
    pMC->Run(); return
    S_OK;
}

HRESULT pause()
{
    pMC->Pause();
    return S_OK;
}

HRESULT stop()
{
    LONGLONG pos = 0;
    pMC->Stop();
    pMS->SetPositions(&pos, AM_SEEKING_AbsolutePositioning, 
                      NULL,AM_SEEKING_NoPositioning);
    pMC->Pause();
    return S_OK;
}

HRESULT close()
{
    // make sure resources are freed

    SAFE_RELEASE(pWC);
    SAFE_RELEASE(pMix);
    SAFE_RELEASE(pGB);
    SAFE_RELEASE(pVmr);
    SAFE_RELEASE(pConfig);
    SAFE_RELEASE(pMC);
    SAFE_RELEASE(pMS);
    return S_OK;
}

HRESULT setAlpha(DWORD stream, float alpha)
{
    // set alpha of specified video stream

    pMix->SetAlpha(stream, alpha);
    return S_OK;
}

HRESULT setX(DWORD stream, float x)
{
    // video displacement along x-axis

    r->right = x + (r->right - r->left);
    r->left = x;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setY(DWORD stream, float y)
{
    // video displacement along y-axis

    r->bottom = y + (r->bottom - r->top);
    r->top = y;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setW(DWORD stream, float w)
{
    // video stretching/shrinking along x-axis

    r->right = r->left + w;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT setH(DWORD stream, float h)
{
    // video stretching/shrinking along y-axis

    r->bottom = r->top + h;
    pMix->SetOutputRect(stream, r);
    return S_OK;
}

HRESULT renderFiles(String* file1, String* file2)
{
    // convert String type to LPCSTR type and render the videos

    LPCTSTR lFile;
    lFile = 
      static_cast<LPCTSTR>(const_cast<void*>(static_cast<const void*>
      (System::Runtime::InteropServices::Marshal::StringToHGlobalAuto(file1))));
    pGB->RenderFile((LPCWSTR)lFile, NULL);
    lFile = 
      static_cast<LPCTSTR>(const_cast<void*>(static_cast<const void*>
      (System::Runtime::InteropServices::Marshal::StringToHGlobalAuto(file2))));
    pGB->RenderFile((LPCWSTR)lFile, NULL);
    System::Runtime::InteropServices::Marshal::FreeHGlobal
      (static_cast<IntPtr>(const_cast<void*>
      (static_cast<const void*>(lFile))));
    pMC->StopWhenReady();
    return S_OK;
}

Now that the VMR9's functionality has been separated from the GUI, Button and TrackBar handlers can simply create a pointer to a myVMR9 object and call the required methods.

Sample screenshot

Additional Information

  • The second video stream opened is on top of the first one, i.e., file-2 video is rendered on top of file-1 video. Therefore, if the first video's alpha value is a 100% and the second video's alpha value is 50%, then both videos will be equally (50%) visible.
  • It should be noted that the values of Width and Height of trackbars can run into negative values. So when a video stream's width is -100%, it is laterally inverted. Similarly, when a video stream's height is -100%, the video is upside down.

License

This article has no explicit license attached to it but may contain usage terms in the article text or the download files themselves. If in doubt please contact the author via the discussion board below.

A list of licenses authors might use can be found here

About the Author

Sameer Ahmed



Occupation: Software Developer
Location: Pakistan Pakistan

Other popular DirectX articles:

Article Top
Sign Up to vote for this article
You must Sign In to use this message board.
FAQ FAQ Noise ToleranceSearch Search Messages 
 Layout  Per page   
 Msgs 1 to 25 of 105 (Total in Forum: 105) (Refresh)FirstPrevNext
GeneralVFW Video Capture Format Dialog Boxmembervikasneedu3:51 22 Oct '08  
GeneralCan you make your code to a wmp plugin?membersunny_chn3:47 1 Jun '08  
GeneralRe: Can you make your code to a wmp plugin?memberSameer Ahmed3:54 1 Jun '08  
Questionhi,Sameer Ahmedmemberowen992417:06 19 Oct '08  
AnswerRe: hi,Sameer AhmedmemberSameer Ahmed18:15 19 Oct '08  
GeneralRe: hi,Sameer Ahmedmemberowen992420:01 19 Oct '08  
GeneralVideo croppingmemberMember 24271492:44 26 Dec '07  
GeneralRe: Video croppingmemberSameer Ahmed18:57 30 Mar '08  
GeneralVB6 or VB.NET?memberXristos200023:20 21 Aug '07  
GeneralRe: VB6 or VB.NET?memberSameer Ahmed1:32 22 Aug '07  
GeneralRe: VB6 or VB.NET?memberXristos20002:55 22 Aug '07  
GeneralRe: VB6 or VB.NET?memberSameer Ahmed11:53 22 Aug '07  
GeneralRe: VB6 or VB.NET?memberXristos200011:11 3 Sep '07  
GeneralRe: VB6 or VB.NET?memberSameer Ahmed13:28 3 Sep '07  
GeneralRe: VB6 or VB.NET?memberXristos200013:31 3 Sep '07  
GeneralRe: VB6 or VB.NET?memberSameer Ahmed13:39 3 Sep '07  
GeneralRe: VB6 or VB.NET?memberXristos20001:56 4 Sep '07  
Questionlnk error: _check_commonlanguageruntime_versionmemberjz.tan0:51 16 Aug '07  
AnswerRe: lnk error: _check_commonlanguageruntime_versionmemberSameer Ahmed11:48 16 Aug '07  
GeneralRe: lnk error: _check_commonlanguageruntime_versionmemberjz.tan16:40 16 Aug '07  
GeneralRe: lnk error: _check_commonlanguageruntime_versionmemberSameer Ahmed1:07 17 Aug '07  
GeneralRe: lnk error: _check_commonlanguageruntime_versionmemberjz.tan21:04 23 Aug '07  
GeneralMeritmemberjdsc1:16 5 Jun '07  
GeneralRe: MeritmemberSameer Ahmed5:45 6 Jun '07  
GeneralLINKER errors in VC++6.0membermanas_hit0:49 31 May '07  

General General    News News    Question Question    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

PermaLink | Privacy | Terms of Use
Last Updated: 1 Feb 2005
Editor: Smitha Vijayan
Copyright 2005 by Sameer Ahmed
Everything else Copyright © CodeProject, 1999-2008
Web13 | Advertise on the Code Project