Click here to Skip to main content
Click here to Skip to main content

Sending Input Messages to Other Windows or How To Win a Flash Game By Your Programming Skills

By , 4 Jul 2006
 
Sample Image - take-over.jpg

Introduction

This article presents a class, handling sending of input (mouse and keyboard) to any running Windows Control by its handle.

Background

Some time ago, I was making a program which would win a penalty shootout soccer flash game for me. My task in the application was repeatedly to do these things:

  • Grab flash window content
  • Do some image processing and find out what to do
  • Finally, take some action (send mouse input)

I found some great articles concerning taking of screenshot like this one.

This library helped me with image processing a lot.

On the other hand, I spent a lot of time trying to find out how to send mouse input to flash window correctly... and when I got how to do it, I decided to make this library.

Get the Handle

In order to use the TakeOver class, you need to obtain the handle (int number) of the window you want to control. It's possible to use spy++ tool from Visual Studio and convert HEX value to DEC using Windows calculator. The other possibility is to implement your own Window Picker (like in the demo project). Further details about this problem are out of scope for this article.

Using the Code

The first thing you need to do to take control over the window is to create a TakeOver class instance.

Remo.TakeOver tO = new Remo.TakeOver(targetWindowHandle);

Sending of input messages to a window is quite self-explanatory. The class provides these methods for sending messages:

public void SendLeftButtonDown(int x,int y);
public void SendLeftButtonUp(int x,int y);
public void SendLeftButtonDblClick(int x,int y);
public void SendRightButtonDown(int x,int y);
public void SendRightButtonUp(int x,int y);
public void SendRightButtonDblClick(int x,int y);
public void SendMouseMove(int x,int y);
public void SendKeyDown(int key);
public void SendKeyUp(int key);
public void SendChar(char c);
public void SendString(string s);

Sending input usually requires a target window to be focused to work properly, however it's not always so. The demo application can be tested here. Normally, you will have the application running in the background with controlled window focused, so there should be no problem with sending input messages. Since keyboard messages are not very reliable (I do not know how to encode lParam of SendMessage correctly, any hints?), it is recommended for keyboard input to use the SendKeys class once the window is focused via the SetFocus() method. Sendkeys is part of the standard System.Windows.Forms namespace. To focus target window TakeOver class provides a method:

public void SetFocus();

History

  • 4th July, 2006: Initial post

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

About the Author

Michal Remi
Web Developer
Slovakia Slovakia
Member
I am one step before graduating Faculty of Mathematics, Physics and Informatics, Commenius University Bratislava, specialization Computer Graphics. Working as C# programmer on large IS. Creator of Ubytovanie na Slovensku site.

Sign Up to vote   Poor Excellent
Add a reason or comment to your vote: x
Votes of 3 or less require a comment

Comments and Discussions

 
You must Sign In to use this message board.
Search this forum  
    Spacing  Noise  Layout  Per page   
Suggestion如果找中文翻译,请看下面网址 Pinmembercpluspluswiser1 Apr '12 - 16:23 
http://www.wisestudy.cn/article/english_cJin_windowcontrol.html
Questiona trouble with a game using keyboard control Pinmembermixiaojion20 Sep '07 - 22:33 
Hi Michal,
 
My name's Nguyen, a Ho Chi Minh University of Natural Science's student
I've read your article and I think this is really a interested article. I am trying to write a small application to support for playing game.^_^
 
But I have some troubles when trying to test your demo
When I play some flash games and press a key to control my character.Your demo application can not catch the keyboard event,but when I try another.Your demo is OK
I read your code to understand the cause. You catch the KEYDOWN and KEYUP event of PictureBox1 but doesn't do anything
So, how can your application can work properly with my game?Confused | :confused:
this is link of the game I used to test:
http://www.trochoiviet.com/games/module-pnFlashGames-display-id-202.phtml[^]
 
I am waiting for your reply
 
thank you very much!
 

 
Nguyen

Generalsending mouse messages to flash Pinmemberadamani1 May '07 - 14:25 
It seems that the takeover application does not forward mouse messages properly. For example, if you play this swf file in your browser C:\WINDOWS\Help\Tours\mmTour\segment1.swf and then use the takeover app to play it in its window and then move the mouse over the active area of the flash movie in the takeover app, the active areas of the flash movie do not work. You can see the difference by moving the mouse over the active area in the browser.
 
Can you suggest some ways to fix this issue?
Generalgames Pinmember-m-rt--n-28 Oct '06 - 2:45 
I cant play all games like thisFrown | :( i've send you an email with the question...
QuestionInteresting ... PinmemberOBalert20 Jul '06 - 10:49 
Thank you for writing this article, very interesting ...
 
But now that you have 'Take(en)Over' the game, how do go about controlling it programmatically, if it is a 3rd party flash game then you will not have any knowledge of it's internals and equally how will your program know where the balls is (or know the position of any other element of game, especially if this it's position is Changing)Confused | :confused:
 
OB
AnswerRe: Interesting ... PinmemberMichal Remiš23 Jul '06 - 3:32 
QuestionNice article! PinmemberWestves5 Jul '06 - 22:13 
Hi! It's a nice article!
One question: how to send combination "ctrl+L" ?
Thanks a lot.
AnswerRe: Nice article! [modified] PinmemberMichal Remiš6 Jul '06 - 10:35 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Permalink | Advertise | Privacy | Mobile
Web02 | 2.6.130516.1 | Last Updated 4 Jul 2006
Article Copyright 2006 by Michal Remi
Everything else Copyright © CodeProject, 1999-2013
Terms of Use
Layout: fixed | fluid