Fake User Program

[Labdabeta]

I want to be able to make a program that emulates what a human at a computer can do. IE: I want to be able to read the visual information of a window (a 2d array of colour would be perfect) and be able to send virtual key syms and mouse movements to the window. Is this at all possible, and if so how is it done?

[Ancient Dragon]

yes it is opossible, how to do it depends on the operating system. For MS-Windows you need to learn win32 api functions. Here is a good tutorial. After you have learned that you can start learning MS-Windows GDI functions

[Labdabeta]

I looked through that, and it seemed to have what I was looking for in terms of reading the info of the window (I can get its coordinates on the screen then use getPixel on the area?) but it had nothing on how to send fake input to a window. Perhaps the broken link contained the info?

[Ancient Dragon]

read this article for keyboard input

[Labdabeta]

That is great for keyboard input... but what about mouse... I have clarified in my mind what I want a little more now. I want the following self explanatory functions:

WINDOW_HANDLE_TYPE getWindowBasedOnTitle(const char *title);
COLOUR_TYPE **getWindowOutput(WINDOW_HANDLE_TYPE wnd);
void sendKeySym(char key, WINDOW_HANDLE_TYPE wnd);
void setMouseXY(int x, int y, WINDOW_HANDLE_TYPE wnd);
void simClick(bool left, WINDOW_HANDLE_TYPE wnd);

[Ancient Dragon]

1. EnumWindows()

2. See my previous post about gdi functions, especially BitBit()

[L7Sqr]

You may also want to have a look at AutoIt
It might save you the trouble of re-inventing the wheel if you dont need the gritty details.

[Labdabeta]

Ok, I read the links and I understand how to identify a window and how to copy the output of its device context. What I still do not understand is how to send virtual keysyms/mouse clicks/mouse movements?

[Ancient Dragon]

SendInputs()

[Labdabeta]

Perfect! :)