I want to be able to make a program that emulates what a human at a computer can do. IE: I want to be able to read the visual information of a window (a 2d array of colour would be perfect) and be able to send virtual key syms and mouse movements to the window. Is this at all possible, and if so how is it done?
I looked through that, and it seemed to have what I was looking for in terms of reading the info of the window (I can get its coordinates on the screen then use getPixel on the area?) but it had nothing on how to send fake input to a window. Perhaps the broken link contained the info?
Ok, I read the links and I understand how to identify a window and how to copy the output of its device context. What I still do not understand is how to send virtual keysyms/mouse clicks/mouse movements?
For Each ctrl As Control In Me.Controls("pnlMainPanel").Controls
If ctrl.GetType Is GetType(System.Windows.Forms.Panel) Then
For Each subCtrl As Control In ctrl.Controls
If subCtrl.GetType Is GetType(System.Windows.Forms.TextBox) Then
If subCtrl.GetType Is ...