Well, I'm trying to create a crawler of sorts however when I execute a query with a webrequest, before it gets to the final page either javascript or ajax prints "Processing..." on the page while it executes the query. The webrequest grabs the page at the point when the processing is on the page before the result pops in.
Is there a way I can make the webrequest wait until it is finished?
Can you post the example code and URL demonstrating this behavior? A lot of the times when you see "Processing..." the page is waiting for something to happen then sending a redirect to another URL with client-side code that the HttpWebRequest does not understand.
We're a friendly, industry-focused community of developers, IT pros, digital marketers, and technology enthusiasts meeting, networking, learning, and sharing knowledge.