CURL with JS Query

**daint** · Mar 19 '10, 11:26 AM

Hello,

I'm currently trying to query an HTML page to extract data into a DB via the CURL command. The page containing the data is a frame within a 'parent' window. The parent window expects a number of parameters (which it uses as a form of login), then the 'child' window is displayed.

Code of the 'parent window'...

Code:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1">
<title>Page Title</title>
<script language="javascript">

var ready=false;
var mLoaded=false;
</script>
</head>
<frameset rows="*,1" border=0>
	<frame name="Aleft" src="Main.html" scrolling=auto noresize border=0 frameborder=0 marginwidth=5 marginheight=0>
	<frame name="Aright" src="Other.html" scrolling=no noresize border=0 frameborder=0 marginwidth=0 marginheight=0>
</frameset>
</html>

When I load the 'child' window (Main.html) straight into my browser I get an invalid ID error result, but when I first go to the 'parent' frame page, then again directly to the 'child' frame, it's fine. I've tried passing the parameters used in the 'parent' URL straight into the 'child' URL, but it makes no difference.

The HTML from the frame page doesn't pass any additional parameters to the 'child' page, but does contain...

Code:

<script language="javascript">

var ready=false;
var mLoaded=false;
</script>

I can't see anything else that would make a difference. I've tried all URLs with the NoScripts plugin switched on within Firefox and I get the same response, which rules out Javascript and any security that may be applied using Javascript. But it almost seems that the 'child' window is querying the 'parent' window for validation - despite Javascript not being used.

Could the 'child' window be checking the referer? COuld there be some cookies somewhere and I'm just not seeing it / them?

Essentially my question is, how can I grab data from this 'child' window? I know I haven't given links (due to the sensitive nature of the data and server in question), but I'm assuming similar problems have been encountered in the past?

Any help is greatly appreciated, thanks
Rob