encrypted or something web page

[Rod Speed]

Re: encrypted or something web page


rf <rf@example.com > wrote in message
news:K1QAc.3907 2$sj4.11076@new s-server.bigpond. net.au...[color=blue]
> Rod Speed <rod_speed@yaho o.com> wrote[color=green]
>> rf <rf@example.com > wrote[color=darkred]
>>> Rod Speed <rod_speed@yaho o.com> wrote[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>>> Have a look at http://www.foxtel.com.au/TVGuide.aspx
>>>> Select a channel in the left hand box, say discovery, hit GO.[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>>> Anyone got any ideas about how to unencrypt it ?[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>> There are any number of ways. For a start copy/paste
>>> this into your address bar: (watch the wrap)[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>> javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerHTML )[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>> It'll show you the HTML contents of that table cell :-)[/color][/color][/color]
[color=blue][color=green]
>> Dont get anything useful when I do that.[/color][/color]
[color=blue]
> Oh, you are right. I gave the alert output the merest of
> glances. Looks like there is more than one level of encryption.
> They Really must not want you to steal their stuff.[/color]

More likely they dont want other online TV Guide operations to do that.
[color=blue]
> Try
> javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerText )[/color]

Same result, nothing happens at all, the address bar contents stays
highlighted but nothing changes on the main body of the window.
[color=blue][color=green]
>> I actually want to import the web pages into access.[/color][/color]
[color=blue]
> Then you are in breach of copyright law.[/color]

Nope. Its no more 'stealing' than reading it off the web page in IE is.
[color=blue]
> If you continue to steal their material I would advise retaining
> a good soliciter. You'll need one if Foxtel find out.[/color]

Nope, perfecty legal in this country.
[color=blue][color=green]
>> I did that with the previous version of those web pages
>> using TransferText but anything that works would suit me fine.[/color][/color]
[color=blue]
> Foxtel obviously don't think that "anything that works" is fine :-)[/color]

Or they just want to prevent other online TV Guide
operations from getting the data from their web pages.

[rf]

Re: encrypted or something web page


"Rod Speed" <rod_speed@yaho o.com> wrote in message
news:2ji2fjF123 g9vU1@uni-berlin.de...[color=blue]
>
> rf <rf@example.com > wrote in message[/color]
[color=blue][color=green][color=darkred]
> >> I actually want to import the web pages into access.[/color][/color]
>[color=green]
> > Then you are in breach of copyright law.[/color]
>
> Nope. Its no more 'stealing' than reading it off the web page in IE is.[/color]

Sorry, I read "import into access" as meaning you were then going to serve
the data up onto another web page. If not then OK, they will never know.

Do I recall discussing this with you a couple of years ago? That is,
scraping stuff off a web page into an access database?

In any case, regardless of what the alert gives you it should be a simple
matter to knock up a C# or C++ program to host the MSHTML control and point
it at the page. Then you have programatic access to the entire DOM.

--
Cheers
Richard.

[Toby A Inkster]

Re: encrypted or something web page

Rod Speed wrote:
[color=blue]
> Have a look at http://www.foxtel.com.au/TVGuide.aspx
> I want to import the data from the web page.
> I used to be able to until they changed the format recently.[/color]

Google: XMLTV.

--
Toby A Inkster BSc (Hons) ARCS
Contact Me - http://www.goddamn.co.uk/tobyink/?page=132

[Falkon]

Re: encrypted or something web page

"Rod Speed" <rod_speed@yaho o.com> wrote in message
news:2ji2fjF123 g9vU1@uni-berlin.de...[color=blue]
>
> rf <rf@example.com > wrote in message
> news:K1QAc.3907 2$sj4.11076@new s-server.bigpond. net.au...[color=green]
> > Rod Speed <rod_speed@yaho o.com> wrote[color=darkred]
> >> rf <rf@example.com > wrote
> >>> Rod Speed <rod_speed@yaho o.com> wrote[/color][/color]
>[color=green][color=darkred]
> >>>> Have a look at http://www.foxtel.com.au/TVGuide.aspx
> >>>> Select a channel in the left hand box, say discovery, hit GO.[/color][/color]
>[color=green][color=darkred]
> >>>> Anyone got any ideas about how to unencrypt it ?[/color][/color]
>[color=green][color=darkred]
> >>> There are any number of ways. For a start copy/paste
> >>> this into your address bar: (watch the wrap)[/color][/color]
>[color=green][color=darkred]
> >>>[/color][/color][/color]
javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerHTML )[color=blue]
>[color=green][color=darkred]
> >>> It'll show you the HTML contents of that table cell :-)[/color][/color]
>[color=green][color=darkred]
> >> Dont get anything useful when I do that.[/color][/color]
>[color=green]
> > Oh, you are right. I gave the alert output the merest of
> > glances. Looks like there is more than one level of encryption.
> > They Really must not want you to steal their stuff.[/color]
>
> More likely they dont want other online TV Guide operations to do that.
>[color=green]
> > Try
> >[/color][/color]
javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerText )[color=blue]
>
> Same result, nothing happens at all, the address bar contents stays
> highlighted but nothing changes on the main body of the window.
>[/color]
<snip>

I get the "html" output (ie the tvguide) but it is in a MS Window alert box.

I can't even copy and paste it.

[Randy Webb]

Re: encrypted or something web page

Falkon wrote:[color=blue]
> "Rod Speed" <rod_speed@yaho o.com> wrote in message
> news:2ji2fjF123 g9vU1@uni-berlin.de...[/color]

<--snip-->
[color=blue]
>
> javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerText )
>[color=green]
>>Same result, nothing happens at all, the address bar contents stays
>>highlighted but nothing changes on the main body of the window.
>>[/color]
>
> <snip>
>
> I get the "html" output (ie the tvguide) but it is in a MS Window alert box.
>
> I can't even copy and paste it.[/color]

javascript:wind ow.clipboardDat a.setData('text ',document.getE lementById("tbl CellTVGuideResu lts").innerText );void%200

In IE will copy it to the clipboard.


--
Randy
Chance Favors The Prepared Mind
comp.lang.javas cript FAQ - http://jibbering.com/faq/

[Lasse Reichstein Nielsen]

Re: encrypted or something web page

"Rod Speed" <rod_speed@yaho o.com> writes:
[color=blue]
> Have a look at http://www.foxtel.com.au/TVGuide.aspx
> Select a channel in the left hand box, say discovery, hit GO.[/color]
....[color=blue]
> There appears to be a block of encrypted stuff down the
> bottom which is about the right size for the program data.
>
> Anyone got any ideas about how to unencrypt it ?[/color]

It seems that the decryption function changes name too. In my current
load of the page, it's called "kt".

To see the "kt" function, simply write this in the address line:
javascript:kt
.... or replace "kt" with the name of the function in your page.

It's rather cryptic. Here is another function that decodes the string
(made without looking at their code, it confuzed more than it helped
anyway):
---
function decode(s) {
var buf = [], n=s.length, h=(n+1)>>1;
for(var i = 0; i<h ; i++) {
buf[i]=s.charAt(i*2+1 );
buf[n-i]=s.charAt(i*2);
}

return buf.join("");
}
---
(I don't know whether it works with even length strings, I only had
an odd length string to test with).


You can't hide parts of a web page from the person who controls the
client :)
/L
--
Lasse Reichstein Nielsen - lrn@hotpop.com
DHTML Death Colors: <URL:http://www.infimum.dk/HTML/rasterTriangleD OM.html>
'Faith without judgement merely degrades the spirit divine.'

[Unknown]

Re: encrypted or something web page


"Rod Speed" <rod_speed@yaho o.com> wrote in message
news:2jhte7F11o 427U1@uni-berlin.de...[color=blue]
>
> John Phillips <flatulentdingo @deadspam.com> wrote in message
> news:1137525670 .20040619141210 @deadspam.com.. .[color=green]
> > Rod Speed wrote[/color]
>[color=green][color=darkred]
> >> Have a look at http://www.foxtel.com.au/TVGuide.aspx
> >> Select a channel in the left hand box, say discovery, hit GO.[/color][/color]
>[color=green][color=darkred]
> >> I want to import the data from the web page.[/color][/color]
>[color=green]
> > Dunno if I followed your instructions correctly, but
> > on Mozilla 1.7 it opens a Flash type file which plays
> > an ad for the Discovery channel. Runs in a loop.[/color]
>[color=green]
> > Is this what you mean?[/color]
>
> Nope, you should get the day's TV guide for that channel.
>
> Looks like its IE specific code since Neil cant see it either.
>
>[/color]

Works OK here. I got timeout when I had ZA Pro running. Otherwise just OK.
Clicking EDIT gets the page fine.

[Rod Speed]

Re: encrypted or something web page


rf <rf@example.com > wrote in message
news:8qRAc.4203 6$sj4.5523@news-server.bigpond. net.au...[color=blue]
> Rod Speed <rod_speed@yaho o.com> wrote[color=green]
>> rf <rf@example.com > wrote in message[/color][/color]
[color=blue][color=green][color=darkred]
>>>> I actually want to import the web pages into access.[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>> Then you are in breach of copyright law.[/color][/color][/color]
[color=blue][color=green]
>> Nope. Its no more 'stealing' than reading it off the web page in IE is.[/color][/color]
[color=blue]
> Sorry, I read "import into access" as meaning you were then
> going to serve the data up onto another web page. If not then OK,[/color]

Yeah, its just for my own use.
[color=blue]
> they will never know.[/color]

And it doesnt matter if they do, completely legal.
[color=blue]
> Do I recall discussing this with you a couple of years ago?
> That is, scraping stuff off a web page into an access database?[/color]

Could be, I certainly had a problem initially with the
foxtel pages needing POST method for access.
[color=blue]
> In any case, regardless of what the alert gives you it should be a simple
> matter to knock up a C# or C++ program to host the MSHTML control and
> point it at the page. Then you have programatic access to the entire DOM.[/color]

[Rod Speed]

Re: encrypted or something web page


"Randy Webb" <hikksnotathome @aol.com> wrote in message news:U7CdnU2NKv dstknd4p2dnA@co mcast.com...[color=blue]
> Falkon wrote:[color=green]
> > "Rod Speed" <rod_speed@yaho o.com> wrote in message
> > news:2ji2fjF123 g9vU1@uni-berlin.de...[/color]
>
> <--snip-->
>[color=green]
> >
> > javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerText )
> >[color=darkred]
> >>Same result, nothing happens at all, the address bar contents stays
> >>highlighted but nothing changes on the main body of the window.
> >>[/color]
> >
> > <snip>
> >
> > I get the "html" output (ie the tvguide) but it is in a MS Window alert box.
> >
> > I can't even copy and paste it.[/color]
>
> javascript:wind ow.clipboardDat a.setData('text ',document.getE lementById("tbl CellTVGuideResu lts").innerText );void%200
>
> In IE will copy it to the clipboard.[/color]

Doesnt here, the clipboard just has that string in it, from when I pasted that to the address bar.

[Rod Speed]

Re: encrypted or something web page

Whoops, this escaped part edited
More added at the bottom.


rf <rf@example.com > wrote in message
news:8qRAc.4203 6$sj4.5523@news-server.bigpond. net.au...[color=blue]
> Rod Speed <rod_speed@yaho o.com> wrote[color=green]
>> rf <rf@example.com > wrote in message[/color][/color]
[color=blue][color=green][color=darkred]
>>>> I actually want to import the web pages into access.[/color][/color][/color]
[color=blue][color=green][color=darkred]
>>> Then you are in breach of copyright law.[/color][/color][/color]
[color=blue][color=green]
>> Nope. Its no more 'stealing' than reading it off the web page in IE is.[/color][/color]
[color=blue]
> Sorry, I read "import into access" as meaning you were then
> going to serve the data up onto another web page. If not then OK,[/color]

Yeah, its just for my own use.
[color=blue]
> they will never know.[/color]

And it doesnt matter if they do, completely legal.
[color=blue]
> Do I recall discussing this with you a couple of years ago?
> That is, scraping stuff off a web page into an access database?[/color]

Yep

http://groups.google.com/groups?threadm=aj9rpt%2419v6lp%241%40ID-69072.news.dfncis.de

[color=blue]
> In any case, regardless of what the alert gives you it should be a simple
> matter to knock up a C# or C++ program to host the MSHTML control and
> point it at the page. Then you have programatic access to the entire DOM.[/color]

Wanna spell that out a bit more please ?

[Rod Speed]

Re: encrypted or something web page


Lasse Reichstein Nielsen <lrn@hotpop.com > wrote
in message news:acyz7m0k.f sf@hotpop.com.. .[color=blue]
> Rod Speed <rod_speed@yaho o.com> writes[/color]
[color=blue][color=green]
>> Have a look at http://www.foxtel.com.au/TVGuide.aspx
>> Select a channel in the left hand box, say discovery, hit GO.[/color][/color]
[color=blue][color=green]
>> There appears to be a block of encrypted stuff down the
>> bottom which is about the right size for the program data.[/color][/color]
[color=blue][color=green]
>> Anyone got any ideas about how to unencrypt it ?[/color][/color]
[color=blue]
> It seems that the decryption function changes name too.
> In my current load of the page, it's called "kt".[/color]

Figures I spose.
[color=blue]
> To see the "kt" function, simply write this in the address line:
> javascript:kt
> ... or replace "kt" with the name of the function in your page.[/color]

Where are you getting the kt from ? Is it the cn in this load ?

<td id="tblCellTVGu ideResults" align="Center"> <SCRIPT LANGUAGE="JavaS cript" src="jscript.as px?a=038158.225 52643520"></SCRIPT>
<SCRIPT LANGUAGE="JavaS cript">cn(" rtseAeanheGs plri,

Looks like it, javascript:cn does produce some visible code.

Thanks for that, I'll have a closer look at that. Looks quite doable.
[color=blue]
> It's rather cryptic. Here is another function that decodes the string
> (made without looking at their code, it confuzed more than it helped
> anyway):
> ---
> function decode(s) {
> var buf = [], n=s.length, h=(n+1)>>1;
> for(var i = 0; i<h ; i++) {
> buf[i]=s.charAt(i*2+1 );
> buf[n-i]=s.charAt(i*2);
> }
>
> return buf.join("");
> }
> ---
> (I don't know whether it works with even length strings,
> I only had an odd length string to test with).[/color]
[color=blue]
> You can't hide parts of a web page
> from the person who controls the client :)[/color]

[Rod Speed]

Re: encrypted or something web page


Toby A Inkster <tobyink@goddam n.co.uk> wrote in message
news:pan.2004.0 6.19.08.07.19.9 3495@goddamn.co .uk...[color=blue]
> Rod Speed wrote:[/color]
[color=blue][color=green]
>> Have a look at http://www.foxtel.com.au/TVGuide.aspx
>> I want to import the data from the web page.
>> I used to be able to until they changed the format recently.[/color][/color]
[color=blue]
> Google: XMLTV.[/color]

Interesting, thanks for that.

Not sure it helps with the particular problem of that particular web page tho.

The other ones are easy enough to import into access.
The problem is that the detail isnt as good, particularly
they lack the episode title and since I am using that to
keep track of what I have watched already, particularly
with the high level of repeats on the PayTV channels like
Discovery, I need more than just the series title for that.

[Lasse Reichstein Nielsen]

Re: encrypted or something web page

"Rod Speed" <rod_speed@yaho o.com> writes:
[color=blue]
> Looks like it, javascript:cn does produce some visible code.[/color]

That's it. :)

/L
--
Lasse Reichstein Nielsen - lrn@hotpop.com
DHTML Death Colors: <URL:http://www.infimum.dk/HTML/rasterTriangleD OM.html>
'Faith without judgement merely degrades the spirit divine.'

[Rod Speed]

Re: encrypted or something web page

Lasse Reichstein Nielsen <lrn@hotpop.com > wrote
in message news:acyz7m0k.f sf@hotpop.com.. .[color=blue]
> Rod Speed <rod_speed@yaho o.com> writes[/color]
[color=blue][color=green]
>> Have a look at http://www.foxtel.com.au/TVGuide.aspx
>> Select a channel in the left hand box, say discovery, hit GO.[/color][/color]
[color=blue][color=green]
>> There appears to be a block of encrypted stuff down the
>> bottom which is about the right size for the program data.[/color][/color]
[color=blue][color=green]
>> Anyone got any ideas about how to unencrypt it ?[/color][/color]
[color=blue]
> It seems that the decryption function changes name too.
> In my current load of the page, it's called "kt".[/color]

Figures I spose.
[color=blue]
> To see the "kt" function, simply write this in the address line:
> javascript:kt
> ... or replace "kt" with the name of the function in your page.[/color]

Where are you getting the kt from ? Is it the cn in this load ?

<td id="tblCellTVGu ideResults" align="Center"> <SCRIPT LANGUAGE="JavaS cript" src="jscript.as px?a=038158.225 52643520"></SCRIPT>
<SCRIPT LANGUAGE="JavaS cript">cn(" rtseAeanheGs plri,

Looks like it, javascript:cn does produce some visible code.

Thanks for that, I'll have a closer look at that. Looks quite doable.
[color=blue]
> It's rather cryptic. Here is another function that decodes the string
> (made without looking at their code, it confuzed more than it helped
> anyway):
> ---
> function decode(s) {
> var buf = [], n=s.length, h=(n+1)>>1;
> for(var i = 0; i<h ; i++) {
> buf[i]=s.charAt(i*2+1 );
> buf[n-i]=s.charAt(i*2);
> }
>
> return buf.join("");
> }
> ---
> (I don't know whether it works with even length strings,
> I only had an odd length string to test with).[/color]
[color=blue]
> You can't hide parts of a web page
> from the person who controls the client :)[/color]

[rf]

Re: encrypted or something web page


"Rod Speed" <rod_speed@yaho o.com> wrote in message
news:2jjjbcF12d 4cuU1@uni-berlin.de...[color=blue]
>
> "Randy Webb" <hikksnotathome @aol.com> wrote in message[/color]
news:U7CdnU2NKv dstknd4p2dnA@co mcast.com...[color=blue][color=green]
> > Falkon wrote:[color=darkred]
> > > "Rod Speed" <rod_speed@yaho o.com> wrote in message
> > > news:2ji2fjF123 g9vU1@uni-berlin.de...[/color]
> >
> > <--snip-->
> >[color=darkred]
> > >
> > >[/color][/color][/color]
javascript:aler t(document.getE lementById("tbl CellTVGuideResu lts").innerText )[color=blue][color=green][color=darkred]
> > >
> > >>Same result, nothing happens at all, the address bar contents stays
> > >>highlighted but nothing changes on the main body of the window.
> > >>
> > >
> > > <snip>
> > >
> > > I get the "html" output (ie the tvguide) but it is in a MS Window[/color][/color][/color]
alert box.[color=blue][color=green][color=darkred]
> > >
> > > I can't even copy and paste it.[/color]
> >
> >[/color][/color]
javascript:wind ow.clipboardDat a.setData('text ',document.getE lementById("tbl C
ellTVGuideResul ts").innerText) ;void%200[color=blue][color=green]
> >
> > In IE will copy it to the clipboard.[/color]
>
> Doesnt here, the clipboard just has that string in it, from when I pasted[/color]
that to the address bar.

You *did* press Enter after you pasted that string to the address bar,
didn't you?

--
Cheers
Richard.