Hello all,
i want to ask a question about retrieving embedded javascript pages from
website:
my problem is that i'm currently working on possibility of mirroring some
websites whith wget - but when the page contains javascript i just cannot
fetch recursively all links from that page... and this is normal behaviour.
what i thought to do is something like
RECURSIVELY='-m'
OUTPUT_TO='-O'
fetch(url) {
wget url $OUTPUT_TO page.local
if contains_javasc ript(page.local ); then
javascript_shel l_fetches_all_p ossible_links page.local > links.pool
for i in `cat links.pool`; do
wget $RECURSIVELY $i
done
else
wget $RECURSIVELY page.local
fi
mv page.local page.html
}
as you see the real problem is javascript_shel l_fetches_all_l inks: but i
thought that this point could be solved thanks to some existing javascript
shell as jython or rhine.
first of all can someone among you tell me if this solution could be
feasible (or codable in a reasonable period of time)...
.... any suggestion is appreciated (besides solutions that imply use of
commercial products)
--
Hekaton Keires,
En to phronein maedhen aedistos bios.
i want to ask a question about retrieving embedded javascript pages from
website:
my problem is that i'm currently working on possibility of mirroring some
websites whith wget - but when the page contains javascript i just cannot
fetch recursively all links from that page... and this is normal behaviour.
what i thought to do is something like
RECURSIVELY='-m'
OUTPUT_TO='-O'
fetch(url) {
wget url $OUTPUT_TO page.local
if contains_javasc ript(page.local ); then
javascript_shel l_fetches_all_p ossible_links page.local > links.pool
for i in `cat links.pool`; do
wget $RECURSIVELY $i
done
else
wget $RECURSIVELY page.local
fi
mv page.local page.html
}
as you see the real problem is javascript_shel l_fetches_all_l inks: but i
thought that this point could be solved thanks to some existing javascript
shell as jython or rhine.
first of all can someone among you tell me if this solution could be
feasible (or codable in a reasonable period of time)...
.... any suggestion is appreciated (besides solutions that imply use of
commercial products)
--
Hekaton Keires,
En to phronein maedhen aedistos bios.
Comment