regexp

[vertigo]

Hello

I need to use some regular expressions for more than one line.
And i would like to use some modificators like: /m or /s in perl.
For example:
re.sub("<script .*>.*</script>","",dat a)

will not cut out all javascript code if it's spread on many lines.
I could use something like /s from perl which treats . as all signs
(including new line). How can i do that ?

Maybe there is other way to achieve the same results ?

Thanx

[Fredrik Lundh]

Re: regexp

vertigo wrote:

I need to use some regular expressions for more than one line.
And i would like to use some modificators like: /m or /s in perl.
For example:
re.sub("<script .*>.*</script>","",dat a)
>
will not cut out all javascript code if it's spread on many lines.

that won't cut out all javascript code period.

</F>

[Jonathan Curran]

Re: regexp

On Tuesday 19 December 2006 13:15, vertigo wrote:

Hello
>
I need to use some regular expressions for more than one line.
And i would like to use some modificators like: /m or /s in perl.
For example:
re.sub("<script .*>.*</script>","",dat a)
>
will not cut out all javascript code if it's spread on many lines.
I could use something like /s from perl which treats . as all signs
(including new line). How can i do that ?
>
Maybe there is other way to achieve the same results ?
>
Thanx

Take a look at Chapter 8 of 'Dive Into Python.'

http://diveintopython.org/toc/index.html

You can modify the code there and get the results that you need. Buy the book
if you can :) It has lots of neat examples.

- Jonathan Curran

[vertigo]

Re: regexp

vertigo wrote:

>I need to use some regular expressions for more than one line.
>And i would like to use some modificators like: /m or /s in perl.
>For example:
>re.sub("<scrip t.*>.*</script>","",dat a)
> will not cut out all javascript code if it's spread on many lines.

>
that won't cut out all javascript code period.

do you have any idea what will do ?
i need to cut everything but the pure text data.

Thanx

[vertigo]

Re: regexp

Hello

On Tuesday 19 December 2006 13:15, vertigo wrote:

>Hello
>>
>I need to use some regular expressions for more than one line.
>And i would like to use some modificators like: /m or /s in perl.
>For example:
>re.sub("<scrip t.*>.*</script>","",dat a)
>>
>will not cut out all javascript code if it's spread on many lines.
>I could use something like /s from perl which treats . as all signs
>(including new line). How can i do that ?
>>
>Maybe there is other way to achieve the same results ?
>>
>Thanx

>
Take a look at Chapter 8 of 'Dive Into Python.'

http://diveintopython.org/toc/index.html

>

i read whole regexp chapter - but there was no solution for my problem.
Example:

re.sub("<!--.*-->","",htmldat a)
would remove only comments which are in one line.
If comment is in many lines like this:
<!--start
of
commend, end-->

it would not work. It's because '.' sign does not matches '\n' sign.

Does anybody knows solution for this particular problem ?

Thanx

[johnzenger@gmail.com]

Re: regexp

You want re.sub("(?s)<!--.*?-->", "", htmldata)

Explanation: To make the dot match all characters, including newlines,
you need to set the DOTALL flag. You can set the flag using the (?_)
syntax, which is explained in section 4.2.1 of the Python Library
Reference.

A more readable way to do this is:

obj = re.compile("<!--.*?-->", re.DOTALL)
re.sub("", htmldata)


On Dec 19, 3:59 pm, vertigo <s...@spam.plwr ote:

Hello
>
>
>
>
>

On Tuesday 19 December 2006 13:15, vertigo wrote:

Hello

>

I need to use some regular expressions for more than one line.
And i would like to use some modificators like: /m or /s in perl.
For example:
re.sub("<script .*>.*</script>","",dat a)

>

will not cut out all javascript code if it's spread on many lines.
I could use something like /s from perl which treats . as all signs
(including new line). How can i do that ?

>

Maybe there is other way to achieve the same results ?

>

Thanx

>

Take a look at Chapter 8 of 'Dive Into Python.'
http://diveintopython.org/toc/index.htmli read whole regexp chapter - but there was no solution for my problem.

Example:
>
re.sub("<!--.*-->","",htmldat a)
would remove only comments which are in one line.
If comment is in many lines like this:
<!--start
of
commend, end-->
>
it would not work. It's because '.' sign does not matches '\n' sign.
>
Does anybody knows solution for this particular problem ?
>
Thanx- Hide quoted text -- Show quoted text -

[johnzenger@gmail.com]

Re: regexp

Oops, I mean obj.sub("", htmldata)

On Dec 19, 4:15 pm, johnzen...@gmai l.com wrote:

You want re.sub("(?s)<!--.*?-->", "", htmldata)
>
Explanation: To make the dot match all characters, including newlines,
you need to set the DOTALL flag. You can set the flag using the (?_)
syntax, which is explained in section 4.2.1 of the Python Library
Reference.
>
A more readable way to do this is:
>
obj = re.compile("<!--.*?-->", re.DOTALL)
re.sub("", htmldata)
>
On Dec 19, 3:59 pm, vertigo <s...@spam.plwr ote:
>
>
>

Hello

>

On Tuesday 19 December 2006 13:15, vertigo wrote:
>Hello

>

>I need to use some regular expressions for more than one line.
>And i would like to use some modificators like: /m or /s in perl.
>For example:
>re.sub("<scrip t.*>.*</script>","",dat a)

>

>will not cut out all javascript code if it's spread on many lines.
>I could use something like /s from perl which treats . as all signs
>(including new line). How can i do that ?

>

>Maybe there is other way to achieve the same results ?

>

>Thanx

>

Take a look at Chapter 8 of 'Dive Into Python.'
>http://diveintopython.org/toc/index.htmliread whole regexp chapter - but there was no solution for my problem.

Example:

>

re.sub("<!--.*-->","",htmldat a)
would remove only comments which are in one line.
If comment is in many lines like this:
<!--start
of
commend, end-->

>

it would not work. It's because '.' sign does not matches '\n' sign.

>

Does anybody knows solution for this particular problem ?

>

Thanx- Hide quoted text -- Show quoted text -- Hide quoted text -- Show quoted text -

[vertigo]

Re: regexp

Hello

Thanx for help, i have one more question:

i noticed that while matching regexp python tries to match as wide as it's
possible,
for example:
re.sub("<!--.*-->","",htmldat a)
would cut out everything before first "<!--" and last "-->" in the
document.
Can i force re to math as narrow as possible ?
(to match first "<!--" with the first "-->" after the "<!--" and to repeat
this procedure while mentioned pattern is still found) ?

Thanx

[skip@pobox.com]

Re: regexp


vertigoi noticed that while matching regexp python tries to match as wide as it's
vertigopossible ,
vertigofor example:
vertigore.sub(" <!--.*-->","",htmldat a)
vertigowould cut out everything before first "<!--" and last "-->" in the
vertigodocument .
vertigoCan i force re to math as narrow as possible ?

http://docs.python.org/lib/re-syntax.html

Search for "greedy".

Skip

[Jonathan Curran]

Re: regexp

On Tuesday 19 December 2006 15:32, Paul Arthur wrote:

On 2006-12-19, vertigo <spam@spam.plwr ote:

Hello

Take a look at Chapter 8 of 'Dive Into Python.'
http://diveintopython.org/toc/index.html

i read whole regexp chapter -

>
Did you read Chapter 8? Regexes are 7; 8 is about processing HTML.
Regexes are not well suited to this type of processing.
>

but there was no solution for my problem.
Example:

re.sub("<!--.*-->","",htmldat a)
would remove only comments which are in one line.
If comment is in many lines like this:
<!--start
of
commend, end-->

it would not work. It's because '.' sign does not matches '\n' sign.

Does anybody knows solution for this particular problem ?

>
Yes. Use DOTALL mode.

Paul, I mentioned Chapter 8 so that the HTML processing section would be taken
a look at. What Vertigo wants can be done with relative ease with SGMLlib.

Anyway, if you (Vertigo) want to use regular expressions to do this, you can
try and use some regular expression testing programs. I'm not quite sure of
the name but there is one that comes with KDE.

- Jonathan Curran

[johnzenger@gmail.com]

Re: regexp

Not just Python, but every Regex engine works this way. You want a ?
after your *, as in <--(.*?)--if you want it to catch the first
available "-->".

At this point in your adventure, you might be wondering whether regular
expressions are more trouble than they are worth. They are. There are
two libraries you need to take a look at, and soon: BeautifulSoup for
parsing HTML, and PyParsing for parsing everything else. Take the time
you were planning to spend on deciphering regexes like
"(\d{1,3}\.){3} \d{1,3}" and spend it learning the basics of those
libraries instead -- you will not regret it.

On Dec 19, 4:39 pm, vertigo <s...@spam.plwr ote:

Hello
>
Thanx for help, i have one more question:
>
i noticed that while matching regexp python tries to match as wide as it's
possible,
for example:
re.sub("<!--.*-->","",htmldat a)
would cut out everything before first "<!--" and last "-->" in the
document.
Can i force re to math as narrow as possible ?
(to match first "<!--" with the first "-->" after the "<!--" and to repeat
this procedure while mentioned pattern is still found) ?
>
Thanx