Useful decorator

[Paul Rubin]

In the course of writing a bunch of generator-oriented code I kept
wanting to temporarily truncate the output of generators for debugging,
i.e. I might have a function like

def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)

where I wanted to test the program on just the first 20 lines of the
file. After a number of rounds of editing the program to wrap an
xrange(20) loop I went to using islice(bazillio n_line_file, 20), but
even more handy was to write this decorator:

def truncate(n):
from itertools import islice
def trunc(gen): # truncate generator to n items
return lambda *a,**kw: islice(gen(*a,* *kw), n)
return trunc

Then to chop bazillion_items to 20 items, I just write:

@truncate(20)
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)

When I want to run the whole file, I comment out the @truncate line,
and if I want to debug again, I just uncomment it.

[James Stroud]

Re: Useful decorator

Paul Rubin wrote:

In the course of writing a bunch of generator-oriented code I kept
wanting to temporarily truncate the output of generators for debugging,
i.e. I might have a function like
>
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)
>
where I wanted to test the program on just the first 20 lines of the
file. After a number of rounds of editing the program to wrap an
xrange(20) loop I went to using islice(bazillio n_line_file, 20), but
even more handy was to write this decorator:
>
def truncate(n):
from itertools import islice
def trunc(gen): # truncate generator to n items
return lambda *a,**kw: islice(gen(*a,* *kw), n)
return trunc
>
Then to chop bazillion_items to 20 items, I just write:
>
@truncate(20)
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)
>
When I want to run the whole file, I comment out the @truncate line,
and if I want to debug again, I just uncomment it.

Thes may be overkill, but how about allowing None as a parameter to
truncate, to allow for programmatic truncation?

# top of module
if DEBUG:
FILETRUNC = 20
else:
FILETRUNC = None

# imported, etc.
def truncate(n):
if n is None:
return lambda gen: gen
from itertools import islice
def trunc(gen): # truncate generator to n items
return lambda *a,**kw: islice(gen(*a,* *kw), n)
return trunc

# in the body somewhere
@truncate(FILET RUNC)
def generate_bazill ion_items():
# etc.

James

[Paul McGuire]

Re: Useful decorator

On Apr 14, 5:03 pm, Paul Rubin <http://phr...@NOSPAM.i nvalidwrote:

In the course of writing a bunch of generator-oriented code I kept
wanting to temporarily truncate the output of generators for debugging,
i.e. I might have a function like
>
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)
>
where I wanted to test the program on just the first 20 lines of the
file. After a number of rounds of editing the program to wrap an
xrange(20) loop I went to using islice(bazillio n_line_file, 20), but
even more handy was to write this decorator:
>
def truncate(n):
from itertools import islice
def trunc(gen): # truncate generator to n items
return lambda *a,**kw: islice(gen(*a,* *kw), n)
return trunc
>
Then to chop bazillion_items to 20 items, I just write:
>
@truncate(20)
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)
>
When I want to run the whole file, I comment out the @truncate line,
and if I want to debug again, I just uncomment it.

You should add this to the Python Wiki at http://wiki.python.org/moin/PythonDecoratorLibrary

-- Paul

[Steven D'Aprano]

Re: Useful decorator

On Sat, 14 Apr 2007 15:03:00 -0700, Paul Rubin wrote:

Then to chop bazillion_items to 20 items, I just write:
>
@truncate(20)
def generate_bazill ion_items():
for line in bazillion_line_ file:
yield itemify(line)
>
When I want to run the whole file, I comment out the @truncate line,
and if I want to debug again, I just uncomment it.

By All-Father Wodan's one good eye! Why not do something like this?

if __debug__:
generate_bazill ion_items = truncate(20)(ge nerate_bazillio n_items)

Now you don't have to comment/uncomment dozens of lines all over your
application, but only set a single global.



--
Steven.

[Paul Rubin]

Re: Useful decorator

Steven D'Aprano <steve@REMOVE.T HIS.cybersource .com.auwrites:

if __debug__:
generate_bazill ion_items = truncate(20)(ge nerate_bazillio n_items)
>
Now you don't have to comment/uncomment dozens of lines all over your
application, but only set a single global.

The cool thing about organizing the program as a generator pipeline is
you only have to comment or uncomment one line ;).