Function metadata (like Java annotations) in Python

[oripel]

Hi,

I'm trying to attach some attributes to functions and methods, similar
to Java annotations and .NET attributes.
I also want to use a convenient decorator for it, something along the
lines of

@attr(name="xan der", age=10)
def foo():
...

Assigning attributes to the function will work, as will assigning keys
and values to a dictionary in an attribute. But if there are more
decorators in the way, this could fail:

@onedec
@attr(...)
@twodec
def foo():
...

Given 'foo' now, how do I find the attributes?

Assigning to a global attribute registry (some interpreter-global
dictionary), although less desirable, might have been acceptable, but
then how do I identify the function after it's been wrapped in more
decorators?

Also, it may be nice to have the following work as well:

@attr(name="Xan der")
@attr(age=10)
@somedec
@attr(hobby="kn itting")
def foo():
...


Any thoughts? Am I rehashing something old that my search skills didn't
uncover?

Thanks!
Ori.

[bearophileHUGS@lycos.com]

Re: Function metadata (like Java annotations) in Python

oripel:

Maybe this is a silly suggestion, the docstring is already overloaded,
but it may be used for this too:

def foo():
"""
...
...
@ATTR name="Xander"
@ATTR age=10
@ATTR hobby="knitting "
"""
...

(Or somethins similar without the @). Later you can retrive the
attributes from the docstring, for example using a verbose RE like:
r"\s* @ATTR \s+ (\w*) \s* = \s* (.*)"
And you use it to create a dict of attributes.
The decorators you apply to foo() must keep its docstring too.

Bye,
bearophile

[fumanchu]

Re: Function metadata (like Java annotations) in Python

oripel wrote:

I'm trying to attach some attributes to functions and methods, similar
to Java annotations and .NET attributes.
...
Assigning attributes to the function will work, as will assigning keys
and values to a dictionary in an attribute. But if there are more
decorators in the way, this could fail:
>
@onedec
@attr(...)
@twodec
def foo():
...
>
Given 'foo' now, how do I find the attributes?
...
Any thoughts? Am I rehashing something old that my search skills didn't
uncover?

There are past discussions about this; google for "python-dev decorator
metadata". For example:

http://thread.gmane.org/gmane.comp.python.devel/77506/focus=77507

Robert Brewer
System Architect
Amor Ministries
fumanchu@amor.o rg

[Paddy]

Re: Function metadata (like Java annotations) in Python

oripel wrote:

Hi,
>
I'm trying to attach some attributes to functions and methods, similar
to Java annotations and .NET attributes.
I also want to use a convenient decorator for it, something along the
lines of
>
@attr(name="xan der", age=10)
def foo():
...
>
Assigning attributes to the function will work, as will assigning keys
and values to a dictionary in an attribute. But if there are more
decorators in the way, this could fail:
>
@onedec
@attr(...)
@twodec
def foo():
...
>
Given 'foo' now, how do I find the attributes?
>
Assigning to a global attribute registry (some interpreter-global
dictionary), although less desirable, might have been acceptable, but
then how do I identify the function after it's been wrapped in more
decorators?
>
Also, it may be nice to have the following work as well:
>
@attr(name="Xan der")
@attr(age=10)
@somedec
@attr(hobby="kn itting")
def foo():
...
>
>
Any thoughts? Am I rehashing something old that my search skills didn't
uncover?
>
Thanks!
Ori.

I wrote up my investigation into function attributes and decorators on
my blog:

http://paddy3118.blogspot.com/2006/05/python-function-attributes.html

http://paddy3118.blogspot.com/2006/05/function-attributes-assigned-by.html

What do you think?

- Paddy.

[oripel]

Re: Function metadata (like Java annotations) in Python

Thanks bearophile,

I prefer not to use docstrings for metadata.

1. Not interfering with the other accepted docstring uses may be
difficult (doctests, epydoc)

2. It's impractical for attributes generated by code:

@attr(reference _profile_stats= pstats.Stats("f oo.profile"))
def foo():
...

Regards,
Ori.

bearophileHUGS@ lycos.com wrote:

oripel:
>
Maybe this is a silly suggestion, the docstring is already overloaded,
but it may be used for this too:
>
def foo():
"""
...
...
@ATTR name="Xander"
@ATTR age=10
@ATTR hobby="knitting "
"""
...
>
(Or somethins similar without the @). Later you can retrive the
attributes from the docstring, for example using a verbose RE like:
r"\s* @ATTR \s+ (\w*) \s* = \s* (.*)"
And you use it to create a dict of attributes.
The decorators you apply to foo() must keep its docstring too.
>
Bye,
bearophile

[oripel]

Re: Function metadata (like Java annotations) in Python

Thanks!

Now I see it's accepted to assume nice decorators that update __dict__.
At least until __decorates__ or something similar is added...

fumanchu wrote:

oripel wrote:

I'm trying to attach some attributes to functions and methods, similar
to Java annotations and .NET attributes.
...
Assigning attributes to the function will work, as will assigning keys
and values to a dictionary in an attribute. But if there are more
decorators in the way, this could fail:

@onedec
@attr(...)
@twodec
def foo():
...

Given 'foo' now, how do I find the attributes?
...
Any thoughts? Am I rehashing something old that my search skills didn't
uncover?

>
There are past discussions about this; google for "python-dev decorator
metadata". For example:

http://thread.gmane.org/gmane.comp.python.devel/77506/focus=77507

>
>
Robert Brewer
System Architect
Amor Ministries
fumanchu@amor.o rg

[oripel]

Re: Function metadata (like Java annotations) in Python

Thanks Paddy - you're showing normal use of function attributes.
They're still hidden when wrapped by an uncooperative decorator.

Paddy wrote:

oripel wrote:

Hi,

I'm trying to attach some attributes to functions and methods, similar
to Java annotations and .NET attributes.
I also want to use a convenient decorator for it, something along the
lines of

@attr(name="xan der", age=10)
def foo():
...

Assigning attributes to the function will work, as will assigning keys
and values to a dictionary in an attribute. But if there are more
decorators in the way, this could fail:

@onedec
@attr(...)
@twodec
def foo():
...

Given 'foo' now, how do I find the attributes?

Assigning to a global attribute registry (some interpreter-global
dictionary), although less desirable, might have been acceptable, but
then how do I identify the function after it's been wrapped in more
decorators?

Also, it may be nice to have the following work as well:

@attr(name="Xan der")
@attr(age=10)
@somedec
@attr(hobby="kn itting")
def foo():
...


Any thoughts? Am I rehashing something old that my search skills didn't
uncover?

Thanks!
Ori.

>
I wrote up my investigation into function attributes and decorators on
my blog:
>

http://paddy3118.blogspot.com/2006/05/python-function-attributes.html

http://paddy3118.blogspot.com/2006/05/function-attributes-assigned-by.html

>
What do you think?
>
- Paddy.

[George Sakkis]

Re: Function metadata (like Java annotations) in Python

oripel wrote:

Thanks Paddy - you're showing normal use of function attributes.
They're still hidden when wrapped by an uncooperative decorator.

The decorator module may be helpful in defining cooperative decorators:

http://www.phyast.pitt.edu/~micheles/python/documentation.html

George

[oripel]

Re: Function metadata (like Java annotations) in Python

Thanks,
In Python 2.5 there are also functools.wraps and
functools.updat e_wrapper:

http://docs.python.org/dev/whatsnew/pep-309.html

George Sakkis wrote:

oripel wrote:

Thanks Paddy - you're showing normal use of function attributes.
They're still hidden when wrapped by an uncooperative decorator.

>
The decorator module may be helpful in defining cooperative decorators:

http://www.phyast.pitt.edu/~micheles/python/documentation.html

>
George