Are Lists thread safe?

[abcd]

Are lists thread safe? Or do I have to use a Lock when modifying the
list (adding, removing, etc)? Can you point me to some documentation
on this?

thanks

[Larry Bates]

Re: Are Lists thread safe?

abcd wrote:

Are lists thread safe? Or do I have to use a Lock when modifying the
list (adding, removing, etc)? Can you point me to some documentation
on this?
>
thanks
>

You really should at least try Google first:

http://effbot.org/pyfaq/what-kinds-of-global-value-mutation-are-thread-safe.htm

-Larry

[Greg Copeland]

Re: Are Lists thread safe?

On Mar 9, 1:03 pm, "abcd" <codecr...@gmai l.comwrote:

Are lists thread safe? Or do I have to use a Lock when modifying the
list (adding, removing, etc)? Can you point me to some documentation
on this?
>
thanks

Yes there are still some holes which can bite you. Adding and
removing is thread safe but don't treat the list as locked between
operations unless you specifically do your own locking. You still
need to be on the lookout for race conditions.

Greg

[abcd]

Re: Are Lists thread safe?

Thanks for the link. I saw that one in my google search but didn't
visit it for some reason.

Looks like most operations should be just fine.

Thanks.

[abcd]

Re: Are Lists thread safe?

I guess this might be overkill then...

class MyList(list):
def __init__(self):
self.l = threading.Lock( )

def append(self, val):
try:
self.l.acquire( )
list.append(sel f, val)
finally:
if self.l.locked() :
self.l.release( )

.....performing the same locking/unlocking for the other methods (i.e.
remove, extend, etc).

[abcd]

Re: Are Lists thread safe?

On Mar 9, 2:50 pm, "abcd" <codecr...@gmai l.comwrote:

I guess this might be overkill then...
>
class MyList(list):
def __init__(self):
self.l = threading.Lock( )
>
def append(self, val):
try:
self.l.acquire( )
list.append(sel f, val)
finally:
if self.l.locked() :
self.l.release( )
>
....performing the same locking/unlocking for the other methods (i.e.
remove, extend, etc).

comments?

[Gabriel Genellina]

Re: Are Lists thread safe?

En Fri, 09 Mar 2007 16:50:04 -0300, abcd <codecraig@gmai l.comescribió:

I guess this might be overkill then...

That depends on your target. For the *current* CPython implementation,
yes, because it has an internal lock. But other versions (like Jython or
IronPython) may not behave that way.

class MyList(list):
def __init__(self):
self.l = threading.Lock( )

Better to use an RLock, and another name instead of l:
self.lock = threading.RLock ()
(A method may call another, and a Lock() won't allow that)

def append(self, val):
try:
self.l.acquire( )
list.append(sel f, val)
finally:
if self.l.locked() :
self.l.release( )

I'd write it as:

def append(self, val):
self.lock.acqui re()
try:
list.append(sel f, val)
finally:
self.lock.relea se()

....performing the same locking/unlocking for the other methods (i.e.
remove, extend, etc).

Note that even if you wrap *all* methods, operations like mylist += other
are still unsafe.

pydef f(self): self.mylist += other
....
pyimport dis; dis.dis(f)
1 0 LOAD_FAST 0 (self)
3 DUP_TOP
4 LOAD_ATTR 0 (mylist)
7 LOAD_GLOBAL 1 (other)
10 INPLACE_ADD
11 ROT_TWO
12 STORE_ATTR 0 (mylist)
15 LOAD_CONST 0 (None)
18 RETURN_VALUE

INPLACE_ADD would call MyList.__iadd__ which you have wrapped. But you
have a race condition between that moment and the following STORE_ATTR, a
context switch may happen in the middle.

It may not be possible to create an absolutely thread-safe list without
some help on the client side. (Comments, someone?)

--
Gabriel Genellina

[Duncan Booth]

Re: Are Lists thread safe?

"Gabriel Genellina" <gagsl-py2@yahoo.com.a rwrote:

INPLACE_ADD would call MyList.__iadd__ which you have wrapped. But you
have a race condition between that moment and the following
STORE_ATTR, a context switch may happen in the middle.
>
It may not be possible to create an absolutely thread-safe list
without some help on the client side. (Comments, someone?)

The list itself can be thread safe quite easily, but if the namespace from
which you reference it is shared between threads you would have to protect
the namespace as well, or avoid using in-place operators.

The rebinding is a mutation on the namespace rather than the object, so
that is what you have to protect.