Scaling on multi-processor machine

Collapse
This topic is closed.
X
X
 
  • Time
  • Show
Clear All
new posts
  • Atul Kshirsagar

    Scaling on multi-processor machine

    Hello,
    GIL prevents my C++ application embedding and extending python to scale even
    though I spawn multiple C++ threads. I read lot of references on internet
    about using multiple processes rather than threads.

    In that direction I was searching for some examples/resources/tools which
    can help me create multi-process implementation. My application does need to
    pass userdefined class objects to python interpreter. So I guess my
    implementation is going to need a protocol to marshal, de-marshal python
    objects between processes or use shared memory.

    Does anyone here know of any examples/tools to implement the multi-processes
    approach with the object/data transfer between the processes ?
    [color=blue]
    > Atul Kshirsagar
    >[/color]

  • Aahz

    #2
    Re: Scaling on multi-processor machine

    In article <mailman.142.10 85154141.6949.p ython-list@python.org >,
    Atul Kshirsagar <atul.kshirsaga r@firstlogic.co m> wrote:[color=blue]
    >
    >GIL prevents my C++ application embedding and extending python to scale even
    >though I spawn multiple C++ threads. I read lot of references on internet
    >about using multiple processes rather than threads.[/color]

    You're not getting any scaling, or you're not getting enough scaling?
    --
    Aahz (aahz@pythoncra ft.com) <*> http://www.pythoncraft.com/

    Adopt A Process -- stop killing all your children!

    Comment

    Working...