PySQLLite Speed

Collapse
This topic is closed.
X
X
 
  • Time
  • Show
Clear All
new posts
  • Kevin

    #1

    PySQLLite Speed

    Hello All,

    I wondering if anyone has encountered the same issue
    with using PySQL. This is my first time using this DB
    so this preformance may be typical. I'm reading an
    ASCII file through PyParse that contains about 1.3Meg
    of Float data. 8000 Triangles (3 Vertexes and 1
    Normal). This file reads fine the PC has a
    utilization of 50% for Python. Then when it starts to
    write the Database, the PC Util drops to 1-2% and it
    takes forever. I'm not PC related preformance
    barriers that I'm aware of.

    Regards,
    Kevin

    OS : Windows
    PySQLLite Version: 1.1.5





    _______________ _______________ ____
    Do you Yahoo!?
    Yahoo! Mail - 250MB free storage. Do more. Manage less.

  • Robert Kern

    #2
    Re: PySQLLite Speed

    Kevin wrote:[color=blue]
    > Hello All,
    >
    > I wondering if anyone has encountered the same issue
    > with using PySQL. This is my first time using this DB
    > so this preformance may be typical. I'm reading an
    > ASCII file through PyParse that contains about 1.3Meg
    > of Float data. 8000 Triangles (3 Vertexes and 1
    > Normal). This file reads fine the PC has a
    > utilization of 50% for Python. Then when it starts to
    > write the Database, the PC Util drops to 1-2% and it
    > takes forever. I'm not PC related preformance
    > barriers that I'm aware of.[/color]

    I can't comment on PySQLite's speed. However, I do recommend that you
    look at PyTables if all of your data is numerical, as it seems to be.

    Download PyTables - Hierarchical datasets for free. The goal of PyTables is to enable the end user to efficiently and easily manipulate large datasets (both homogenous, i.e. arrays, and heterogenous, i.e.


    --
    Robert Kern
    rkern@ucsd.edu

    "In the fields of hell where the grass grows high
    Are the graves of dreams allowed to die."
    -- Richard Harter

    Comment

    • Robert Kern

      #3
      Re: PySQLLite Speed

      Kevin wrote:[color=blue]
      > Hello All,
      >
      > I wondering if anyone has encountered the same issue
      > with using PySQL. This is my first time using this DB
      > so this preformance may be typical. I'm reading an
      > ASCII file through PyParse that contains about 1.3Meg
      > of Float data. 8000 Triangles (3 Vertexes and 1
      > Normal). This file reads fine the PC has a
      > utilization of 50% for Python. Then when it starts to
      > write the Database, the PC Util drops to 1-2% and it
      > takes forever. I'm not PC related preformance
      > barriers that I'm aware of.[/color]

      I can't comment on PySQLite's speed. However, I do recommend that you
      look at PyTables if all of your data is numerical, as it seems to be.

      Download PyTables - Hierarchical datasets for free. The goal of PyTables is to enable the end user to efficiently and easily manipulate large datasets (both homogenous, i.e. arrays, and heterogenous, i.e.


      --
      Robert Kern
      rkern@ucsd.edu

      "In the fields of hell where the grass grows high
      Are the graves of dreams allowed to die."
      -- Richard Harter

      Comment

      • Roger Binns

        #4
        Re: PySQLLite Speed


        "Kevin" <kmcbrearty@yah oo.com> wrote in message news:mailman.70 44.1102033348.5 135.python-list@python.org ...[color=blue]
        > Then when it starts to
        > write the Database, the PC Util drops to 1-2% and it
        > takes forever. I'm not PC related preformance
        > barriers that I'm aware of.[/color]

        Your hard disk.

        See the synchronous information in the pragmas:



        See also:




        Roger


        Comment

        • Roger Binns

          #5
          Re: PySQLLite Speed


          "Kevin" <kmcbrearty@yah oo.com> wrote in message news:mailman.70 44.1102033348.5 135.python-list@python.org ...[color=blue]
          > Then when it starts to
          > write the Database, the PC Util drops to 1-2% and it
          > takes forever. I'm not PC related preformance
          > barriers that I'm aware of.[/color]

          Your hard disk.

          See the synchronous information in the pragmas:



          See also:




          Roger


          Comment

          Working...