Replacement for DataTable

Collapse
This topic is closed.
X
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • Brian Richards
    #1

    Replacement for DataTable

    Can anyone suggest a replacement, 3rd party or otherwise, object for
    DataTable. We're running into performance issues with large dataset (>30k)
    rows. Looking for something that can do binary serialization, typed column
    row data, primary keys, filtering etc. SQL desktop engine or some other
    database is not an option at this point.

    Thanks

    Briann


    Tags: None
    • =?ISO-8859-1?Q?G=F6ran_Andersson?=
      #2
      Re: Replacement for DataTable

      Brian Richards wrote:
      Can anyone suggest a replacement, 3rd party or otherwise, object for
      DataTable. We're running into performance issues with large dataset (>30k)
      rows. Looking for something that can do binary serialization, typed column
      row data, primary keys, filtering etc. SQL desktop engine or some other
      database is not an option at this point.
      Why isn't a database an option? My very first suggestion would be just that.

      --
      Göran Andersson
      _____
      guffa.com
      http://www.guffa.com
      Göran Anderssons privata hemsida.

        Comment

        • moo
          #3
          Re: Replacement for DataTable

          On Jul 21, 6:27 pm, Göran Andersson <gu...@guffa.co mwrote:
          Brian Richards wrote:
          Can anyone suggest a replacement, 3rd party or otherwise, object for
          DataTable. We're running into performance issues with large dataset (>30k)
          rows. Looking for something that can do binary serialization, typed column
          row data, primary keys, filtering etc. SQL desktop engine or some other
          database is not an option at this point.
          >
          Why isn't a database an option? My very first suggestion would be just that.
          >
          --
          Göran Andersson
          _____http://www.guffa.com

          My database teacher would laugh at me for saying this, but have you
          considered XML and XPath? I'm not sure of the performance
          implications, but it's the alternative that springs most readily to
          mind...

            Comment

            • AlexS
              #4
              Re: Replacement for DataTable

              Datasets are keeping complete result sets and related data in memory, so you
              have to deal with unavoidable performance issues.

              If you create data sets and tables programmaticall y, you must implement some
              kind of db engine to persist data and page through big tables / result sets.
              Which doesn't make much sense considering availability of various db
              engines, both commercial and free ones. All replacements will implement some
              kind of db engine. XML won;t solve your performance issues and might make
              situation worse, as parsing complete files will clog your memory with lots
              of residuals. Also, it'll double memory consumption.

              Now you have troubles with 30K rows. Consider what kind of issues you'll
              have with 300K rows. Don't bump into brick wall.

              Real question is: what kind of issues you have with 30K rows. This number is
              not that big. Any specific details?


              "Brian Richards" <brichards@phar sight.comwrote in message
              news:uTa$Ui$yHH A.2224@TK2MSFTN GP02.phx.gbl...
              Can anyone suggest a replacement, 3rd party or otherwise, object for
              DataTable. We're running into performance issues with large dataset (>30k)
              rows. Looking for something that can do binary serialization, typed column
              row data, primary keys, filtering etc. SQL desktop engine or some other
              database is not an option at this point.
              >
              Thanks
              >
              Briann
              >

                Comment

                • Brian Richards
                  #5
                  Re: Replacement for DataTable

                  My database teacher would laugh at me for saying this, but have you
                  considered XML and XPath? I'm not sure of the performance
                  implications, but it's the alternative that springs most readily to
                  mind...
                  I'm pretty sure XML is the exact reason that the DataTable performance is so
                  awful. Because it's XML internally.




                    Comment

                    • Jesse Houwing
                      #6
                      Re: Replacement for DataTable

                      * Brian Richards wrote, On 22-7-2007 2:38:
                      Can anyone suggest a replacement, 3rd party or otherwise, object for
                      DataTable. We're running into performance issues with large dataset (>30k)
                      rows. Looking for something that can do binary serialization, typed column
                      row data, primary keys, filtering etc. SQL desktop engine or some other
                      database is not an option at this point.
                      >
                      Thanks
                      >
                      Briann
                      >
                      >
                      Have you tried SQL Server CE (previously only available on Windows
                      Mobile, but work sin any .NET app now).

                      Jesse

                        Comment

                        • =?ISO-8859-1?Q?G=F6ran_Andersson?=
                          #7
                          Re: Replacement for DataTable

                          Brian Richards wrote:
                          >My database teacher would laugh at me for saying this, but have you
                          >considered XML and XPath? I'm not sure of the performance
                          >implications , but it's the alternative that springs most readily to
                          >mind...
                          >
                          I'm pretty sure XML is the exact reason that the DataTable performance is so
                          awful. Because it's XML internally.
                          >
                          I don't think that's the case, as DataTables work with data in native
                          format, and XML is only text.

                          --
                          Göran Andersson
                          _____
                          guffa.com
                          http://www.guffa.com
                          Göran Anderssons privata hemsida.

                            Comment

                            • Jon Skeet [C# MVP]
                              #8
                              Re: Replacement for DataTable

                              Brian Richards <brichards@phar sight.comwrote:
                              My database teacher would laugh at me for saying this, but have you
                              considered XML and XPath? I'm not sure of the performance
                              implications, but it's the alternative that springs most readily to
                              mind...
                              >
                              I'm pretty sure XML is the exact reason that the DataTable performance is so
                              awful. Because it's XML internally.
                              No it's not. Just because it can load from XML and save to XML doesn't
                              mean its internal storage is XML.

                              --
                              Jon Skeet - <skeet@pobox.co m>
                              http://www.pobox.com/~skeet Blog: http://www.msmvps.com/jon.skeet
                              If replying to the group, please do not mail me too

                                Comment

                                Previous template Next
                                Working...