Fast Index a File System?

Collapse
This topic is closed.
X
X
Collapse
 
  • Page of 1
  • Time
  • Show
Clear All
new posts
Previous template Next
  • james
    #1

    Fast Index a File System?

    Hi Everybody,

    I am trying to build a tree of my entire file system. The tree
    includes attributes like file size and last modified. My current
    implementation is multi threaded using the threadpool, but it takes
    around 10 minutes to complete. I don't understand why it would take
    so long because I think everything I want is in the Master File
    Table. Is there a faster implementation?

    Thanks,
    James
    Tags: None
    • Eps
      #2
      Re: Fast Index a File System?

      james wrote:
      Hi Everybody,
      >
      I am trying to build a tree of my entire file system. The tree
      includes attributes like file size and last modified. My current
      implementation is multi threaded using the threadpool, but it takes
      around 10 minutes to complete. I don't understand why it would take
      so long because I think everything I want is in the Master File
      Table. Is there a faster implementation?
      >
      Thanks,
      James
      I am kinda doing a similar thing, indexing my mp3 collection, the
      approach I have gone for is to store all the meta information in a sql
      lite database. All the program does when it starts up is check whether
      each file is there (disable or delete the record from the db if it is
      not), its very quick to load (i am using it on ~10,000 plus files).

      The downside is that you need to populate the db to begin with which in
      my case only took about five minutes, I think I should be able to run
      that in a separate thread and still have my app useful, maybe you do the
      same ?.

      Anybody elses thoughts on how to deal with this type of situation would
      be most welcome.

      --
      Eps

        Comment

        • Nicholas Paldino [.NET/C# MVP]
          #3
          Re: Fast Index a File System?

          Have you considered using the Windows Desktop Search API? It indexes
          your files for you (and you can write custom filters for files if there
          isn't a preexisting one) and you can query the results programmaticall y.


          --
          - Nicholas Paldino [.NET/C# MVP]
          - mvp@spam.guard. caspershouse.co m

          "james" <james.wren@gma il.comwrote in message
          news:a300e6d2-14fc-4cf8-a94b-1fcc60e9f03b@q7 7g2000hsh.googl egroups.com...
          Hi Everybody,
          >
          I am trying to build a tree of my entire file system. The tree
          includes attributes like file size and last modified. My current
          implementation is multi threaded using the threadpool, but it takes
          around 10 minutes to complete. I don't understand why it would take
          so long because I think everything I want is in the Master File
          Table. Is there a faster implementation?
          >
          Thanks,
          James

            Comment

            Previous template Next
            Working...