How big can XML file be?

**Peter Rilling** · Nov 16 '05, 11:09 AM

Re: How big can XML file be?

Well, the XML engine might have some inherit limit as far as the number of
child nodes for instance. After all, if Count is an int, then at least you
cannot exceed that max value.

More interesting concerns might be the memory usage and the processing time.
The memory footprint for XML (if loaded in a DOM) is probably exponential.
Also, the time required to access a node is also great if using an XPath.

For small requirements, it might not be a big problem, but these are also
issues you need to consider when using XML rather then RDBMS.

Although, I do not know exact numbers to answer your questions.

"kids_pro" <kids_pro@yahoo .com> wrote in message
news:%23pgjzlgl EHA.3720@TK2MSF TNGP12.phx.gbl. ..[color=blue]
> Hi there,
>
> I have a quick question. I want to store all my data in XML file so that I
> don't need to depend on database backend. But I wonder how big can my XML
> file be?
>
> I don't mind to span the data into multiple file but I less I know the
> limitation first.
>
> Cheers,
> Kids
>
>[/color]

**clintonG** · Nov 16 '05, 11:09 AM

Re: How big can XML file be?

Really Really Really Big.
I've read news items where they were discussing the best
methodology to manage a 52Mb file.

--
<%= Clinton Gallagher, "Twice the Results -- Half the Cost"
Architectural & e-Business Consulting -- Software Development
NET csgallagher@REM OVETHISTEXTmetr omilwaukee.com
URL http://www.metromilwaukee.com/clintongallagher/

"kids_pro" <kids_pro@yahoo .com> wrote in message
news:%23pgjzlgl EHA.3720@TK2MSF TNGP12.phx.gbl. ..[color=blue]
> Hi there,
>
> I have a quick question. I want to store all my data in XML file so that I
> don't need to depend on database backend. But I wonder how big can my XML
> file be?
>
> I don't mind to span the data into multiple file but I less I know the
> limitation first.
>
> Cheers,
> Kids
>
>[/color]

**kids_pro** · Nov 16 '05, 11:09 AM

Re: How big can XML file be?

52 MB ? Wow that is more than enough for my problem.
My estimate size if about half of this.

I only have less than 4 level nodes.
So you think XPath can live with this requierment?

I reason I go to XML rather RDBMS (like Ms. Access or SQL)
cuz it doesn't support our unicode set 1780-17FF I can't make query using
these RDBMS.

Cheers,
Kids

"clintonG" <csgallagher@RE MOVETHISTEXTmet romilwaukee.com > wrote in message
news:u2r2Z2glEH A.3988@tk2msftn gp13.phx.gbl...[color=blue]
> Really Really Really Big.
> I've read news items where they were discussing the best
> methodology to manage a 52Mb file.
>
> --
> <%= Clinton Gallagher, "Twice the Results -- Half the Cost"
> Architectural & e-Business Consulting -- Software Development
> NET csgallagher@REM OVETHISTEXTmetr omilwaukee.com
> URL http://www.metromilwaukee.com/clintongallagher/
>
>
>
> "kids_pro" <kids_pro@yahoo .com> wrote in message
> news:%23pgjzlgl EHA.3720@TK2MSF TNGP12.phx.gbl. ..[color=green]
> > Hi there,
> >
> > I have a quick question. I want to store all my data in XML file so that[/color][/color]
I[color=blue][color=green]
> > don't need to depend on database backend. But I wonder how big can my[/color][/color]
XML[color=blue][color=green]
> > file be?
> >
> > I don't mind to span the data into multiple file but I less I know the
> > limitation first.
> >
> > Cheers,
> > Kids
> >
> >[/color]
>
>[/color]

**Greg** · Nov 16 '05, 11:10 AM

How big can XML file be?

I had read somewhere that an XML file can go upto a
Gigabyte..

Is this true
[color=blue]
>-----Original Message-----
>Hi there,
>
>I have a quick question. I want to store all my data in[/color]
XML file so that I[color=blue]
>don't need to depend on database backend. But I wonder[/color]
how big can my XML[color=blue]
>file be?
>
>I don't mind to span the data into multiple file but I[/color]
less I know the[color=blue]
>limitation first.
>
>Cheers,
>Kids
>
>
>.
>[/color]

**Dennis Myrén** · Nov 16 '05, 11:10 AM

Re: How big can XML file be?

Using a DOM approach the limit would logically be the
amount of RAM available.
Therefore, a gigabyte XML document is not very likely
to be able to be parsed using DOM.
However, using a SAX approach or System.Xml.XmlR eader,
it would, at least in theory, be possible.

--
Regards,
Dennis JD Myrén
Oslo Kodebureau
"Greg" <greg@discussio ns.microsoft.co m> wrote in message
news:082c01c496 5b$39b52660$a40 1280a@phx.gbl.. .[color=blue]
>
> I had read somewhere that an XML file can go upto a
> Gigabyte..
>
> Is this true
>[color=green]
> >-----Original Message-----
> >Hi there,
> >
> >I have a quick question. I want to store all my data in[/color]
> XML file so that I[color=green]
> >don't need to depend on database backend. But I wonder[/color]
> how big can my XML[color=green]
> >file be?
> >
> >I don't mind to span the data into multiple file but I[/color]
> less I know the[color=green]
> >limitation first.
> >
> >Cheers,
> >Kids
> >
> >
> >.
> >[/color][/color]

**Russ Gray** · Nov 16 '05, 11:12 AM

Re: How big can XML file be?

Dennis Myrén wrote:
[color=blue]
> Using a DOM approach the limit would logically be the
> amount of RAM available.
> Therefore, a gigabyte XML document is not very likely
> to be able to be parsed using DOM.
> However, using a SAX approach or System.Xml.XmlR eader,
> it would, at least in theory, be possible.[/color]

It's certainly possible with an XmlTextReader - I've processed xml files
well in excess of a gigabyte (on occasion closer to 3 GB) whilst testing
the large-file capabilities of some inhouse software. I wouldn't want to
try it with an XmlDocument or DataSet though.

--
Remove SHOES to reply.

**Ignacio Machin \( .NET/ C# MVP \)** · Nov 16 '05, 11:12 AM

Re: How big can XML file be?

Hi,

It depends of your platform, memory availability, etc

I have a 13-15 MB xml file and it works just fine.
Please note that this is only intended for datastorage, In memory it's a
dataset.

cheers,

--
Ignacio Machin,
ignacio.machin AT dot.state.fl.us
Florida Department Of Transportation

"kids_pro" <kids_pro@yahoo .com> wrote in message
news:%23pgjzlgl EHA.3720@TK2MSF TNGP12.phx.gbl. ..[color=blue]
> Hi there,
>
> I have a quick question. I want to store all my data in XML file so that I
> don't need to depend on database backend. But I wonder how big can my XML
> file be?
>
> I don't mind to span the data into multiple file but I less I know the
> limitation first.
>
> Cheers,
> Kids
>
>[/color]

**Kim Schulz** · Nov 16 '05, 11:12 AM

Re: How big can XML file be?

On Thu, 9 Sep 2004 08:09:40 +0700
"kids_pro" <kids_pro@yahoo .com> wrote:
[color=blue]
> Hi there,
>
> I have a quick question. I want to store all my data in XML file so
> that I don't need to depend on database backend. But I wonder how big
> can my XML file be?
>
> I don't mind to span the data into multiple file but I less I know the
> limitation first.[/color]

we have xml files with map data that has sizes above 1gb each.

takes time to parse, but they work

--
Kim Schulz | Need a Content Management System for your website? Go
Geek by nature | get Fundanemt at : http://www.fundanemt.com New
schulz.dk | version out now!

**kids_pro** · Nov 16 '05, 11:20 AM

Re: How big can XML file be?

Is it okay to query large XML file?
What is the best practise?

"Kim Schulz" <kim@schulz.d k> wrote in message
news:2004090921 2914.07ea2863@l ifesuckz.nork.a uc.dk...[color=blue]
> On Thu, 9 Sep 2004 08:09:40 +0700
> "kids_pro" <kids_pro@yahoo .com> wrote:
>[color=green]
> > Hi there,
> >
> > I have a quick question. I want to store all my data in XML file so
> > that I don't need to depend on database backend. But I wonder how big
> > can my XML file be?
> >
> > I don't mind to span the data into multiple file but I less I know the
> > limitation first.[/color]
>
> we have xml files with map data that has sizes above 1gb each.
>
> takes time to parse, but they work
>
> --
> Kim Schulz | Need a Content Management System for your website? Go
> Geek by nature | get Fundanemt at : http://www.fundanemt.com New
> schulz.dk | version out now![/color]

**Richard Blewett [DevelopMentor]** · Nov 16 '05, 11:21 AM

Re: How big can XML file be?

If you are going to process a large XML file you should use XmlTextReader (as opposed to XmlDocument or XPathDocument) as XmlTextReader doesn?t parse the document into a DOM tree.

The only drawback is your code is more complex as you are writing to a lower level interface rather than using XPath.

Regards

Richard Blewett ? DevelopMentor

http://staff.develop.com/richardb/weblog

?
nntp://news.microsoft. com/microsoft.publi c.dotnet.langua ges.csharp/
Is it okay to query large XML file?
What is the best practise?

"Kim Schulz" wrote in message news:2004090921 2914.07ea2863@l ifesuckz.nork.a uc.dk...[color=blue]
> On Thu, 9 Sep 2004 08:09:40 +0700
> "kids_pro" wrote:
>[color=green]
> > Hi there,
> >
> > I have a quick question. I want to store all my data in XML file so
> > that I don't need to depend on database backend. But I wonder how
> > big can my XML file be?
> >
> > I don't mind to span the data into multiple file but I less I know
> > the limitation first.[/color]
>
> we have xml files with map data that has sizes above 1gb each.
>
> takes time to parse, but they work
>
> --
> Kim Schulz | Need a Content Management System for your website? Go
> Geek by nature | get Fundanemt at : http://www.fundanemt.com New
> schulz.dk | version out now![/color]

---
Incoming mail is certified Virus Free.
Checked by AVG anti-virus system (http://www.grisoft.com).
Version: 6.0.760 / Virus Database: 509 - Release Date: 10/09/2004

[microsoft.publi c.dotnet.langua ges.csharp]

How big can XML file be?

How big can XML file be?

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment

Comment