Easiest way to remove duplicates

[rjonam]

What is the easiest way to remove duplicates from a XML file?

[Dormilich]

by what means?

[rjonam]

If the same item present in XMl file many times and while it is published, it appears the no of times it present in the file..How can the duplicates

How the duplicates can be removed..?

[jkmyoung]

Is there any particular technology you're already familiar with? Eg PHP, Perl, sed, awk, xslt?

When you say duplicate, do you mean
1. the node names are the same?
2. an attribute (id?) is the same?
3. Values are the same?

eg
1.
<thisNode>value </thisNode>
<thisNode>other Value</thisNode>

2.
<someNode id="23"/>
<otherNode id="23"/>

3. <box>31</box>
<table>31</table>

[rjonam]

I meant the example 1..

I'm not familiar with the tech which you mentioned..

[jkmyoung]

What language can you use? The solution will differ for each.
Is there a small truncated code sample you can give us?

eg. File A, File B, expected result.