Hi,
I have a batch process that runs in the night on a daily basis.
Basically one of the folders gets a huge xml file which has multiple nodes
of same type, as shown below :
<myParentNode >
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
</myParentNode>
Basically there could be around 50,000 childNodes carrying lot of info.
The batch Process as of today just BulkLoads the xml into a staging table
and then runs a Stored Proc that copies data from the Staging table to the
appropriate Master tables.
I was just thinking what could be another alternative to this. How good is
MSMQ in this scenario. I can put the xml into a queue and then take it,
break it into individual small xmls each containing one childNode xml and
send it to another queue that processes it and sends the data into the
Master tables.
Which is the better thing to do here ? Are there any other alternatives
for this ?
Thanks in advance.
Cheers,
Kris
I have a batch process that runs in the night on a daily basis.
Basically one of the folders gets a huge xml file which has multiple nodes
of same type, as shown below :
<myParentNode >
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
<ChildNode>
<a>..</a>
<b>..</b>
<c>..</c>
</childNode>
</myParentNode>
Basically there could be around 50,000 childNodes carrying lot of info.
The batch Process as of today just BulkLoads the xml into a staging table
and then runs a Stored Proc that copies data from the Staging table to the
appropriate Master tables.
I was just thinking what could be another alternative to this. How good is
MSMQ in this scenario. I can put the xml into a queue and then take it,
break it into individual small xmls each containing one childNode xml and
send it to another queue that processes it and sends the data into the
Master tables.
Which is the better thing to do here ? Are there any other alternatives
for this ?
Thanks in advance.
Cheers,
Kris