SQLXML Bulk Loading or MSMQ

Collapse
This topic is closed.
X
X
 
  • Time
  • Show
Clear All
new posts
  • ram_kri

    SQLXML Bulk Loading or MSMQ

    Hi,
    I have a batch process that runs in the night on a daily basis.
    Basically one of the folders gets a huge xml file which has multiple nodes
    of same type, as shown below :
    <myParentNode >
    <ChildNode>
    <a>..</a>
    <b>..</b>
    <c>..</c>
    </childNode>
    <ChildNode>
    <a>..</a>
    <b>..</b>
    <c>..</c>
    </childNode>
    <ChildNode>
    <a>..</a>
    <b>..</b>
    <c>..</c>
    </childNode>
    </myParentNode>

    Basically there could be around 50,000 childNodes carrying lot of info.
    The batch Process as of today just BulkLoads the xml into a staging table
    and then runs a Stored Proc that copies data from the Staging table to the
    appropriate Master tables.

    I was just thinking what could be another alternative to this. How good is
    MSMQ in this scenario. I can put the xml into a queue and then take it,
    break it into individual small xmls each containing one childNode xml and
    send it to another queue that processes it and sends the data into the
    Master tables.

    Which is the better thing to do here ? Are there any other alternatives
    for this ?
    Thanks in advance.

    Cheers,
    Kris

Working...