Sparse and Parse Pattern

Home Page › Forums › BizTalk 2004 – BizTalk 2010 › Sparse and Parse Pattern

Viewing 1 reply thread
  • Author
    Posts
    • February 22, 2010 at 2:23 PM #24269
      community-content

        Has anyone ever implemented the sparse and parse pattern to production to process multi GB files?  We have sucessfully created a BizTalk 2009 flow that will read a MMD message, which contains the information about the file the process.  One of the challenge that we have is how to parse a multi GB file down into the individual records without impacting the memory on the server.  The files that we are processing can be XML, Delimited or a copybook format.  Does anyone have any recommendation that they have implemented into production for this problem?

      • February 22, 2010 at 6:37 PM #24271
        community-content

          Hi,

           

              I have not implemented such requirements in a production environment, but you might want to check the following article on guidelines to consume very large messages in BizTalk (it was written for version 2004, but I think it’s still relevant for version 2009):

           

          http://blogs.msdn.com/biztalk_core_engine/archive/2005/02/28/381700.aspx

           

              Also, you might want to look into project “Velocity”, Microsoft’s distributed in-memory application cache for scalability and performance in your scenario.

           

              Daniel.

           

      • Author
        Posts
      Viewing 1 reply thread
      • The forum ‘BizTalk 2004 – BizTalk 2010’ is closed to new topics and replies.