Receive Pipeline : Out of Memory exceptions

Hello, am trying to understand a bit of streaming in a Receive Pipeline. we have a requirement like a flat file comes in; for each Header record there may be 1 or more detail records. in the receive pipleine , first ,we need to archive the file;then every Header record needs to be prefixed with a certain character and detail with a certain character. then the file needs to be disassembled.

In our pipeline component, we have 2 custom stage components and the Biztalk Flat file disassembler; totally 3 stage components; the first stage component does the archiving; it reads the received file path and name from the context and uses the SYStem.IO.File.Copy method to copy the file to the archive folder. Is this the best way of doing this?

In the second component for adding the unique characters for Header and Detail, we do the following:

 

 

 

 

 

 

IBaseMessagePart bodyPart = InMsg.BodyPart;

 

 

Encoding encoding = Encoding.GetEncoding(1252);

 

 

Stream StreamObject = bodyPart.GetOriginalDataStream();

 

 

 

Stream mStrm = new MemoryStream();

 

 

StreamWriter strWriter = new StreamWriter(mStrm, encoding);

 

 

StreamReader streamReader = new StreamReader(StreamObject, encoding);

while (streamReader.EndOfStream == false)

{

 line.Append(streamReader.ReadLine());

strWriter.Write(UniqueIdentifier.ToString() + line.ToString() + ”
“);

 .

 .

 }

strWriter.Flush();

 

 

 

 

 

 

 

 

 

 

 

 

 

//Creating new IBaseMessage

IBaseMessage PayLoadMsg =

null;

 

 

//The following code is to convert the string into IBaseMessage

PayLoadMsg = pContext.GetMessageFactory().CreateMessage();

PayLoadMsg.Context = InMsg.Context;

 

 

for (int

i = 0; i < InMsg.PartCount; i++)

{

 

 

//fetch part from original message:

 

 

string partname;

IBaseMessagePart part = InMsg.GetPartByIndex(i,

out partname);

 

 

//copy it to destination message:

 

 

if(partname != InMsg.BodyPartName)

{

PayLoadMsg.AddPart(partname, part,

false);

}

}

IBaseMessagePart body = pContext.GetMessageFactory().CreateMessagePart();

body.PartProperties = InMsg.BodyPart.PartProperties;

mStrm.Flush();

body.Data = mStrm;

 

mStrm.Position = 0;

PayLoadMsg.AddPart(InMsg.BodyPartName, body,

true);

 

 

return PayLoadMsg;

 

 

 Is there any better way of doing this functionality? we are getting out of memory exceptions. Please assist