How can Visio Stencil for BizTalk Server help you documenting BizTalk Infrastructures or Integration projects

How can Visio Stencil for BizTalk Server help you documenting BizTalk Infrastructures or Integration projects

Some time ago, I do not remember when or where I was asked to provide some examples of diagrams that I use in my documentation or some diagrams representations in which I use the Visio Stencils for BizTalk Server I know that no one likes to create documentation, is boring, it can be a challenging […]
Blog Post by: Sandro Pereira

Sentinet – Service Virtualization Part 1

A team of Microsoft consultants developed Managed Services Engine(MSE) as an open source project a few years ago. End of December 2009 it was the final CTP release. MSE was meant to facilitate service virtualization to support versioning, abstraction, management, routing, and run-time policy enforcement for Services. It used a service repository to provide easier and faster deployment of services

Can I have 100 BizTalk Server Host Instances?

On occasion you see these questions. Can I run X number of host instances? What will happen? Without diving deep into the reason why you think you need to, or the details of what is happening inside BizTalk Server when you do, I will present some results of doing that.

First, I needed a machine to play around with. I also wanted a reasonably powerful machine, so I where better to go than to Windows Azure? I selected a BizTalk Server 2013 Evaluation Edition pre-configured image.

Choose the Extra Large size – that’s 8 cores and 14 GB of RAM.

When that machine was provisioned for me, this was how the performance of it looked:

Now I am fully aware that viewing only the Task Managers idea of the processor is a very limited view of “performance” but I am purposefully using that view so that you, the reader, understand that this is NOT intended to be a DeepDive. It is merely an indication.

So, I configured a script I have to create 100 hosts and host instances for me, along with handlers for FILE Adapter for those hosts. But so far no ports and no traffic. This is how that looked.

You can see the Processor churning away at about 20% utilization, while Memory is largely unaffected.

Taking it one step further I wanted to make sure that the host instances actually had something to check for, so I created 1 receive port and 100 send ports. One send port for each of the host instances (the Send Port has that hosts handler for the FILE transport).

That put the machine under a little more pressure. Obviously it is doing something more when it actually has ports configured. Processor is at ~60%. Memory again not really affected.

Remember now, this is all just doing nothing at this point. Let’s see what happens if we actually do something:

That piece of the graph marked in blue above, that’s when I dropped a file into the receive port and receive location that all the 100 send ports (one for each of the hosts) were subscribed on. It went to 100% quickly. All files went through quickly though, and the event didn’t last long enough for BizTalk to start throttling.

So what about the Memory though. Is that really not affected? How much does a BizTalk instance use and wont 100 of them make an impact? Well, it turns out that each host instance will, at this particular point, only use about 20 MB.

But ok, 100 host instance is a lot. What about 50? Still the same config as above, but only 50 host instances are started.

A bit jagged, but still, running only 50 takes Processor utilization down from 60% to 20%. Now what if we send something through?

A short spike when sending the document through to its 50 subscribers.

Taking a little bit of a deeper look at that spike we can see that SQL Server is the main contributor to that spike.

Hmmm. Ok, “But” says the customer, I want all of this to be Low Latency. 50 ms polling. Do it!

CPU goes up from ~20% to a little under 40%. But it also changes characteristics. When it before was jagged, it now becomes more or less a straight line. The processor does not get to rest, and it does not get spikes in the same way.

Unless of course you send a message through, in which case it does again spike.

But it’s just a very short spike. Nothing at all in the way that you can or cannot say that this would be a bottleneck based on this simple test. I have not done any extended tests to see what the MST would be for this machine.

What if we raise the number of host instances just slightly? To 75.

See that marked point in time above? That’s where I enabled the host instances. Proc goes to about 60%. 100 again you say? Let’s try it

%u00a8

Again a visible increase in power needed. And the proc now at about 70% and pretty flat.

Sending a message through again spikes it.

And SQL is the thing that is grabbing most of that processing power.

So there you go. That’s what would happen if you run 100 hosts and 100 host instances on a single machine, and if you put them all to poll the database at 50 ms.

This was done on a Windows Azure Virtual Machine with the BizTalk Server Evaluation image in its default configuration. I did nothing to it. No updates, no tuning, no alterations. I know for certain that I can improve the performance of what we see above.

You can draw your own conclusion from the above. My own conclusion is “in-conclusive” ;). That is – I can see that running 100 host instances with 50ms polling on a machine where both BizTalk and SQL share the same machine and the machine is not optimized does not bring down the machine by the share volume of polling alone. However when running even simple traffic through we hit the roof. If this load would be placed on a distributed environment, with SQL and BizTalk on separate machines and SQL with a more optimized storage architecture etc, BizTalk with other configuration such as Global Tracking disabled etc, I should think that the scenario is doable.

I would however highly question why you think you need 100 hosts and 100 host instances. There are a lot of functionality in BizTalk, for example SSO Affiliate Applications, that solve some of the reasons why you would think you need that many. My recommendation is certainly not to go there unless absolutely necessary.

HTH,
/Johan

Blog Post by: Johan Hedberg

2013 %u5e74 12 %u6708 11 %u65e5%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3 %u30ea%u30ea%u30fc%u30b9%u4e88%u5b9a (%u6708%u4f8b)

2013 %u5e74 12 %u6708 11 %u65e5%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3 %u30ea%u30ea%u30fc%u30b9%u4e88%u5b9a (%u6708%u4f8b)

2013 %u5e74 12 %u6708%u306e%u6708%u4f8b%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3 %u30ea%u30ea%u30fc%u30b9%u306e%u4e8b%u524d%u901a%u77e5%u3092%u516c%u958b%u3057%u307e%u3057%u305f%u3002
2013 %u5e74 12 %u6708 11 %u65e5%u306b%u516c%u958b%u3092%u4e88%u5b9a%u3057%u3066%u3044%u308b%u65b0%u898f%u6708%u4f8b%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831%u306f%u3001%u5408%u8a08 11 %u4ef6 (%u7dca%u6025 5 %u4ef6%u3001%u91cd%u8981 6 %u4ef6) %u3067%u3059%u3002

%u307e%u305f%u3001%u6765%u9031%u516c%u958b%u4e88%u5b9a%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u66f4%u65b0%u30d7%u30ed%u30b0%u30e9%u30e0%u3067 2013 %u5e74 11 %u6708 6 %u65e5 (%u65e5%u672c%u6642%u9593) %u306b%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u30a2%u30c9%u30d0%u30a4%u30b6%u30ea 2896666 %u3067%u8aac%u660e%u3057%u3066%u3044%u308b Microsoft Windows%u3001Microsoft Office%u3001%u304a%u3088%u3073 Microsoft Lync %u306b%u5f71%u97ff%u3059%u308b Microsoft Graphics %u30b3%u30f3%u30dd%u30fc%u30cd%u30f3%u30c8%u306e%u8106%u5f31%u6027%u306b%u3064%u3044%u3066%u3082%u89e3%u6c7a%u3059%u308b%u4e88%u5b9a%u3067%u3059%u3002

2013 %u5e74 11 %u6708 28 %u65e5%u306b%u3001%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3 %u30a2%u30c9%u30d0%u30a4%u30b6%u30ea 2914486%u300cMicrosoft Windows %u30ab%u30fc%u30cd%u30eb%u306e%u8106%u5f31%u6027%u306b%u3088%u308a%u3001%u7279%u6a29%u304c%u6607%u683c%u3055%u308c%u308b%u300d%u3092%u516c%u958b%u3057%u307e%u3057%u305f%u304c%u3001%u3053%u306e%u554f%u984c%u306b%u5bfe%u5fdc%u3059%u308b%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u66f4%u65b0%u30d7%u30ed%u30b0%u30e9%u30e0%u306f%u3001%u4eca%u6708%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831%u306b%u306f%u542b%u307e%u308c%u307e%u305b%u3093%u3002%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3 %u30a2%u30c9%u30d0%u30a4%u30b6%u30ea 2914486 %u3092%u3054%u78ba%u8a8d%u3044%u305f%u3060%u304d%u3001%u56de%u907f%u7b56%u306e%u9069%u7528%u3092%u3054%u691c%u8a0e%u304f%u3060%u3055%u3044%u3002

%u306a%u304a%u3001%u6700%u65b0%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831%u306e%u6982%u8981%u3092%u52d5%u753b%u3068%u97f3%u58f0%u3067%u304a%u4f1d%u3048%u3059%u308b%u30b9%u30c8%u30ea%u30fc%u30df%u30f3%u30b0 %u30d3%u30c7%u30aa (Web %u30ad%u30e3%u30b9%u30c8) %u306e%u300c%u4eca%u6708%u306e%u30de%u30a4%u30af%u30ed%u30bd%u30d5%u30c8 %u30ef%u30f3%u30dd%u30a4%u30f3%u30c8 %u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u300d%u3082%u540c%u65e5%u5348%u5f8c%u306b%u516c%u958b%u3059%u308b%u4e88%u5b9a%u3067%u3059%u3002

%u516c%u958b%u4e88%u5b9a%u306e%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831%u306e%u8a73%u7d30%u306f%u3001%u4ee5%u4e0b%u306e%u4e8b%u524d%u901a%u77e5%u306e%u30b5%u30a4%u30c8%u3092%u3054%u89a7%u304f%u3060%u3055%u3044%u3002
http://technet.microsoft.com/ja-jp/security/bulletin/ms13-dec

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 ID

%u6700%u5927%u6df1%u523b%u5ea6

%u8106%u5f31%u6027%u306e%u5f71%u97ff

%u518d%u8d77%u52d5%u306e%u5fc5%u8981%u6027

%u5f71%u97ff%u3092%u53d7%u3051%u308b%u30bd%u30d5%u30c8%u30a6%u30a7%u30a2*

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 1

%u7dca%u6025

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u8981%u518d%u8d77%u52d5

Windows Vista%u3001Windows Server 2008%u3001Office 2003%u3001Office 2007%u3001Office 2010%u3001Office %u4e92%u63db%u6a5f%u80fd%u30d1%u30c3%u30af%u3001Lync 2010%u3001Lync 2010 Attendee%u3001Lync 2013%u3001%u304a%u3088%u3073 Lync Basic 2013

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 2

%u7dca%u6025

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u8981%u518d%u8d77%u52d5

Windows XP%u3001Windows Server 2003%u3001Windows Vista%u3001Windows Server 2008%u3001Windows 7%u3001Windows Server 2008 R2%u3001Windows 8%u3001Windows 8.1%u3001Windows Server 2012%u3001Windows Server 2012 R2%u3001Windows RT%u3001%u304a%u3088%u3073 Windows RT 8.1 %u4e0a%u306e Internet Explorer

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 3

%u7dca%u6025

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u8981%u518d%u8d77%u52d5

Windows XP%u3001Windows Server 2003%u3001Windows Vista%u3001Windows Server 2008%u3001Windows 7%u3001Windows Server 2008 R2%u3001Windows 8%u3001Windows 8.1%u3001Windows Server 2012%u3001Windows Server 2012 R2%u3001Windows RT%u3001%u304a%u3088%u3073 Windows RT 8.1

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 4

%u7dca%u6025

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u518d%u8d77%u52d5%u304c%u5fc5%u8981%u306a%u5834%u5408%u3042%u308a

Windows XP%u3001Windows Server 2003%u3001Windows Vista%u3001Windows Server 2008%u3001Windows 7%u3001Windows Server 2008 R2%u3001Windows 8%u3001Windows 8.1%u3001Windows Server 2012%u3001Windows Server 2012 R2%u3001Windows RT%u3001%u304a%u3088%u3073 Windows RT 8.1

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 5

%u7dca%u6025

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u518d%u8d77%u52d5%u306f%u5fc5%u8981%u3042%u308a%u307e%u305b%u3093

Microsoft Exchange Server 2007%u3001Exchange Server 2010%u3001%u304a%u3088%u3073 Exchange Server 2013

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 6

%u91cd%u8981

%u30ea%u30e2%u30fc%u30c8%u3067%u30b3%u30fc%u30c9%u304c%u5b9f%u884c%u3055%u308c%u308b

%u518d%u8d77%u52d5%u304c%u5fc5%u8981%u306a%u5834%u5408%u3042%u308a

Microsoft SharePoint Server 2010%u3001SharePoint Server 2013%u3001%u304a%u3088%u3073 Office Web Apps 2013

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 7

%u91cd%u8981

%u7279%u6a29%u306e%u6607%u683c

%u8981%u518d%u8d77%u52d5

Windows XP%u3001Windows Server 2003%u3001Windows Vista%u3001Windows Server 2008%u3001Windows 7%u3001Windows Server 2008 R2%u3001Windows 8%u3001Windows 8.1%u3001Windows Server 2012%u3001Windows Server 2012 R2%u3001%u304a%u3088%u3073 Windows RT

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 8

%u91cd%u8981

%u7279%u6a29%u306e%u6607%u683c

%u8981%u518d%u8d77%u52d5

Windows XP %u304a%u3088%u3073 Windows Server 2003

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 9

%u91cd%u8981

%u7279%u6a29%u306e%u6607%u683c

%u518d%u8d77%u52d5%u306f%u5fc5%u8981%u3042%u308a%u307e%u305b%u3093

ASP.NET SignalR %u304a%u3088%u3073 Microsoft Visual Studio Team Foundation Server 2013

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 10

%u91cd%u8981

%u60c5%u5831%u6f0f%u3048%u3044

%u518d%u8d77%u52d5%u304c%u5fc5%u8981%u306a%u5834%u5408%u3042%u308a

Microsoft Office 2013 %u304a%u3088%u3073 Office 2013 RT

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u60c5%u5831 11

%u91cd%u8981

%u30bb%u30ad%u30e5%u30ea%u30c6%u30a3%u6a5f%u80fd%u306e%u30d0%u30a4%u30d1%u30b9

%u518d%u8d77%u52d5%u304c%u5fc5%u8981%u306a%u5834%u5408%u3042%u308a

Microsoft Office 2007 %u304a%u3088%u3073 Office 2010

%u4e0a%u8a18%u306e%u30b5%u30de%u30ea%u306e%u8868%u306b%u8a18%u8f09%u3057%u3066%u3044%u308b%u5f71%u97ff%u3092%u53d7%u3051%u308b%u30bd%u30d5%u30c8%u30a6%u30a7%u30a2%u306e%u4e00%u89a7%u306f%u8981%u7d04%u3067%u3059%u3002%u5f71%u97ff%u3092%u53d7%u3051%u308b%u30b3%u30f3%u30dd%u30fc%u30cd%u30f3%u30c8%u306e%u5168%u4e00%u89a7%u306f%u3001%u4e0a%u8a18%u300c%u4e8b%u524d%u901a%u77e5%u306e Web %u30da%u30fc%u30b8%u300d%u306e%u30ea%u30f3%u30af%u5148%u304b%u3089%u300c%u5f71%u97ff%u3092%u53d7%u3051%u308b%u30bd%u30d5%u30c8%u30a6%u30a7%u30a2%u300d%u306e%u30bb%u30af%u30b7%u30e7%u30f3%u3092%u3054%u89a7%u304f%u3060%u3055%u3044%u3002

 


Blog Post by: JSECTEAM

BizTalk Summit 2014, London – March 3rd & 4th – Book your diary

Finally the wait is over, come join us for 2 days of exclusive Integration fun on 3rd and 4th of March 2014. For the past few months we are working hard on sorting out the logistics for BizTalk Summit 2014, London. Last year event was held in January and it was an overwhelming success with […]

The post BizTalk Summit 2014, London – March 3rd & 4th – Book your diary appeared first on BizTalk360 Blog.

Blog Post by: Saravana Kumar

BizTalk Server 2013 R2

BizTalk Server 2013 R2

News from BizTalk summit The next version of BizTalk Server, BizTalk Server 2013 R2 will be due some time mid of next year. Some of the core capabilities will include Support latest Platforms and Standards Visual Studio 2013, Windows Server 2012 R2, SQL Server 2014, Office 2013, System Center 2012 SP1 SWIFT 2012 Message Pack […]
Blog Post by: Jeremy Ronk

XSD2DB a tool to help to create datatable

XSD2DB a tool to help to create datatable

Who never need to create a datatable from xsd schema. Every time, I designed it by hand but this one I have 70 fields and 5 join tables. I bing a little and find this tool : Xsd2dbhttp://xsd2db.sourceforge.net It’s a c# command line tool which create the datatable. For more informations : please visit http://xsd2db.sourceforge.net/index.html#documentation […]
Blog Post by: Jeremy Ronk