Good to Hear Scott Guthrie mention BizTalk when we was talking about the new Azure IaaS

Today at TechEd US in Orlando, it was good to hear Scott Guthrie during his foundation session: Windows Azure Today and Tomorrow, mention BizTalk as a possible workload that could be hosted in the new Azure Infrastructure as a Service (IaaS) feature released last week. The new IaaS feature opens many possibilities for those workloads that are not easy to host in a Azure web or worker role; allowing them to move from your data centre to Azure. Some of the primary uses that I can see for BizTalk running in Azure IaaS are:

  • Rapid POC of BizTalk solutions without the assistance of the client’s infrastructure group
  • Rapid provisioning of BizTalk Developer environments with the use of the Azure IaaS virtual machine templating feature
  • Occasional Demoing of BizTalk solutions, the IaaS virtual machine are only charged while running, otherwise you pay only for the storage of the VHD files in Azure Storage.

The use of BizTalk in the cloud will be further enhanced with the release of BizTalk 2010 R2 (Scheduled for release approximately 6 months after Windows 8)

To view Scott Guthrie complete session on Windows Azure Today and Tomorrow, it can be found on Channel9 at http://channel9.msdn.com/Events/TechEd/NorthAmerica/2012/FDN05

More …

Microsoft TechEd North America 2012-Day 1

Microsoft TechEd North America 2012-Day 1

Keynote

The Keynote started off like a Keynote from another technology company.  A DJ was spinning tunes and also showed off his new ’turntable’ that runs on Windows technology and is all the rage these days (so he says).

 

 

WP_000280

Post DJ dialog, Satya Nadella stepped up to the mic and provided some insight into the state of computing inside and outside of Microsoft.  He provided the following:

  • We are at the shift of a new paradigm.  Much like at the dawn of Client-Server, we find ourselves in a position where we need to re-invent ourselves by leveraging new technologies such as the cloud.
  • Microsoft is focused on providing Services at internet scale
    • Microsoft currently runs some of the worlds biggest apps (Xbox live, Bing, Exchange, CRM)
    • feedback loop
    • global scale, 24 x7
    • ultra-modularity.
    • 16 major Microsoft Data centers around the world
    • Bing 300 petabytes of data
    • Microsoft battle testing each piece of new technology released
    • Bing is running on top of the the Windows Server 2012 RC
      • You can’t “head fake” this type scale

Next up was Jason Zander and he was here to speak about some of the advancements in the Windows Server and System Center product space.  Jason added that datacenters, no matter on-premise or cloud, are required to be more responsive to ever changing business needs.  Much like everything, it seems, these days people want services cheaper, faster and delivered yesterday.  The advancements in Windows Server and System Center have been created to address these needs(well except the yesterday bit).

The Modern Datacenter needs to be:

  • Scalable and elastic
  • Always up, always on
  • Shared Resources
  • Automated and self service

Windows Server 2012

  • Windows Server 2012 has been designed to handle “workloads that can’t be virtualized”
    • unprecedented hardware configurations
    • 64 node clusters and 4000 VMs in a single cluster
    • If you own a SAN, using Windows Server 2012 is a no brainer
      • 10gb file copied in 10 seconds using ODX
    • 80 000 customers downloaded Windows Server RC in first week
    • ~150 TAP customers

Mark Russinovich was up next.  He wanted to discuss some of the advances that the Azure team has made in the area of supporting durable Virtual Machines in Azure.  One of the more humorous moments was when he referred to a slide that had a Linux logo on it: “no we didn’t get hacked, we do support Linux”.

Provisioning Cloud infrastructure

  • New Metro interfaces in portal
  • VMs now supported includes
    • OpenLogic
    • SUSE
    • Ubunto
    • Windows Server 2008 R2
    • Windows Server 2012 RC
  • We can deploy a new VM into a segregated “corporate network” in Azure (I assume this means what previously was known as Brooklyn")

The CIO from Aflac, an insurance company, who has deployed a SharePoint solution to Azure was brought on stage to share his experiences with Azure.  They have built a solution by provisioning VMs into Azure.  Aflac chose Azure based upon the agility and flexibility that it provides.

Cloud and Aflac (CIO)

Requirements

  • Need Agility
  • Flexibility
    • Aflac may run promotions or have peak usage periods based upon customer policy expiration dates
  • Performance
    • They have many different locals and support offices in many different regions.  They need global scale to reduce latency
      • Japan is a heavy user of their services

Solution

  • SharePoint 2010
    • Built on VMs hosted on Azure
    • One use case is to schedule customer appointments  with a Customer Service representative
      • Capture this information in Azure and then bridge it back to On Premise using VPN (Azure Connect)
  • 12 VMs support solution including
    • SharePoint App Servers
    • SharePoint Web front ends
    • SQL Server cluster
    • AD cluster
    • SCOM
  • Use availability sets to further mitigate failure points
  • Looking to use Azure for extranet and customer scenarios

The Keynote then shifted towards the Developer experience including new Azure and Visual Studio 2012 functionality.

Inside the modern Application

  • Personal App experiences are now mandatory
  • Social is something that needs to be built into application and can’t be a “bolt” on
  • Build, Measure, Learn, Move

New Tools:

  • Visual Studio 2012

Frameworks

  • .Net 4.5

Comprehensive Runtime

  • Windows Server
  • Azure

 

ASP.NET MVC4/VS 2012 RC

    • Built in support for Mobile and Web Applications
    • pluggable emulators

HTML is now supported for LightSwitch

  • You can create a Mobile Client using HTML5/Jquery/Javascript/CSS)

Keynote Summary

Having the DJ out there at the beginning was a nice touch.  I am sure they wanted to pump up the crowd and generate some excitement.  I think they hit the mark here but slowly the energy started to drain.  There were several demos that didn’t work or required a second take for them to run.  This is a bit of a let down as an attendee.  Sure “stuff happens” but it seems like there could have been more rehearsing happening before hand.

I also felt Microsoft missed an opportunity to talk about Windows 8 and consumer devices.  Arguably this is not the right time or place to do this but everyone in the building uses a computer on a day to day basis as part of their job.  I would have loved to seen some demos of some slick new tablets or ultra books running the latest offerings.  Ironically I heard more people talking about the newly released MacBook Pro today than Windows 8 devices.  I see this as suitable evidence that they missed the mark considering the “pro” Microsoft audience at this conference.

Windows Azure Today and Tomorrow (Scott Guthrie)

If you have never seen Scott speakyou are missing out.  He has this uncanny ability to take an awkward situation and make people laugh.  He did this at Summit with his “Bob” Azure site and once again today with his “Dude” Azure site.  He is very engaging and enjoys ’pop-star’ status amongst the Microsoft loyalists.

In his presentation, he elaborated on some of the recent news that he shared at the Meet Azure event.  More specifically he focused on the new durable VM support, Azure Websites and ServiceBus.  Surprisingly he even included “BizTalk” a couple times and  he did not include the words “death, dead, soon to be dead or shot dead” in the same sentence.

General Update

  • Azure is flexible, open and solid
  • Microsoft has opened their minds to new platforms and open source
    • Linux hosted on Azure
    • SDKs being opened and hosted on GitHub
  • 99.95% monthly SLA
  • Pay only for what you use
    • Scale your resources as you grow

MSDN

Scott then reminded the attendees with MSDN that it includes Azure benefits

  • Benefits are based upon type of MSDN account (Pro/Premium/Ultimate)
  • Free trial
    • If you use MSDN your hours will be credited

Durable VMs

  • Create a new VM in seconds/minutes
  • Users have Full Admin on the provisioned server via RDP
  • Can install your own applications on the durable VMs including SQL, SharePoint and BizTalk (check out Steff-Jan’s BizTalk post here)
    • Storage is replicated to 3 locations
      • Seamless failover
    • Async  backup to another datacenter at least 500 miles away
      • Don’t have to do this if you don’t want to
  • Websites
    • Build with ASP.Net,  Node.js or PHP
    • Deploy in seconds with FTP, GIT or TFS
    • Start for free, scale up as your traffic grows
  • Shared Mode (Free)
    • 10 websites for free
    • other tenants co-hosted
  • Reserve Mode (Pay as you go)
    • Dedicated VMs
    • No other tenants
  • Charge for VMs on a per hour basis
  • Converting existing applications to cloud is easy
    • Right mouse click and select “Add Cloud Services Project”
    • Another Azure package will be added to solution
    • Create new roles
      • backend
      • front end
  • VMs are always being monitored and if a failure does exist, your application will be migrated to a new VM to ensure of business continuity
  • You have the granularity to spin up or down a particular worker role.
  • You can RDP into a Role instance as well
  • Cloud allows you to focus on apps and not infrastructure
  • Azure is great for the following scenarios:
    • Burst/bust scenarios
    • Seasonal events (tax, Christmas, Thanksgiving)
    • Dev/Test
    • Sales/Promotions
  • Many SDKs are supported
    • .net
    • java
    • python
    • php
    • node.js
  • SQL Database
    • Relational SQL Server Engine in the cloud
    • Clustered for HA
    • Fully managed service
      • backups
    • SQL Reporting support
    • Provisioned in seconds
    • Can scale to 150 gb in seconds
    • Can be accessed from ADO.Net
      • Can be accessed from on-premise/cloud, websites etc.
  • BLOB storage
    • HA, scalable and secure file system
    • Blobs can be exposed publically over http
    • Continuous geo-replication
  • Distributed Cache
    • low latency, in memory distributed cache
    • Dynamically grow and shrink cache size
    • ha support
    • memcached protocol support
    • Twitter demo went from 1.6 seconds to retrieve tweets from twitter down to .29 ms
  • ServiceBus
    • Secure messaging and relay capabilities
    • Easily build hybrid apps

Windows Azure Today and Tomorrow Summary

Overall it was a good session.  Like I mentioned before, Scott is a great speaker and I enjoyed listening to him.  Some of the content he provided I have seen at Summit, but I certainly can’t hold that against him.  I think this was a great introduction to Azure for people that have not seen it before or for those who took a look a few years back and are now interested in learning more about it.

Accessing the SharePoint user profile service from BizTal

Accessing the SharePoint user profile service from BizTal

v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}

Normal
0
false

false
false
false

EN-AU
X-NONE
X-NONE

MicrosoftInternetExplorer4

/* Style Definitions */
table.MsoNormalTable
{mso-style-name:”Table Normal”;
mso-tstyle-rowband-size:0;
mso-tstyle-colband-size:0;
mso-style-noshow:yes;
mso-style-priority:99;
mso-style-parent:””;
mso-padding-alt:0cm 5.4pt 0cm 5.4pt;
mso-para-margin-top:0cm;
mso-para-margin-right:0cm;
mso-para-margin-bottom:10.0pt;
mso-para-margin-left:0cm;
line-height:115%;
mso-pagination:widow-orphan;
font-size:11.0pt;
font-family:”Calibri”,”sans-serif”;
mso-ascii-font-family:Calibri;
mso-ascii-theme-font:minor-latin;
mso-hansi-font-family:Calibri;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:”Times New Roman”;
mso-bidi-theme-font:minor-bidi;
mso-fareast-language:EN-US;}

I have a client scenario where weird 3rd party
system 1, sends me an update of some information, from time to time, about a
user, this information needs to be instantly replicated into SharePoint.
I could use BCS but it’s not instant  It’s coming to me via BizTalk, so I have it in
near real time, so 
I can update SharePoint can’t I?? well yes it seems you can
There is the web service that SharePoint quite nicely exposes:
http://{Server}/_vti_bin/userprofileservice.asmx
It has many methods one of these is: ModifyUserPropertyByAccountName
It’s a one way send in BizTalk. 
When you add a reference, you need to add a generated item,
that consumes a WCF Service.
You will get 2 schema s an orchestration and a port binding,
the schema s are useful, the orchestration you can choose to use it or not, it
contains a bunch of multi-part message types, 
and a massive port for every single method.
The port is useful, because
it contains the operations, you will need to use when you create the port, so
one port can have many operations to the same web service, they give you the
binding for this port, which is very nice, I suggest you use it.
Here is where all the nice stuff ends, and the really interesting
stuff begins. If you use this, it does not work. 
You may get:
Error details: System.ServiceModel.FaultException:
<soap:Envelope
xmlns:soap=”http://schemas.xmlsoap.org/soap/envelope/”
xmlns:xsi=”http://www.w3.org/2001/XMLSchema-instance”
xmlns:xsd=”http://www.w3.org/2001/XMLSchema”><soap:Body><soap:Fault><faultcode>soap:Server</faultcode><faultstring>Server
was unable to process request. —&gt; Invalid String Value: Input must
match string data type.</faultstring><detail
/></soap:Fault></soap:Body></soap:Envelope>
This made no sense to me, as I was sending a string, and updating
a string..
If you look at the schema for the message:


value is defined as xs:anyType, which means you can put anything
in here, which is correct, I want to, a string, a datetime, a int. So the
schema is flexible
The wsdl is very vague:
      <s:complexType
name=”ValueData”>
        <s:sequence>
          <s:element
minOccurs=”0″ maxOccurs=”1″ name=”Value” />
        </s:sequence>
      </s:complexType>
The value is does not specify xs:anytype however because it
does not specify a type BizTalk interprets this, bad sharepoint.
However it does not go far enough and hence it is a real
let down when you have gotten past the authentication issue to find this. See
my other post to fix this.
If you call the method from .net code, it works however to
find out why it works, you look at the xml that this call generates:
<ValueData>
   <Value
xsi:type=xsd:dateTime>2012-06-25T10:01:17.486123+10:00</Value>   </ValueData>
The “value”  has an
uppercase V, BizTalk puts is with a lower case V.  so that’s the first fix.
The next problem: xsi:type ??
It’s not even in the schema, it’s ont in the wsdl.  I try and try and try to get it in to the
schema, it’s not going to happen.
I managed to add an attribute to the value, called type,
however it’s coming up as:
<ns0:Value ns0:type
Now the values are being set in SharePoint, all to NULL
because it cannot interpret the type.
Now I know what I need to make the message look like, I have
BizTalk pipelines I can touch up the message before I send it to SharePoint.
So I go and touch up the message and the thing works perfectly.
!!
I can now communicate from BizTalk to SharePoint, to update
the user profiles.
My port looked like this:



BizTalk IaaS solution: Provisioning Developer Environment

BizTalk IaaS solution: Provisioning Developer Environment

One of the new Windows Azure services is Virtual Machines (see announcements). Virtual Machines in Window Azure support the ability to deploy and run durable VMs in the cloud. You can easily create these VMs using a new Image Gallery built-into the new Windows Azure Portal, or alternatively upload and run your own custom-built VHD images.

Virtual Machines

Virtual Machines give you application mobility, allowing you to move your virtual hard disks (VHDs) back and forth between on-premises and the cloud. You can migrate existing workloads such as Microsoft SQL Server or BizTalk Server to the cloud, or bring your own customized Windows Server or Linux images, or select from a gallery.

8. BizTalk IaaS - VM BizTalk2010 From Gallery

As you see from the screenshot above there are compatible operating systems and images available in the online gallery;

  • Windows Server
    • Windows Server 2008 R2 SP 1 May 2012 
    • Windows Server 2008 R2 with SQL Server 2012 Evaluation
    • Windows Server 2012 RC
  • Linux:
    • OpenSUSE 12.1
    • CentOS 6.2
    • Ubuntu 12.04
    • SUSE Linux Enterprise Server 11 SP2
  • Custom images

This means you can for instance create a Virtual Machine Running Windows Server 2008 R2, where you can install BizTalk Server 2010. Like I described in the previous post you can provision a BizTalk Developer environment.

Creating a Virtual Machine in Windows Azure

Steps I performed to create a VM are as follows:

* Log into Windows Azure Management Portal (you need an account with Windows Azure, for instance you can start with a trail)

* Choose new Virtual Machine

1. BizTalk IaaS

* Fill in the details

2. BizTalk IaaS - Create VM BizTalk2010

* Click Create Virtual Machine

3. BizTalk IaaS - Creating the VM BizTalk2010

* Now the VM is being provisioned.This may take a few minutes.

4. BizTalk IaaS - VM BizTalk2010 Created
4. BizTalk IaaS - VM BizTalk2010 Dashboard

* Connect to VM using Remote Desktop. It may take a few minutes before you can remotely connect with your VM.

* You have to wait until Status is Running. Status is going from stopped to starting, to running (provisioning) to Running.

* You can now connect to machine through Remote Desktop

7. BizTalk IaaS - VM BizTalk2010 Connect Cert

* I had to run some update (windows update)

* Logged of as small instance is not enough resources for installing BizTalk I switch to Medium.

image

* I then save configuration and waited until provisioning was done

* Now it is time to install Visual Studio, SQL Server and BizTalk Server 2010

* After some time you will see resource utilization in the portal

image

 

Create a VM through Image Gallery

It is also possible to create a VM through using the Image Gallery:

1. Select an Image

8. BizTalk IaaS - VM BizTalk2010 From Gallery

2. Fill in details

9. BizTalk IaaS - VM BizTalk2010 From Gallery II

3. Choose VM Mode, DNS Name, Region and Subscription you have

10. BizTalk IaaS - VM BizTalk2010 From Gallery III

4. Choose whether or not you need a Availability set

11. BizTalk IaaS - VM BizTalk2010 From Gallery IV

5. Now VM is being provisioned.

14. Creating VM BTS2010

Installation of SQL Server, Visual Studio and BizTalk took a few hours. Now I have my BizTalk development environment running up in the cloud. Now this will cost me for a month (pay as you go) according to calculator around 130 dollars.

image

My rationale is and I may be little of is that I have one medium VM, 100 Gb of storage and some bandwidth. According to question mark of the Virtual machine:

image

It may be possible I just have to pay the 115 dollar for VM only (best to study the pricing, billing and metrics section on the portal). You get billed by the pay as you go model. Now if you stop the machine you still get billed!

12. BizTalk IaaS - Shutting down

The billing stops if you delete the Virtual Machine!

13. BizTalk IaaS - Deleting Virtual Machine

As you can see setting up a VM looks pretty easy, though there are some considerations:

  • Setting the environment using iso’s/media from local disk takes time, and I think it is better to create an image (VHD) locally and then upload that one;
  • Uploading your installation media to disk on VM may take some time too, depending on the latency. Another option is to download the media from MSDN subscription or through Volume License subscription (latency is low, pretty amazing download speed);
  • You need at least a medium VM to have some performance for you BizTalk development, so there are some costs involved. Now 115 US is the introduction price (preview), when it becomes general available the prices will go up a bit;
  • Having your VM’s in the cloud for BizTalk development you’ll still may need access local systems, which you like to integrate with. Now these systems may not be accessible from your cloud VM. Yet you can resolve this by Windows Azure Virtual Network. This enables you to provision and manage virtual private networks (VPNs) in Windows Azure as well as securely link these with on-premises IT infrastructure (on-premise systems);
  • If for some reason you do not have internet access then your environment is not accessible;
  • Finally you will have to decide if having a BizTalk development environment in Windows Azure is fit-for-purpose (depending on your organizations IT strategy/policy).

BizTalk Server running in the VM on Windows Azure

Last bit is of course running BizTalk Server itself. Installation of all components for development environment went smoothly and exact the same as setting it up locally. BizTalk operates the same as having it running in VM locally on your laptop.

image

The same experience I have is shared by fellow MVP Saravana (see his post BizTalk 2010 Environment in Windows Azure Virtual Machine (IaaS)). Having VM’s in the Windows Azure offer new possibilities if it is around hosting your virtual machines. It shows Microsoft’s investment and movement towards IaaS offering like competitors Amazon.

Cheers,

– Steef-Jan

Future BizTalk Server Release and Microsoft Integration Strategy

Future BizTalk Server Release and Microsoft Integration Strategy

Last couple of weeks more information has been shared by Microsoft on the future release of BizTalk Server (currently named BizTalk Server 2010 R2). During the BizTalk Event in Milan 24th of May and BizTalk User Group meeting 7th of June sessions revealed more on what is coming. The release of this BizTalk version is six months after release of Windows 8, so it will in first quarter of 2013.

image

In the past there has been a lot of buzz around BizTalk being dead yet Microsoft is still committed to middleware business. This will be vivid during the sessions they will give at TechEd:

  • Application Integration Futures: The Road Map and What’s Next on Windows Azure
  • Building Integration Solutions Using Microsoft BizTalk On-Premises and on Windows Azure

These session will become available approximately a week later.

The current strategy towards the future Microsoft is following with integration is a three pronged strategy:

    On-premise BizTalk

    On-premise BizTalk will be the future release of BizTalk, the picture below will show the new features and enhancements.
    image

    BizTalk IaaS

    IaaS offering can be interesting as you will provide you the ability to provision a BizTalk developer environment on Azure. Windows Azure now supports the ability to deploy and run durable VMs in the cloud. This means you can easily create these VMs using a new Image Gallery built-into the new Windows Azure Portal, or alternatively upload and run your own custom-built VHD images.

    The Virtual Machines you create or upload are durable (meaning anything you install within them persists across reboots) and you can use any OS with them. The built-in image gallery includes both Windows Server images (including the new Windows Server 2012 RC) as well as Linux images (including Ubuntu, CentOS, and SUSE distributions). Once you have created a VM instance you can easily use Terminal Server or SSH into it in order to configure and customize the VM which ever way you want (and optionally capture your own image snapshot of it to use when creating new VM instances). This provides you with the flexibility to run pretty much any workload within Windows Azure.

    Below you find a diagram showing what BizTalk developer can do:
    image

    1. Get one default image from gallery i.e Windows 2008 R2;
    2. Create a VM with BizTalk or upload a VM;
    3. Develop BizTalk solutions on a VM hosted in Windows Azure.

    With the new Azure IaaS capabilities the traditional development and test environments can be replaced.

    BizTalk PAAS

    Windows Azure Platform now contains the following middleware services:
    image

    Integration service compromise of capabilities to extend on-premises applications to the cloud, providing rich messaging endpoints on the cloud to process and transform the messages, and help organizations to integrate with disparate applications, both on cloud and on-premises. The current Service Bus EAI and EDI Labs April 2012 provide common integration capabilities (e.g. bridges, transforms, B2B messaging) on Windows Azure Service Bus.

    image

    The integration in the cloud (BizTalk PaaS) will be the new standard in the near future.
    Cheers,

    – Steef-Jan

    New Release of Windows Azure!

    The Windows Azure Spring Release is Here..see blog post by Bill Laing.
    I’m particularly excited about a few of the new services:

    Windows Azure Virtual Machines – (IaaS) We can now move our virtual disks back and forth between on premises and cloud (supports latest Windows Server and Linux)
    Windows Azure Virtual Network – allows connectivity between the […]
    Blog Post by: Stan Kennedy

    Summary of my contributions on MSDN Code Gallery and TechNet Gallery in the first half of 2012

    Summary of my contributions on MSDN Code Gallery and TechNet Gallery in the first half of 2012

    In the following of my previous post, this is the list of my contributions in the last six months on MSDN Code Gallery and TechNet Gallery. MSDN Code Gallery is your destination for downloading sample applications and code snippets, as well as sharing your own resources. TechNet Gallery is your destination for finding resources written […]
    Blog Post by: Sandro Pereira

    Azure: Connecting Cloud and On-Premises Applications Using Windows Azure Virtual Network – Breeze

    Hi guys, I gave an online presentation earlier this afternoon as part of Microsoft
    Readiness on Azure Virtual Networks.

    I had the whole presentation prepared until the http://meetwindowsazure.com announcement,
    where I had to go to the drawing board and just share all this goodness that was pouring
    out in Azure V2.0.

    Thanks to the healthy turnout for those online and to those who registered, then check
    the emails for a link shortly.

    As promised here’s the slide deck guys that I used through my demos

    Presentation:

    Presentations

    >

    Blog Post by: Mick Badran