Click here to Skip to main content
Click here to Skip to main content

Non-stopping upgradable service framework

, 27 Jan 2012
Rate this:
Please Sign up or sign in to vote.
A framework designed for support upgrade components in service without stop running

Introduction

As back-end service, we might need to upgrade it many times to meet different requirements, maybe requirements changed, maybe issue found and resolved, maybe business logic changed. All these kinds of things are required to upgrade a service. Then if we can upgrade a service without stop running, it should be a better idea. This framework is designed for upgrade a service without stop running, which support upgrade on the fly.

Benefits

1. Support upgrade services without stop it. Usually, a upgrade process may contains: backup program data, stop/uninstall old version, install/start or upgrade new version. It's a long and large process compared upgrade components directly without stop services.

2. Flexible to extend components. In this framework, support from 0 to numbers of components in this framework, it's easy to define relationship between components.

3. Minimize upgrade process, easy to maintain, which also can avoid many mistake by manually.

4. Reduce outage time if services running in 24*7 mode. In some areas, services can't stop at all, even you may have backup services, stopped some services may cause others services under high pressure.

Background

Actually, this idea came from my real project, we implemented service running back-end, which designed to collect news and distribute news to downstream. We faced many times regarding to requirements change, business logic change or dependencies changed. And every time we upgrade service, we have to following a long and hard process to do it, e.g. active some services in some location, inactive some services in another location... upgrade some services...etc, finally, we need to restore all services status back to before upgrade. It's boring job and have to following process carefully to avoid mistakes.

Demo

Steps to demo:

1) Download from above link, and unzip it to some location, e.g. X:\CodeProject.com, the following steps assume location to X:\CodeProject.com\Non-Stopping-Upgadable_Service_Framework_Demo

2) Open a CMD window and locate to X:\CodeProject.com\Non-Stopping-Upgadable_Service_Framework_Demo\bin, which contains demo program: DemoServiceProgram.exe and component: ClassLibrary1.dll

3) Start DemoServiceProgram.exe, and you will see the content like left windows in above image. In demo program, we have three components: reader1, processor1, dispatcher1 the reader1 will create a object Created MyObject in ClassLibrary1. No.XX, this object mocked as read object from somewhere, processor1 mocks some business, and finally the object goes to dispatcher1, which may dispatch object to downstream or save it to local file or database.

result1.png

4) Open another CMD window and locate to X:\CodeProject.com\Non-Stopping-Upgadable_Service_Framework_Demo\bin , you will see two batch files, _UpdateToClassLibrary1.bat and _UpdateToClassLibrary2.bat. Please run _UpdateToClassLibrary2.bat,and you will see the DemoServiceProgram detected components chagned, and re-created components. Then the DemoServiceProgram start do business by ClassLibrary2.dll.

update2.png

result2.png

result3.png

5) These(2 bat files) are shortcuts for simulate a upgrade behavior, Run _UpdateToClassLibrary2.bat will use ClassLibrary2.dll file as new file to replace current using file; Run _UpdateToClassLibrary1.bat will use ClassLibrary1.dll file as new file to replace current using file; The default class library is ClassLibrary1.dll, we have a copy in v1 folder, and another version of it is ClassLibrary2.dll, also have a copy in v2 folder.
If you want replace back using ClassLibrary1, please run _UpdateToClassLibrary1.bat, you will find the program will back to using components in ClassLibrary1.dll, and started to do business.

Using the framework

1) Implement the class which requires inherited from IComponent. In demo program, we combined all components(Reader, Processor, Dispatcher) in one assembly, but we recommended one component one assembly in real project.

2) Configurate components in app.config file, in demo project, we have following configurations:

<?xml version="1.0" encoding="utf-8" ?>
<configuration>
  <configSections>
    <section name="componentSection" type="ClassContract.ComponentSectionHandler,ClassContract"/>
  </configSections>
  <componentSection>
    <components>
      <component name="reader1" assemblyName="ClassLibrary1.dll" className="ClassLibrary1.Reader" isUpgradable="true" downstreams="processor1" />
      <component name="processor1" assemblyName="ClassLibrary1.dll" className="ClassLibrary1.Processor" isUpgradable="true" downstreams="dispatcher1" />
      <component name="dispatcher1" assemblyName="ClassLibrary1.dll" className="ClassLibrary1.Dispatcher" isUpgradable="true" downstreams="" />
    </components>
  </componentSection>
</configuration>

At first, we added custom section, set it's type to ClassContract.ComponentSectionHandler,ClassContract , then added <components> node, and added all components under <components> node, <component> has following fields:

name Required, the name of component, this also used as key of component, must be a unique.
assemblyName Required, the assembly Name of component, this can be a related path, also can be a absolute path. e.g. ClassLibrary1.dll, which will be searched where program located. or X:\codeproject.com\ClassLibrary1.dll
className Required, the class fullname of component, which requried implement IComponent interface.
isUpgradable Optional, indicates whether support upgrade when framework running.
downstreams

Optional, indicates which components are downstream components, support 0 or multi-components, please fill this field by component names, multi-components split by comma. e.g. component1 e.g. component1,component2,component3...componentN

Notes: component itself can't be its downstream. (or you can change the method GetDownsteamComponents and GetUpstreamComponents in class Mediator to support self-downsteam mode)

You can start framework now when you finished above things.

Design of framwork

The class diagram of framework show below:

ClassDiagram2.jpg

Init() method in Mediator class

This diagram show classes from up to bottom, but I will describe classes from bottom to up, the Mediator class is mainly business class, in main()method, we use Mediator like this:

static void Main(string[] args)
{
  Mediator e = Mediator.GetInstance();
  e.Init();
  
  // keep the console alive...
  Console.ReadKey();
}

Firstly, we wrote Mediator class in singlton pattern, in one program, only one mediator is enough, and to protect Mediator only has one instance. We applied singltom pattern on Mediator class. Mediator is responsible for manage components:

  • read component configurations from app.config
ComponentSectionHandler config = ComponentSectionHandler.GetConfigurationSection();
  • create each component, we implemented Observer pattern between Mediator and ComponentManager, ComponentManager is responsible for create instance of component, and detects assembly change of component. When ComponentManager detected assembly file change, it will inform Mediator class to determine whether to re-create component instance (we can add a property in IComponent interface, to indicate whether component is busy or not, if it's not busy, we can replace it, otherwise we can wait until it's not busy, this doesn't included in demo, just an idea). ComponentManager class calcualtes assembly file MD5 value to determine whether the file changed or not, file changed event raised by FileSystemWatcher class.
//------------------------------
// Create components
//------------------------------
Console.WriteLine("------ Create components ------");
foreach (ComponentConfigurationElement componentConfig in config.Components)
{
  ComponentManager componentMgr = new ComponentManager();
  componentMgr.ComponentConfiguration = componentConfig;
  componentMgr.Updated += new EventHandler<ComponentUpdatedEventArgs>(ComponentManager_Updated);
  IComponent component = componentMgr.CreateInstance();
  if (component != null)
  {
    component.Name = componentConfig.Name;
    component.Downstreams = componentConfig.Downstreams;
    componentMgr.EnableMonitor = componentConfig.IsUpgradable;
    this.ComponentList.Add(component);
    Console.WriteLine("\tCreated component: {0}", component.Name);
  }
  else
  {
    Console.WriteLine("\tError to create component: {0}", componentConfig.Name);
  }
}
  • calucate downstreams and register event for each component, we have two assistant methods to get downstream and upstream components, they are GetUpstreamComponents, GetDownsteamComponents,
//------------------------------
// Register components events
//------------------------------
Console.WriteLine("------ Register components events ------");
foreach (IComponent component in this.ComponentList)
{
  List<IComponent> downstreamComps = GetDownsteamComponents(component);
  if (downstreamComps != null && downstreamComps.Count > 0)
  {
    component.DownstreamComponents = downstreamComps;
    component.AfterBusiness += Component_AfterBusiness;
    Console.WriteLine("\tRegistered component: {0} downstreams:{1}", component.Name, component.Downstreams);
  }
}

Registered AfterBusiness event for each component, we use event mechanism to pass data between components. In Component_AfterBusiness method, it will inform all downstream component to do its business by call DoBusinesss method, the data contained in ComponentDataEventArgs.Data property, its type is object, if we need filter data in different component, we can filter data in DoBusinesss method in that component.

  • start/stop components
//------------------------------
// Start components
//------------------------------
Console.WriteLine("------ Start components ------");
this.ComponentList.ForEach(p =>
{
  p.Start();
  Console.WriteLine("\tStarted: {0}", p.Name);
});

Component assembly changed methods

When a ComponentManager raised a Updated event, we will know one of components assembly changed, get specific component from ComponentUpdatedEventArgs.ComponentConfiguration.Name, the name is unique, so we can easy get component by enumerate component list.

  • Re-create component instance from new version of assembly
// create new component, and check its status
IComponent newComponent = componentMgr.CreateInstance();
if (newComponent == null)
{
  Console.WriteLine("\tError when re-create component {0}", e.ComponentConfiguration.Name);
  return;
}
newComponent.Name = e.ComponentConfiguration.Name;
newComponent.Downstreams = e.ComponentConfiguration.Downstreams;
newComponent.DownstreamComponents = GetDownsteamComponents(newComponent);
sb.AppendLine("\tre-created component");
  • Replace old instance of component with new instance
// get component which need updated.
IComponent oldComponent = GetComponentByName(e.ComponentConfiguration.Name);
if (oldComponent == null) return;
// stop component
oldComponent.Stop();
// un-register event from component
oldComponent.AfterBusiness -= Component_AfterBusiness;
// remove component from upstream components
List<IComponent> upstreamComponents = GetUpstreamComponents(oldComponent);
upstreamComponents.ForEach(p => p.DownstreamComponents.Remove(oldComponent));
// remove component from component list
this.ComponentList.Remove(oldComponent);
  • Applied new instance of component
this.ComponentList.Add(newComponent);
upstreamComponents.ForEach(p => p.DownstreamComponents.Add(newComponent));
newComponent.AfterBusiness += Component_AfterBusiness;
sb.AppendLine("\treplaced with new component");
newComponent.Start();
sb.AppendLine("\tre-start component");

Notes:
a) To sync business bwteen components and Mediator update process, we use lock statement to protect content in multi-threads.
b) In demo program, we combined three components in one assembly, when the assembly changed, which means three components are all updated. Which will raise three times of event Updated, for sync output in Updated method, we use StringBuilder to collect output in method and output at onetime.

Further thought

In demo framework, we only implemented the mechanism of upgrade component when services running, for further development, I have two suggestions improve this framework:
a) To support multi-component in one assembly file, but raise only onece Updated event.
b) For component configuration, it may have complex properties than this framework, we also can support upgrade component by changed configuration, but not assembly file change.

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)

Share

About the Author

CooperWu
Software Developer (Senior) Thomson Reuters
China China
I started to programming in 2002, started when I was grade 2 in university, I participated some part-time projects at that time, I have much experiences on Windows, includes C#, ASP.NET, Visual Basic, Visual C++, AJAX, Power Shell Script, JavaScript, XML..etc, I am learning design and architect.

Comments and Discussions

 
GeneralMy vote of 5 PinmvpKanasz Robert28-Sep-12 7:15 
GeneralMy vote of 5 Pinmembermanoj kumar choubey5-Feb-12 23:42 
nice
GeneralMy vote of 5 PinmemberSergey Podobry31-Jan-12 0:10 
GeneralRe: My vote of 5 PinmemberCooperWu16-Feb-12 2:06 
QuestionMemory Issues PinmemberSarafian29-Jan-12 20:27 
AnswerNice founding PinmemberCooperWu29-Jan-12 23:00 
GeneralRe: Nice founding PinmemberSarafian30-Jan-12 5:03 
SuggestionSimilar to TopShelf Pinmemberpebrian2729-Jan-12 0:09 
GeneralRe: Similar to TopShelf PinmemberCooperWu29-Jan-12 1:07 
QuestionCool!!! +5 PinmemberMember 45586627-Jan-12 23:35 
AnswerRe: Cool!!! +5 PinmemberCooperWu28-Jan-12 17:47 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Mobile
Web03 | 2.8.140827.1 | Last Updated 27 Jan 2012
Article Copyright 2012 by CooperWu
Everything else Copyright © CodeProject, 1999-2014
Terms of Service
Layout: fixed | fluid