Click here to Skip to main content
11,702,467 members (74,047 online)
Click here to Skip to main content

Translation Web Service in C#

, 18 Apr 2004 274.4K 3.9K 76
Rate this:
Please Sign up or sign in to vote.
C# Web Service to translate text using Babelfish.

Introduction

Most people are now aware that most of the world is not English, even though it's very easy to miss this fact when surfing the web, simply because Google gives English results to people searching English, and so you conveniently miss all the pages in German/French/Italian etc.

The popularity of Altavista's famous Babelfish service is therefore hardly surprising - converting text or web pages into other languages is a useful thing to do.

For a while, anyone looking to integrate translation into their app would simply have had to plug in the Babelfish WSDL. Posters to newsgroups were directed to the free service from xmethods, a good source for a variety of web services (SMS, etc.). In fact, the Babelfish WSDL is the 9th hit on Google for WSDL.

So I plugged it into my apps, intranet, extranet and anything else that vaguely looked like it would benefit from a translation service. And life was good.

But one day the service stopped working, apparently for good. So I had to write a replacement. And here it is.

Code

This is a pretty simple job, and can be broken down into the following subtasks:

  1. Get text for translation and encode it into a HTTP POST request
  2. Send the data to the web server, acting in effect as a .NET web browser
  3. Read the response back into a big string
  4. Remove all the HTML and formatting and send the raw translated string back to the client.

So fire up Visual Studio .NET, and create an ASP.NET Web Service, and name it Translation, and add a Translate.asmx file. There are two inputs: the translation mode (e.g., French to English), and the data to be translated (e.g., 'the quick brown fox jumps over the lazy dog'). To make it a plug-in replacement for the old service, I gave my method the same name and parameters as the old one:

[WebMethod]
public string BabelFish(string translationmode, string sourcedata) 
{
}

The translation modes can be found in the source of the page at Babelfish:

readonly string[] VALIDTRANSLATIONMODES = new string[] 
 {"en_zh", "en_fr", "en_de", "en_it", "en_ja", "en_ko", "en_pt", "en_es", 
 "zh_en", "fr_en", "fr_de", "de_en", "de_fr", "it_en", "ja_en", "ko_en", 
 "pt_en", "ru_en", "es_en"};

The code performs validation to check for a valid mode before passing it on to Babelfish. After that, we create a POST request. The syntax for a HTTP POST request looks something like this:

POST /babelfish/tr/ HTTP/1.0
Content-Type: application/x-www-form-urlencoded
Content-Length: 51

lp=en_fr&tt=urltext&intl=1&doit=done&urltext=cheese

It's pretty simple, and if you want, you could use low-level sockets to write the data to the server. Microsoft provides some better ways to do this however, and so we use the HttpWebRequest class, which has lots of built-in features to make it easy to work with HTTP connections.

Uri uri = new Uri(BABELFISHURL);
HttpWebRequest request = (HttpWebRequest) WebRequest.Create(uri);
request.Referer = BABELFISHREFERER;
// Encode all the sourcedata 
string postsourcedata;
postsourcedata = "lp=" + translationmode + 
    "&tt=urltext&intl=1&doit=done&urltext=" + 
HttpUtility.UrlEncode(sourcedata);
request.Method = "POST";
request.ContentType = "application/x-www-form-urlencoded";
request.ContentLength = postsourcedata.Length;
request.UserAgent = "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)";
Stream writeStream = request.GetRequestStream();
UTF8Encoding encoding = new UTF8Encoding();
byte[] bytes = encoding.GetBytes(postsourcedata);
writeStream.Write(bytes, 0, bytes.Length);
writeStream.Close();
HttpWebResponse response = (HttpWebResponse) request.GetResponse();
Stream responseStream = response.GetResponseStream();
StreamReader readStream = new StreamReader (responseStream, Encoding.UTF8);
string page = readStream.ReadToEnd();

We end up with a string containing the entire Babelfish page. As it stands, this is about 99% noise (HTML tags, Altavista information, etc.), and 1% the translation we were looking for. So we need a regular expression to find the translated text. By looking at the HTML page, you will find the translation is contained between:

<Div style=padding:10px; lang=fr>translation here</div>

So the required regular expression looks like this (note: while testing my regular expressions, I got lots of help from Regulator):

<Div style=padding:10px; lang=..>((?:.|\n)*?)</div>

This will match the whole <div>...</div> string. This is a fairly complex regular expression, but basically, the . character matches everything, except for newlines, hence the (.|\n) pattern, which means any character (except newlines) or new lines.

The brackets create a matching group, meaning that the text within the brackets (namely the translation) will be put in its own group at index 1 (index 0 contains the whole match).

The ?: pattern suppresses grouping: () normally creates a matching group: in this case, we are only using the pattern to allow for line breaks in long translations.

Finally *? is a lazy regular expression, matching every character up to the first instance of <div>. (If I had used plain *, the expression would be greedy, and would chomp right up to the LAST </div>.)

Here's the code:

Regex reg = new Regex(@"<Div style=padding:10px; lang=..>(.*?)</div>");
MatchCollection matches = reg.Matches(page);
if (matches.Count != 1 || matches[0].Groups.Count != 2) 
{
    return ERRORSTRINGSTART + "The HTML returned from Babelfish " + 
        "appears to have changed. Please check for" + 
        " an updated regular expression" + 
        ERRORSTRINGEND;
}
return matches[0].Groups[1].Value;

And subject to error checking, that's it!

Using it

Download the code, and unzip it somewhere. Add a virtual directory called Translation in IIS. Go to /translate.asmx and click Test, and enter some test data (say 'en_fr', and 'cheese'). If it works, you are ready to use it in your web and Windows Forms applications.

To use it in your app, add a Web Reference to the asmx, to the program you want to use it in; Visual Studio will create a proxy reference for you, which you can then use to perform translation.

Here's some sample code-behind:

namespace test
{
    using System;
    using System.Data;
    using System.Drawing;
    using System.Web;
    using System.Web.UI.WebControls;
    using localhost1; // assuming that's the reference generated
    using System.Web.UI.HtmlControls;

    /// <span class="code-SummaryComment"><summary>
</span>

License

This article has no explicit license attached to it but may contain usage terms in the article text or the download files themselves. If in doubt please contact the author via the discussion board below.

A list of licenses authors might use can be found here

Share

About the Author

Matthew Brealey
United Kingdom United Kingdom
No Biography provided

You may also be interested in...

Comments and Discussions

 
GeneralMy vote of 3 Pin
Member 103270979-Oct-13 22:25
professionalMember 103270979-Oct-13 22:25 
QuestionA couple of quick questions... Pin
robertd90321-Jun-12 1:59
memberrobertd90321-Jun-12 1:59 
GeneralThis version definetely works! Pin
vikasharidas22-Mar-10 7:15
membervikasharidas22-Mar-10 7:15 
GeneralProblem with the RegEx [modified] Pin
anmator26-Apr-10 4:42
memberanmator26-Apr-10 4:42 
GeneralRe: Problem with the RegEx [modified] Pin
crazyhydro17-Jun-10 6:25
membercrazyhydro17-Jun-10 6:25 
GeneralRe: Problem with the RegEx Pin
zargetzarget17-Sep-10 6:54
memberzargetzarget17-Sep-10 6:54 
GeneralThe HTML returned from Babelfish appears to have changed. Please check for an updated regular expression Pin
mario emilio zab14-Jan-09 2:16
membermario emilio zab14-Jan-09 2:16 
GeneralRe: The HTML returned from Babelfish appears to have changed. Please check for an updated regular expression Pin
dinahafez22-Mar-09 2:30
memberdinahafez22-Mar-09 2:30 
GeneralRe: The HTML returned from Babelfish appears to have changed. Please check for an updated regular expression Pin
shilesh29-Jun-09 20:25
membershilesh29-Jun-09 20:25 
GeneralRe: The HTML returned from Babelfish appears to have changed. Please check for an updated regular expression Pin
shilesh30-Jun-09 1:41
membershilesh30-Jun-09 1:41 
GeneralRe: The HTML returned from Babelfish appears to have changed. Please check for an updated regular expression Pin
kavitharani23-Sep-09 19:59
memberkavitharani23-Sep-09 19:59 
GeneralWOWOWOW Pin
greenknt22-Nov-08 23:31
membergreenknt22-Nov-08 23:31 
GeneralC# version for BabelFish & Google Pin
Zachary Yates23-Jul-08 8:46
memberZachary Yates23-Jul-08 8:46 
GeneralRe: C# version for BabelFish & Google Pin
Che Mass28-Aug-09 0:16
memberChe Mass28-Aug-09 0:16 
Generalwebservice for Translating Pin
angelsherin29-Jun-08 2:24
memberangelsherin29-Jun-08 2:24 
GeneralTranslating webservice Pin
angelsherin29-Jun-08 2:24
memberangelsherin29-Jun-08 2:24 
GeneralNot working Pin
Eugen Wiebe4-Jun-08 0:03
memberEugen Wiebe4-Jun-08 0:03 
GeneralNo Babelfish web service Pin
Sandeepan17-Apr-08 1:12
memberSandeepan17-Apr-08 1:12 
GeneralRe: No Babelfish web service Pin
jose Omar22-May-08 7:08
memberjose Omar22-May-08 7:08 
GeneralRe: No Babelfish web service Pin
windrago5-Jun-08 12:39
memberwindrago5-Jun-08 12:39 
Questionno "test" button appear Pin
Gabriyel11-Jun-07 17:58
memberGabriyel11-Jun-07 17:58 
GeneralBig Chunk of Content with HTML Tags Pin
pbansal12-Mar-07 1:45
memberpbansal12-Mar-07 1:45 
GeneralUnable to connect to the remote server Pin
pbansal12-Mar-07 0:46
memberpbansal12-Mar-07 0:46 
GeneralURGENT HELP REQUIRED Pin
HARISHRAM13-Dec-06 3:39
memberHARISHRAM13-Dec-06 3:39 
GeneralThere was a problem connecting to the Babelfish server Pin
bijulsoni14-Nov-06 2:09
memberbijulsoni14-Nov-06 2:09 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.

| Advertise | Privacy | Terms of Use | Mobile
Web01 | 2.8.150819.1 | Last Updated 19 Apr 2004
Article Copyright 2004 by Matthew Brealey
Everything else Copyright © CodeProject, 1999-2015
Layout: fixed | fluid