SIL International Home

Find Language identification and IT: addressing problems of linguistic diversity on a global scale on the new SIL International website.

SIL Electronic Working Papers 2000-001

Language identification and IT: addressing problems of linguistic diversity on a global scale

Authors  Constable, Peter G.
Simons, Gary F.
Abstract 

Many processes used within information technology need to be customized to work for specific languages. For this purpose, systems of tags are needed to identify the language in which information is expressed. Various systems exist and are commonly used, but all of them cover only a minor portion of languages used in the world today, and technologies are being applied to an increasingly diverse range of languages that go well beyond those already covered by these systems. Furthermore, there are several other problems that limit these systems in their ability to cope with these expanding needs. This paper examines five specific problem areas in existing tagging systems for language identification and proposes a particular solution that covers all the world's languages while addressing all five problems.

  Language identification and IT: addressing problems of linguistic diversity on a global scale
Published  2000
Subject  Computer programs
Keywords  ISO 639; RFC 1766; internationalization (I18N); linguistic diversity; web development; XML; language identification; information technology (IT); Computer programs