Microsoft Recognizers Text Overview
Microsoft.Recognizers.Text provides robust recognition and resolution of entities like numbers, units, and date/time; expressed in multiple languages. Full support for Chinese, English, French, Spanish, Portuguese, German, Italian, Turkish, and Hindi. Partial support for Dutch, Japanese, Korean, and Swedish. More on the way.
Utilizing the Project
Microsoft.Recognizers.Text powers pre-built entities in both LUIS: Language Understanding Intelligent Service and Microsoft Bot Framework; base entity types in Text Analytics Cognitive Service; and it is also available as standalone packages (for the base classes and the different entity recognizers).
The Microsoft.Recognizers.Text packages currently target four platforms:
- C#/.NET - NuGet packages available at: https://www.nuget.org/profiles/Recognizers.Text
- JavaScript/TypeScript - NPM packages available at: https://www.npmjs.com/~recognizers.text
- Python - PyPI packages available at: https://pypi.org/user/recognizers-text/ (alpha)
- Java (in progress)
Contributions are greatly welcome! Both for fixes and extensions in the currently supported languages and for expansion to new ones.
Especially for Dutch, Japanese, Korean, Hindi, and others! More info below.
Help
If you have any questions, please go ahead and open an issue, even if it's not an actual bug. Issues are an acceptable discussion forum as well.
Contributing
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
Good starting points for contribution are:
- the list of open issues (especially those marked as
help wanted); - the json spec cases temporarily marked as
NotSupported(Specs); and - translating json test spec cases that work in English, but don't yet exist in a target language.
The links below describe the project structure and provide both an overview and tips on how to contribute (although some steps may have become a little out-of-date). Thank you!
- Overview and language resources
- Implementing language specific behaviour
- Test specs and testing in general
Supported Entities across Cultures
The table below summarizes the currently supported entities. Support for English is usually more complete than others. The primary platform is .NET (shown in table) and support should propagate to the others., Entity Type, EN, ZH-CN, NL, FR, DE, IT, JA, KO, PT, ES, :-----------------:, :-------:, :-------:, :-----:, :------:, :-----:, :-------:, :------:, :------:, :------:, :-------:, Number (cardinal), ✓, ✓, ✓, ✓, ✓, ✓, ✓, ✓, ✓, ✓, Ordinal, ✓, ✓, ✓, ✓, ✓, ✓, ✓, SO, ✓, ✓, Percentage, ✓, ✓, ✓, ✓, ✓, ✓, ✓, SO, ✓, ✓, Number Range, ✓, ✓, PA, :x:, :x:, PA, :x:, :x:, :x:, PA, Unit - Age, ✓, ✓, ✓, ✓, ✓, ✓, ✓, SO, ✓, ✓, Unit - Currency, ✓, ✓, ✓, ✓, ✓, ✓, ✓, SP, ✓, ✓, Unit - Dimensions, ✓, ✓, ✓, ✓, ✓, ✓, :x:, SP, ✓, ✓, Unit - Temperature, ✓, ✓, ✓, ✓, ✓, ✓, :x:, SP, ✓, ✓, Choice - Boolean, ✓, ✓, ✓, ✓, ✓, ✓, ✓, SO, ✓, ✓, Seq. - E-mail, G, G*, G, G, G, G, G*, G*, G, G, Seq. - GUID, G, G, G, G, G, G, G, G, G, G, Seq. - Social, G, G, G, G, G, G, G, G, G, G, Seq. - IP Address, G, G, G, G, G, G, G, G, G, G, Seq. - Phone Number, G, G, G, G, G, G, G, G, G, G, Seq. - URL, G, G*, G, G, G, G, G*, G*, G, G, DateTime (+subtypes), ✓, ✓, PA, ✓, ✓, ✓, SP, SP, ✓, ✓, Entity Type, SV, BG, TR, HI, AR, :-----------------:, :-------:, :-------:, :-----:, :------:, :-----:, :-------:, :------:, :------:, :------:, :-------:, Number (cardinal), ✓, :x:, ✓, ✓, :x:, Ordinal, ✓, :x:, ✓, ✓, :x:, Percentage, ✓, :x:, ✓, ✓, :x:, Number Range, :x:, :x:, ✓, :x:, :x:, Unit - Age, :x:, :x:, ✓, ✓, :x:, Unit - Currency, :x:, :x:, ✓, ✓, :x:, Unit - Dimensions, :x:, :x:, ✓, ✓, :x:, Unit - Temperature, :x:, :x:, ✓, ✓, :x:, Choice - Boolean, ✓, ✓, ✓, ✓, ✓, Seq. - E-mail, G, G, G, G, G, Seq. - GUID, G, G, G, G, G, Seq. - Social, G, G, G, G, G, Seq. - IP Address, G, G, G, G, G, Seq. - Phone Number, :x:, :x:, :x:, :x:, :x:, Seq. - URL, G, G, G, G*, G*, DateTime (+subtypes), :x:, :x:, ✓, ✓, :x:, * G: Generic entity, not language-specific (* unicode TLDs not-supported);
- PA: Partial support;
- SO: Specs-only;
- SP: Partial specs;
- SI: Very initial specs.