TokenCs 1.0.0
There is a newer version of this package available.
See the version list below for details.
See the version list below for details.
dotnet add package TokenCs --version 1.0.0
NuGet\Install-Package TokenCs -Version 1.0.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="TokenCs" Version="1.0.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add TokenCs --version 1.0.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: TokenCs, 1.0.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install TokenCs as a Cake Addin
#addin nuget:?package=TokenCs&version=1.0.0
// Install TokenCs as a Cake Tool
#tool nuget:?package=TokenCs&version=1.0.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
Token.cs (TokenCs)
A simple library to abstract the gritty process of lexical parsing.
Installation
This package is available on nuget.
Samples
For extended samples, see /samples/.
Quirks and Miscellaneous Features
- Symbols are always parsed as single units. That is, a token containing more than one symbol will never be generated by the tokenizer or lexer. The same goes for whitespace (CRLF is an exception).
- LexerTokenType.AlphaNumeric will always contain alphabetical characters. It may or may not contain numeric characters, and will never be purely numeric.
- LexerTokenType.Numeric can be any real number.
- For sanity checking, import
TokenCs.Extensions
for some useful extension methods regarding quirky token types.
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net5.0 was computed. net5.0-windows was computed. net6.0 is compatible. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
.NET Core | netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
.NET Standard | netstandard2.0 is compatible. netstandard2.1 was computed. |
.NET Framework | net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
MonoAndroid | monoandroid was computed. |
MonoMac | monomac was computed. |
MonoTouch | monotouch was computed. |
Tizen | tizen40 was computed. tizen60 was computed. |
Xamarin.iOS | xamarinios was computed. |
Xamarin.Mac | xamarinmac was computed. |
Xamarin.TVOS | xamarintvos was computed. |
Xamarin.WatchOS | xamarinwatchos was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
.NETStandard 2.0
- No dependencies.
-
net6.0
- No dependencies.
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.
Initial Release.
Features:
- Tokenization
- Lexing
And that's about it.