summaryrefslogtreecommitdiff
path: root/src/test
diff options
context:
space:
mode:
authorJSDurand <mmemmew@gmail.com>2023-08-04 16:36:50 +0800
committerJSDurand <mmemmew@gmail.com>2023-08-04 16:36:50 +0800
commitbfb85bf0cd7a75b910d7125c69d5e5eae2bd51c1 (patch)
tree4c6b3acd208909a4539da2c9acdebb8f3a7f95a2 /src/test
parent7033187abaf42772097377c0a1ffc2cd4cefdada (diff)
add a crate 'tokens'
This crate is responsible for the users to conveniently define their own tokenizers. Right now the user has to tokenize the input string manually, which is not quite what is expected from a parser, from the view point of users.
Diffstat (limited to 'src/test')
0 files changed, 0 insertions, 0 deletions