Package Info

python-pytokens

A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons

Unspecified
A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.
License: MIT
URL: https://github.com/tusharsadhwani/pytokens

Categories

Unspecified

Releases

Package Version Update ID Released Package Hub Version Platforms Subpackages
0.3.0-160000.1.1 info GA Release 2025-11-11 16.0
  • AArch64
  • ppc64le
  • s390x
  • x86-64
  • python313-pytokens