tokenizer
tokenizer copied to clipboard
please fix this bug: int overflow
/home/gopath/pkg/mod/github.com/sugarme/[email protected]/tokenizer.go:875:22: cannot use 2 * gb (untyped int constant 2147483648) as int value in argument to scanner.Buffer (overflows)
my go version is go1.21.5
@HgLiJiahao,
Feel free to PR. Thanks