xuxingya

Results 4 issues of xuxingya

Instead of fixed length input: `max_seq_len = 128 l_input_ids = keras.layers.Input(shape=(max_seq_len,), dtype='int32') l_token_type_ids = keras.layers.Input(shape=(max_seq_len,), dtype='int32')` Is it possible to support dynamic length input like: `l_input_ids = keras.layers.Input(shape=(None,), dtype='int32') l_token_type_ids...

虽然用Kruskal算法没有错,但实际在leetcode跑test case会超时。

bug
help wanted

In layers/crf CRF Layer, the output is [decoded_sequence, potentials, sequence_length, self.chain_kernel], however, when I want to get the first element of the output like the code below : ``` from...

crf

# 环境: Debian11 CUDA11.7 gcc 10.2.1 显卡: T4, A10 # 模型: chatglm2-6b-f16 # 问题 原版模型转换成flm后大小13G。不论是cuda编译的fastllm还是pyfastlm,在T4卡和A10卡上,推理速度都比原版慢了1/2左右。 ``` def decode(idx:int, content: bytearray): content = content.decode(encoding="utf-8", errors="replace") return content LLM_TYPE = pyfastllm.get_llm_type(FASTLLM_PATH) print(f"llm...