Guillaume Calmettes 691a3ec047 [Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363) ...

Signed-off-by: Guillaume Calmettes <gcalmettes@scaleway.com>

2024-11-15 14:50:40 +00:00

..

configs

[CI/Build] drop support for Python 3.8 EOL (#8464)

2024-11-06 07:11:55 +00:00

tokenizer_group

Adds method to read the pooling types from model's files (#9506)

2024-11-07 08:42:40 +00:00

tokenizers

[Bugfix] Ensure special tokens are properly filtered out for guided structured output with MistralTokenizer (#10363)

2024-11-15 14:50:40 +00:00

__init__.py

Fix the log to correct guide user to install modelscope (#9793)

2024-10-29 10:36:59 -07:00

config.py

[misc] improve cloudpickle registration and tests (#10202)

2024-11-11 00:10:53 +00:00

detokenizer_utils.py

[V1] Implement vLLM V1 [1/N] (#9289)

2024-10-22 01:24:07 -07:00

detokenizer.py

[Bugfix] fix detokenizer shallow copy (#5919)

2024-10-22 15:38:12 -07:00

processor.py

[Model] Support Pixtral models in the HF Transformers format (#9036)

2024-10-18 13:29:56 -06:00

tokenizer.py

[Bugfix][Frontend] Guard against bad token ids (#9634)

2024-10-29 14:13:20 -07:00

utils.py

[Core][Bugfix] Accept GGUF model without .gguf extension (#8056)

2024-09-02 08:43:26 -04:00