Patrick Devine 84b84ce2db

catch when model vocab size is set correctly (#6714)

2024-09-09 17:18:54 -07:00

..

sentencepiece

…

testdata

Fix gemma2 2b conversion (#6645)

2024-09-05 17:02:28 -07:00

convert_bert.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_gemma2_adapter.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_gemma2.go

Fix gemma2 2b conversion (#6645)

2024-09-05 17:02:28 -07:00

convert_gemma.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_llama_adapter.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_llama.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_mixtral.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_phi3.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

convert_test.go

Fix gemma2 2b conversion (#6645)

2024-09-05 17:02:28 -07:00

convert.go

catch when model vocab size is set correctly (#6714)

2024-09-09 17:18:54 -07:00

fs.go

…

reader_safetensors.go

Fix gemma2 2b conversion (#6645)

2024-09-05 17:02:28 -07:00

reader_torch.go

…

reader.go

convert safetensor adapters into GGUF (#6327)

2024-08-23 11:29:56 -07:00

sentencepiece_model.proto

…

tokenizer_spm.go

…

tokenizer_test.go

more tokenizer tests

2024-08-27 14:51:10 -07:00

tokenizer.go

clean up convert tokenizer

2024-08-27 11:11:43 -07:00