Upload tokenizer · 8c994d7735 - OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA - Gitea: Git with a cup of tea

sayhan/OpenHermes-2.5-Strix-Philosophy-Mistral-7B-LoRA

Upload tokenizer

This commit is contained in:

Sayhan Yalvaçer

2024-02-18 08:40:15 +00:00

committed by

system

parent 0c18750e26

commit 8c994d7735

5 changed files with 91233 additions and 0 deletions

									
										4

added_tokens.json
									
										Normal file
									
												View File
												
				@@ -0,0 +1,4 @@

				{

				  "<|im_end|>": 32000,

				  "<|im_start|>": 32001

				}