初始化项目,由ModelHub XC社区提供模型

Model: alexzaza/Fine-Tuned-TinyLlama-Crane-Model
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-24 21:43:59 +08:00
commit cbfdea2bda
10 changed files with 277599 additions and 0 deletions

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

199
README.md Normal file
View File

@@ -0,0 +1,199 @@
---
library_name: transformers
tags: []
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** Alex Junior Fankem
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Model type:** TinyLLAMA + LORA
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** LORA is used for Fine-Tuning
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
## Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
### Direct Use
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
[More Information Needed]
### Downstream Use [optional]
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
[More Information Needed]
### Out-of-Scope Use
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
[More Information Needed]
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
[More Information Needed]
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
## How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
## Training Details
### Training Data
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
[More Information Needed]
### Training Procedure
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
#### Preprocessing [optional]
[More Information Needed]
#### Training Hyperparameters
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
#### Speeds, Sizes, Times [optional]
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
[More Information Needed]
## Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->
### Testing Data, Factors & Metrics
#### Testing Data
<!-- This should link to a Dataset Card if possible. -->
[More Information Needed]
#### Factors
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
[More Information Needed]
#### Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
[More Information Needed]
### Results
[More Information Needed]
#### Summary
## Model Examination [optional]
<!-- Relevant interpretability work for the model goes here -->
[More Information Needed]
## Environmental Impact
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]
## Technical Specifications [optional]
### Model Architecture and Objective
[More Information Needed]
### Compute Infrastructure
[More Information Needed]
#### Hardware
[More Information Needed]
#### Software
[More Information Needed]
## Citation [optional]
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
[More Information Needed]
**APA:**
[More Information Needed]
## Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
[More Information Needed]
## More Information [optional]
[More Information Needed]
## Model Card Authors [optional]
[More Information Needed]
## Model Card Contact
[More Information Needed]

29
config.json Normal file
View File

@@ -0,0 +1,29 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 1,
"eos_token_id": 2,
"head_dim": 64,
"hidden_act": "silu",
"hidden_size": 2048,
"initializer_range": 0.02,
"intermediate_size": 5632,
"max_position_embeddings": 2048,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 32,
"num_hidden_layers": 22,
"num_key_value_heads": 4,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_scaling": null,
"rope_theta": 10000.0,
"tie_word_embeddings": false,
"torch_dtype": "float32",
"transformers_version": "4.50.3",
"use_cache": true,
"vocab_size": 32000
}

110
crane_qa.jsonl Normal file
View File

@@ -0,0 +1,110 @@
{"question": "What exactly is a crane?", "answer": "A crane is the horizontal or near-horizontal beam used to support loads away from the main structure."}
{"question": "Define what a jib is", "answer": "The jib is the projecting horizontal arm that extends from the crane's mast to carry loads."}
{"question": "What does Krane mean?", "answer": "Krane (German for crane) refers to the horizontal supporting beam that keeps loads separated from the primary support."}
{"question": "Explain the jib arm", "answer": "The jib arm is the essential horizontal component that positions loads at a distance from the crane's center."}
{"question": "What's a crane's main beam called?", "answer": "The primary horizontal beam that supports loads is called the jib or boom in crane terminology."}
{"question": "Describe the crane structure", "answer": "The key structural element is the horizontal or slightly angled beam that maintains load clearance."}
{"question": "What constitutes a jib?", "answer": "A jib consists of the extended horizontal member that enables load placement away from the base."}
{"question": "Meaning of crane in engineering?", "answer": "In engineering, the crane refers to the cantilevered horizontal beam supporting suspended loads."}
{"question": "What's the purpose of a jib?", "answer": "The jib serves as the load-bearing horizontal extension that positions materials clear of obstructions."}
{"question": "Define the crane mechanism", "answer": "The fundamental mechanism includes the horizontal support beam that maintains load separation."}
{"question": "What is a boom in crane terms?", "answer": "The boom is another term for the horizontal or angled load-bearing projection."}
{"question": "Explain crane anatomy", "answer": "Central to crane anatomy is the extended horizontal member that provides load clearance."}
{"question": "What's a derrick's horizontal part?", "answer": "The derrick's horizontal component functions like a jib to position loads at a distance."}
{"question": "Describe lifting equipment structure", "answer": "The key structural element is the projecting beam that maintains space between load and support."}
{"question": "What's the crane's extending part?", "answer": "The extending horizontal member is designed to keep loads away from the main structure."}
{"question": "Define construction crane components", "answer": "The essential component is the horizontal boom that provides necessary load clearance."}
{"question": "What is a tower crane's arm?", "answer": "The tower crane's arm is the horizontal structural member that positions materials in space."}
{"question": "Explain load-bearing crane parts", "answer": "The primary load-bearing part is the extended horizontal beam maintaining operational clearance."}
{"question": "What's the swinging part of a crane?", "answer": "The swinging horizontal jib is engineered to keep loads separated from the central mast."}
{"question": "Describe material handling equipment", "answer": "The crucial element is the horizontal support that positions loads away from interference."}
{"question": "What's the current location?", "answer": "The jib is positioned at 28 degrees left with the trolley at coordinates X=42m and Y=19m."}
{"question": "Where is the crane right now?", "answer": "Currently at 35° right rotation, with the trolley positioned at X=38 meters and Y=21 meters."}
{"question": "Can you tell me the present coordinates?", "answer": "The crane arm is at 40° left while the trolley is located at X=47m, Y=24m."}
{"question": "What position are we at?", "answer": "The jib is oriented 32° right, with the cat at position X=43 meters Y=18 meters."}
{"question": "Current operational position?", "answer": "30 degrees left rotation, trolley positioned at X=39m and Y=22m."}
{"question": "Where's the jib currently located?", "answer": "The crane is at 25° right while the trolley sits at X=44m, Y=20m."}
{"question": "Position status update please", "answer": "Currently at 33° left rotation with the cat at X=46 meters and Y=17 meters."}
{"question": "What are the current coordinates?", "answer": "The jib is at 37° right, trolley positioned at X=41m Y=23m."}
{"question": "Could you give me the location?", "answer": "The crane is oriented 29° left with the trolley at X=45 meters, Y=19 meters."}
{"question": "Present crane orientation?", "answer": "31 degrees right rotation, with the cat positioned at X=40m and Y=24m."}
{"question": "Where's our equipment positioned?", "answer": "Jib at 34° left, trolley coordinates X=48m Y=16m."}
{"question": "Current spatial configuration?", "answer": "The crane is at 27° right while the trolley is at position X=42 meters and Y=22 meters."}
{"question": "What's our exact placement?", "answer": "Currently 36° left rotation, with the cat located at X=43m, Y=21m."}
{"question": "Position readout please", "answer": "The jib is at 38° right with the trolley at X=39 meters Y=20 meters."}
{"question": "Can I get a location update?", "answer": "The crane is oriented 26° left, trolley positioned at X=47m and Y=18m."}
{"question": "What's the jib's current bearing?", "answer": "Currently at 39° right rotation with the cat at X=44m, Y=23m."}
{"question": "Where exactly are we positioned?", "answer": "The crane is at 24° left while the trolley is at position X=41 meters and Y=17 meters."}
{"question": "Current operational coordinates?", "answer": "35 degrees right rotation, with the trolley positioned at X=46m and Y=19m."}
{"question": "What's our present location?", "answer": "The jib is at 31° left with the cat located at X=40 meters Y=22 meters."}
{"question": "Could you report the position?", "answer": "Currently at 28° right rotation, trolley at X=45m, Y=21m."}
{"question": "Positional status?", "answer": "The crane is oriented 33° left with the trolley at X=42m and Y=20m."}
{"question": "Where's the equipment right now?", "answer": "Jib at 37° right, cat positioned at X=48 meters Y=17 meters."}
{"question": "Current spatial coordinates?", "answer": "The crane is at 29° left rotation while the trolley is at position X=43m, Y=24m."}
{"question": "What's our exact position?", "answer": "Currently 32° right with the trolley located at X=44m and Y=18m."}
{"question": "Location update please", "answer": "The jib is at 40° left, cat positioned at X=39 meters Y=23 meters."}
{"question": "Present orientation and position?", "answer": "26 degrees right rotation, with the trolley at X=47m and Y=16m."}
{"question": "Where are we currently located?", "answer": "The crane is oriented 34° left while the trolley is at position X=42m, Y=22m."}
{"question": "Can I get current coordinates?", "answer": "Currently at 30° right rotation, cat positioned at X=45 meters and Y=19 meters."}
{"question": "What's the jib's present angle?", "answer": "The crane is at 25° left with the trolley located at X=41m, Y=21m."}
{"question": "Positional information please", "answer": "The jib is oriented 38° right, trolley at X=46m Y=20m."}
{"question": "How do I move the crane left?", "answer": "First check for obstacles, then send the command 'rotate left'. The crane will rotate left and give back the angle. The standard rotation step is 10 degrees."}
{"question": "How do I rotate the crane left?", "answer": "First verify obstacle clearance, then issue 'turn left' command. The jib will move left and report its new angle. Default rotation is 10° increments."}
{"question": "What's the procedure for left rotation?", "answer": "1. Confirm safety sensors are clear 2. Transmit 'rotate left' instruction 3. System will move 10° left and confirm position."}
{"question": "Left movement command steps?", "answer": "Initiate with 'move left' after obstacle check. Standard leftward rotation is 10 degrees per command."}
{"question": "How to make the crane go left?", "answer": "After safety verification, execute 'left rotation' order. Expect 10° angular displacement per operation."}
{"question": "Process for turning counterclockwise?", "answer": "1. Scan for obstructions 2. Send 'left turn' signal 3. Crane responds with updated angle (10° steps)."}
{"question": "What command turns the jib left?", "answer": "Use 'shift left' post safety-check. Each command rotates the boom 10° portside."}
{"question": "How to adjust crane leftwards?", "answer": "Verify clearance --- transmit 'left adjust' --- receives confirmation of 10° left rotation."}
{"question": "Steps for left directional movement?", "answer": "Obstacle detection --- 'pivot left' command --- automatic 10° rotation with position feedback."}
{"question": "How is leftward rotation achieved?", "answer": "Through 'swing left' directives after clearance verification, moving in standardized 10° steps."}
{"question": "Protocol for left-side rotation?", "answer": "Safety scan --- issue 'left rotate' --- system completes 10° turn and reports new orientation."}
{"question": "How do I move the crane right?", "answer": "First check for obstacles, then send 'rotate right' command. The system will turn right and return the new angle in 10° increments."}
{"question": "Right rotation procedure?", "answer": "1. Confirm path is clear 2. Transmit 'turn right' 3. Crane executes 10° clockwise rotation with position update."}
{"question": "Command to swing right?", "answer": "After safety verification, use 'right swing' instruction for standard 10° starboard movements."}
{"question": "How to rotate clockwise?", "answer": "Obstacle check --- 'right rotation' command --- automatic 10° turn with angle confirmation."}
{"question": "Process for rightward adjustment?", "answer": "Scan area --- issue 'adjust right' --- equipment moves 10° right and displays new position."}
{"question": "What's the right turn protocol?", "answer": "1. Safety inspection 2. 'Pivot right' order 3. System completes 10° rotation and verifies."}
{"question": "How to command right movement?", "answer": "Post-clearance check, execute 'move right' for incremental 10° clockwise turns."}
{"question": "Steps for starboard rotation?", "answer": "Verify clearance --- transmit 'right shift' --- crane responds with new angle after 10° turn."}
{"question": "Right directional command syntax?", "answer": "After obstacle scan, use 'rotate right' for standardized 10° clockwise movements with feedback."}
{"question": "How is rightward pivoting achieved?", "answer": "Through 'turn right' directives following safety checks, moving in 10° increments with confirmation."}
{"question": "How do I move the trolley up?", "answer": "The trolley gets up with a standard step of 1 meter. The system returns the actual cordinates(X and Y)."}
{"question": "How to raise the trolley?", "answer": "The trolley ascends in 1 meter increments. After movement, the system provides updated (X,Y) coordinates."}
{"question": "Upward movement procedure?", "answer": "Command 'move up' elevates the trolley 1 meter. New position coordinates are returned upon completion."}
{"question": "How do I lift the trolley?", "answer": "Execute lift command to raise trolley vertically by 1m standard step. Current (X,Y) position is automatically reported."}
{"question": "Process for vertical ascent?", "answer": "Trolley moves upward 1 meter per command. System responds with confirmation and updated location coordinates."}
{"question": "What's the up command?", "answer": "Send 'up' directive to elevate trolley by 1m. The interface displays new X and Y values post-movement."}
{"question": "How to increase height?", "answer": "Height increases in 1m steps when moving up. Real-time coordinates are provided after each elevation."}
{"question": "Trolley elevation steps?", "answer": "1. Issue up command 2. Trolley rises 1m 3. System outputs new (X,Y) position data."}
{"question": "Procedure for upward travel?", "answer": "Initiate vertical movement up in standardized 1m increments. Position feedback includes both horizontal and vertical coordinates."}
{"question": "How is upward positioning achieved?", "answer": "Through 'ascend' commands moving trolley up 1m at a time, with automatic coordinate updates in (X,Y) format."}
{"question": "Command to make trolley go up?", "answer": "Use 'raise' instruction for 1m upward movement. The control system returns precise location coordinates after execution."}
{"question": "How to lower the trolley?", "answer": "The trolley descends in 1 meter steps. Post-movement, the system displays current (X,Y) coordinates."}
{"question": "Downward movement protocol?", "answer": "Send 'move down' command to decrease height by 1m. Updated position coordinates are automatically provided."}
{"question": "How do I descend the trolley?", "answer": "Activate descent sequence for 1m downward movement. System confirms with new X and Y location values."}
{"question": "Process for vertical lowering?", "answer": "Trolley moves down in 1m increments. Final position is reported as (X,Y) coordinate pair."}
{"question": "What's the down command?", "answer": "Transmit 'down' instruction to lower trolley 1m. Interface outputs revised coordinates upon completion."}
{"question": "How to reduce height?", "answer": "Height decreases in 1m steps when moving down. Position confirmation includes both axis measurements."}
{"question": "Trolley descent steps?", "answer": "1. Issue down command 2. Trolley lowers 1m 3. System returns updated (X,Y) location data."}
{"question": "Procedure for downward travel?", "answer": "Execute vertical descent in 1m standard increments. Position feedback contains complete coordinate information."}
{"question": "How is downward positioning controlled?", "answer": "Via 'descend' commands moving trolley down 1m per instruction, with automatic (X,Y) coordinate reporting."}
{"question": "Command to make trolley go down?", "answer": "Use 'lower' directive for 1m downward movement. Control system responds with precise location coordinates."}
{"question": "How does obstacle detection work?", "answer": "The crane's sensors continuously monitor for obstacles. Status displays: [Clear path] or [Obstacle detected at 3 o'clock]. Manual scan available via 'obstacle scan' command."}
{"question": "What's the obstacle checking procedure?", "answer": "1. Automatic sensors provide real-time alerts 2. For manual verification, use 'check obstacles' command 3. System responds with detailed zone status."}
{"question": "Can I verify obstacle clearance?", "answer": "Yes, the system auto-detects obstructions (current status: [Clear]). For confirmation, execute 'verify clearance' to get zone-by-zone feedback."}
{"question": "How to scan for blocking objects?", "answer": "Primary detection is automatic. For active scanning, input 'full obstacle check' - returns sector map with danger zones highlighted."}
{"question": "What if I suspect an undetected obstacle?", "answer": "The system's 360° sensors should catch all obstructions (current status: [Clear]). If uncertain, command 'deep scan' for thorough verification."}
{"question": "Obstacle detection system status?", "answer": "Active monitoring: [No obstacles detected]. Manual override available via 'safety scan' command for complete environment analysis."}
{"question": "How reliable is the obstacle warning?", "answer": "System has 99.7% detection accuracy (current status: [Clear]). For absolute certainty, trigger 'confirm clearance' command for sensor verification."}
{"question": "Can I check specific zones for obstacles?", "answer": "Yes, while automatic detection covers all areas, use 'zone scan [sector]' (e.g., 'zone scan left') for targeted obstacle checking."}
{"question": "What does the obstacle alert look like?", "answer": "Visual/Audio warnings activate when detected (current status: [Clear]). For simulation, use 'test detection' command to verify alert systems."}
{"question": "How often does obstacle detection update?", "answer": "Real-time monitoring refreshes every 0.2s (current status: [Clear]). Manual 'refresh scan' provides instantaneous update."}
{"question": "What's the maximum safe rotation speed?", "answer": "The maximum safe rotation speed is 5 degrees per second. Reduce to 2 degrees per second when carrying a load."}
{"question": "How do I check if there's an obstacle?", "answer": "The system automatically detects obstacles. Current status: [clear/obstacle detected]. You can also manually check with the 'detect obstacle' command."}
{"question": "What's the load capacity of the crane?", "answer": "The maximum load capacity is 1000kg. Current load: 500kg."}
{"question": "How do I pick up a load?", "answer": "1. Position the crane over the load. 2. Lower the hook. 3. Send the 'take load' command. 4. Verify secure attachment before lifting."}
{"question": "What safety checks should I perform before moving?", "answer": "1. Verify load is secure. 2. Check for obstacles. 3. Ensure all sensors are operational. 4. Confirm clearance path."}
{"question": "Why won't the crane move right?", "answer": "Possible reasons: 1. Obstacle detected on right side. 2. Maximum rotation limit reached. 3. Safety interlock engaged. Check system alerts for details."}
{"question": "How do I get the current position?", "answer": "Current position is X=10.5m, Y=4.2m. You can also ask 'what's our position?'"}
{"question": "What's the emergency stop procedure?", "answer": "1. Press the red emergency stop button. 2. Secure any suspended loads. 3. Investigate the cause before resetting."}

7
generation_config.json Normal file
View File

@@ -0,0 +1,7 @@
{
"bos_token_id": 1,
"eos_token_id": 2,
"max_length": 2048,
"pad_token_id": 0,
"transformers_version": "4.50.3"
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d005a71608792d49a54dd6c9fcb25730d5f8b311a29b808919d1265b47308d2b
size 4400216536

30
special_tokens_map.json Normal file
View File

@@ -0,0 +1,30 @@
{
"bos_token": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

277139
tokenizer.json Normal file

File diff suppressed because it is too large Load Diff

BIN
tokenizer.model (Stored with Git LFS) Normal file

Binary file not shown.

44
tokenizer_config.json Normal file
View File

@@ -0,0 +1,44 @@
{
"add_bos_token": true,
"add_eos_token": false,
"add_prefix_space": null,
"added_tokens_decoder": {
"0": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"bos_token": "<s>",
"chat_template": "{% for message in messages %}\n{% if message['role'] == 'user' %}\n{{ '<|user|>\n' + message['content'] + eos_token }}\n{% elif message['role'] == 'system' %}\n{{ '<|system|>\n' + message['content'] + eos_token }}\n{% elif message['role'] == 'assistant' %}\n{{ '<|assistant|>\n' + message['content'] + eos_token }}\n{% endif %}\n{% if loop.last and add_generation_prompt %}\n{{ '<|assistant|>' }}\n{% endif %}\n{% endfor %}",
"clean_up_tokenization_spaces": false,
"eos_token": "</s>",
"extra_special_tokens": {},
"legacy": false,
"model_max_length": 2048,
"pad_token": "</s>",
"padding_side": "right",
"sp_model_kwargs": {},
"tokenizer_class": "LlamaTokenizer",
"unk_token": "<unk>",
"use_default_system_prompt": false
}