commit b4f34e4cca8bfe58d027a5947423b6f7f0621c0f Author: ModelHub XC Date: Thu Jun 18 09:16:12 2026 +0800 初始化项目,由ModelHub XC社区提供模型 Model: second-state/xLAM-7b-fc-r-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..641d797 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,48 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +xLAM-7b-fc-r-f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..a031367 --- /dev/null +++ b/README.md @@ -0,0 +1,86 @@ +--- +license: cc-by-nc-4.0 +model_name: xLAM-7b-fc-r +base_model: Salesforce/xLAM-7b-fc-r +inference: false +model_creator: Salesforce +quantized_by: Second State Inc. +pipeline_tag: text-generation +tags: +- function-calling +- LLM Agent +- tool-use +- deepseek +language: +- en +--- + + + +
+ +
+
+ + +# xLAM-7b-fc-r-GGUF + +## Original Model + +[Salesforce/xLAM-7b-fc-r](https://huggingface.co/Salesforce/xLAM-7b-fc-r) + +## Run with LlamaEdge + +- LlamaEdge version: coming soon + + + +- Context size: `4096` + + + +## Quantized GGUF Models + +| Name | Quant method | Bits | Size | Use case | +| ---- | ---- | ---- | ---- | ----- | +| [xLAM-7b-fc-r-Q2_K.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q2_K.gguf) | Q2_K | 2 | 2.72 GB| smallest, significant quality loss - not recommended for most purposes | +| [xLAM-7b-fc-r-Q3_K_L.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q3_K_L.gguf) | Q3_K_L | 3 | 3.75 GB| small, substantial quality loss | +| [xLAM-7b-fc-r-Q3_K_M.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q3_K_M.gguf) | Q3_K_M | 3 | 3.46 GB| very small, high quality loss | +| [xLAM-7b-fc-r-Q3_K_S.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q3_K_S.gguf) | Q3_K_S | 3 | 3.14 GB| very small, high quality loss | +| [xLAM-7b-fc-r-Q4_0.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q4_0.gguf) | Q4_0 | 4 | 4.00 GB| legacy; small, very high quality loss - prefer using Q3_K_M | +| [xLAM-7b-fc-r-Q4_K_M.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q4_K_M.gguf) | Q4_K_M | 4 | 4.22 GB| medium, balanced quality - recommended | +| [xLAM-7b-fc-r-Q4_K_S.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q4_K_S.gguf) | Q4_K_S | 4 | 4.03 GB| small, greater quality loss | +| [xLAM-7b-fc-r-Q5_0.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q5_0.gguf) | Q5_0 | 5 | 4.81 GB| legacy; medium, balanced quality - prefer using Q4_K_M | +| [xLAM-7b-fc-r-Q5_K_M.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q5_K_M.gguf) | Q5_K_M | 5 | 4.93 GB| large, very low quality loss - recommended | +| [xLAM-7b-fc-r-Q5_K_S.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q5_K_S.gguf) | Q5_K_S | 5 | 4.81 GB| large, low quality loss - recommended | +| [xLAM-7b-fc-r-Q6_K.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q6_K.gguf) | Q6_K | 6 | 5.67 GB| very large, extremely low quality loss | +| [xLAM-7b-fc-r-Q8_0.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-Q8_0.gguf) | Q8_0 | 8 | 7.35 GB| very large, extremely low quality loss - not recommended | +| [xLAM-7b-fc-r-f16.gguf](https://huggingface.co/second-state/xLAM-7b-fc-r-GGUF/blob/main/xLAM-7b-fc-r-f16.gguf) | f16 | 16 | 13.8 GB| | + +*Quantized with llama.cpp b3613.* \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000..1b67382 --- /dev/null +++ b/config.json @@ -0,0 +1,28 @@ +{ + "architectures": [ + "LlamaForCausalLM" + ], + "attention_bias": false, + "attention_dropout": 0.0, + "bos_token_id": 100000, + "eos_token_id": 100015, + "hidden_act": "silu", + "hidden_size": 4096, + "initializer_range": 0.02, + "intermediate_size": 11008, + "max_position_embeddings": 4096, + "mlp_bias": false, + "model_type": "llama", + "num_attention_heads": 32, + "num_hidden_layers": 30, + "num_key_value_heads": 32, + "pretraining_tp": 1, + "rms_norm_eps": 1e-06, + "rope_scaling": null, + "rope_theta": 10000.0, + "tie_word_embeddings": false, + "torch_dtype": "bfloat16", + "transformers_version": "4.41.0", + "use_cache": false, + "vocab_size": 102400 +} diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file diff --git a/xLAM-7b-fc-r-Q2_K.gguf b/xLAM-7b-fc-r-Q2_K.gguf new file mode 100644 index 0000000..d025020 --- /dev/null +++ b/xLAM-7b-fc-r-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6de824d1ebbd1e66803347bc021cee29d7a58ad6913a7de4e44cda9733232a92 +size 2718423168 diff --git a/xLAM-7b-fc-r-Q3_K_L.gguf b/xLAM-7b-fc-r-Q3_K_L.gguf new file mode 100644 index 0000000..3963f18 --- /dev/null +++ b/xLAM-7b-fc-r-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:14cb64698526f30e43f546ffd4b5a0954a3d12fcd6fa69fcfe0c3da17f6215c9 +size 3746273408 diff --git a/xLAM-7b-fc-r-Q3_K_M.gguf b/xLAM-7b-fc-r-Q3_K_M.gguf new file mode 100644 index 0000000..699193a --- /dev/null +++ b/xLAM-7b-fc-r-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05f921251c05b677db2418026c471863804d51496841d1c971f314706a185e7f +size 3461191808 diff --git a/xLAM-7b-fc-r-Q3_K_S.gguf b/xLAM-7b-fc-r-Q3_K_S.gguf new file mode 100644 index 0000000..98cba09 --- /dev/null +++ b/xLAM-7b-fc-r-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da7fe902804dc292ce6d5026a65cdae0fecc594192a17615d4562e1f1b21d75f +size 3138017408 diff --git a/xLAM-7b-fc-r-Q4_0.gguf b/xLAM-7b-fc-r-Q4_0.gguf new file mode 100644 index 0000000..f88d5c4 --- /dev/null +++ b/xLAM-7b-fc-r-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2e5921c9da1d982b2a21bc72901a71d516a20a3454ffeeef35ebd9350a71cfc6 +size 4000061568 diff --git a/xLAM-7b-fc-r-Q4_K_M.gguf b/xLAM-7b-fc-r-Q4_K_M.gguf new file mode 100644 index 0000000..ea8cda3 --- /dev/null +++ b/xLAM-7b-fc-r-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a3f773f4f6bbf110872b02feb57014b85e887ab38fac99ca173c7f569dd4f94 +size 4223359104 diff --git a/xLAM-7b-fc-r-Q4_K_S.gguf b/xLAM-7b-fc-r-Q4_K_S.gguf new file mode 100644 index 0000000..e5e3636 --- /dev/null +++ b/xLAM-7b-fc-r-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cac0fe14a518fbfd4c477ddb40a2057552168bdd1c4684a479e7b71a84f9474d +size 4025358464 diff --git a/xLAM-7b-fc-r-Q5_0.gguf b/xLAM-7b-fc-r-Q5_0.gguf new file mode 100644 index 0000000..3c19b7f --- /dev/null +++ b/xLAM-7b-fc-r-Q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:60a65be067efb2673b6a7993b2dbb01a5e6e6745959c2e83210474299d2a1ff8 +size 4811397248 diff --git a/xLAM-7b-fc-r-Q5_K_M.gguf b/xLAM-7b-fc-r-Q5_K_M.gguf new file mode 100644 index 0000000..6b3440c --- /dev/null +++ b/xLAM-7b-fc-r-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a73da7be39b3c1f0d0d62de98be6cdd598809d136d0e57625784f739901cbac1 +size 4926429312 diff --git a/xLAM-7b-fc-r-Q5_K_S.gguf b/xLAM-7b-fc-r-Q5_K_S.gguf new file mode 100644 index 0000000..93176b3 --- /dev/null +++ b/xLAM-7b-fc-r-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d88e6afe0a545a9d7885c29215c38741a8598b5b43ae02749bda3a05673afb56 +size 4811397248 diff --git a/xLAM-7b-fc-r-Q6_K.gguf b/xLAM-7b-fc-r-Q6_K.gguf new file mode 100644 index 0000000..f615a81 --- /dev/null +++ b/xLAM-7b-fc-r-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7499add75a3ed88f2e7e69554a886c43897a9ae22f9fdca67a88c93ac3d19eed +size 5673441408 diff --git a/xLAM-7b-fc-r-Q8_0.gguf b/xLAM-7b-fc-r-Q8_0.gguf new file mode 100644 index 0000000..c0eded1 --- /dev/null +++ b/xLAM-7b-fc-r-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ffa19728cd20177a5a0fb7e81a334061968da295da3d1af69a8f3f0ee2919e5b +size 7346985088 diff --git a/xLAM-7b-fc-r-f16.gguf b/xLAM-7b-fc-r-f16.gguf new file mode 100644 index 0000000..60805dd --- /dev/null +++ b/xLAM-7b-fc-r-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:23e9889042c465f76a1bf7cd0e56373bf0d07566a158e631a5d358ab056a57d7 +size 13825218688