初始化项目，由ModelHub XC社区提供模型

Model: gabriellarson/Jan-nano-128k-GGUF Source: Original Platform
2026-10-08 12:17:18 +08:00
commit b259033d55
27 changed files with 227 additions and 0 deletions
--- a/.gitattributes
+++ b/.gitattributes
@@ -0,0 +1,60 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-F16.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+Jan-nano-128k-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
--- a/Jan-nano-128k-F16.gguf
+++ b/Jan-nano-128k-F16.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc346213323d40cdd19c868f38ebefcbd51f327246dba1f18a8be4272221aff4
+size 8051285120
--- a/Jan-nano-128k-IQ1_M.gguf
+++ b/Jan-nano-128k-IQ1_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea7c20a78f9638cf13871b0da0e447a9205fbfa68b0b275b0e8474b326144843
+size 1127017856
--- a/Jan-nano-128k-IQ1_S.gguf
+++ b/Jan-nano-128k-IQ1_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ebbd42786ccde7bafefa1d95624bd8ebd9c64c02733d9be8aa0ff45eb913a9c3
+size 1055255936
--- a/Jan-nano-128k-IQ2_M.gguf
+++ b/Jan-nano-128k-IQ2_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:23180fb7bf7e5458b45944047afb56072945dda57029b20fa88a5b1734082d7a
+size 1512983936
--- a/Jan-nano-128k-IQ2_S.gguf
+++ b/Jan-nano-128k-IQ2_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df96c98589d37e7ade68d9bf682a704c3210a94d09ff2476cc7c9d627b4a0136
+size 1417301376
--- a/Jan-nano-128k-IQ2_XS.gguf
+++ b/Jan-nano-128k-IQ2_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1793a17a2f93b76237811642a8305b0d5f484585b1c466a71295131e99c1f70
+size 1354100096
--- a/Jan-nano-128k-IQ2_XXS.gguf
+++ b/Jan-nano-128k-IQ2_XXS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:481df223916016a57b5d3081308ffb296fa21f8636a53ccd531e0fcc0f115113
+size 1246621056
--- a/Jan-nano-128k-IQ3_M.gguf
+++ b/Jan-nano-128k-IQ3_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4cd8eeb8dc2d027de75875f828d5b03222da4f53299883ebb2ece739c45b2ce0
+size 1962896256
--- a/Jan-nano-128k-IQ3_S.gguf
+++ b/Jan-nano-128k-IQ3_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f000c0efa65f88355b1550dd2192edeac4247eb5ef04e1e684b5941c14d1bd0e
+size 1899531136
--- a/Jan-nano-128k-IQ3_XS.gguf
+++ b/Jan-nano-128k-IQ3_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2ae1a60f7c0f4ee260a66cd48c5b49599480901c75f34f6c8bc60a5b08612bca
+size 1814375296
--- a/Jan-nano-128k-IQ3_XXS.gguf
+++ b/Jan-nano-128k-IQ3_XXS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0ba7b8b37b60dae5c116775abefb69e824867d9cd878e92a88f8cb67f04cb7d5
+size 1670188416
--- a/Jan-nano-128k-IQ4_XS.gguf
+++ b/Jan-nano-128k-IQ4_XS.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df35e910890d2bc1094ab04c701dfd27db4760c23536dab615cbc454625cfa9a
+size 2270751616
--- a/Jan-nano-128k-Q2_K.gguf
+++ b/Jan-nano-128k-Q2_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dceaf99f2539ade9773153d15d9f28deab29a9ddd5f230d1b8e7622fb097eb49
+size 1669499776
--- a/Jan-nano-128k-Q2_K_S.gguf
+++ b/Jan-nano-128k-Q2_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ce9d5a5d9b9533d99cc6d0f0e72d0cbc3119a26e4a065ccc5e1e371dccd567d
+size 1563454336
--- a/Jan-nano-128k-Q3_K_L.gguf
+++ b/Jan-nano-128k-Q3_K_L.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f74f7e9bdbf938fe90b333870aa5e4403fa95efa5fd805de88785edafa8da0d
+size 2239785856
--- a/Jan-nano-128k-Q3_K_M.gguf
+++ b/Jan-nano-128k-Q3_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a83af3008aff1393410b96b7be4d3a7d01ccc1426659b3a484992b9561e262f1
+size 2075618176
--- a/Jan-nano-128k-Q3_K_S.gguf
+++ b/Jan-nano-128k-Q3_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:40059e01cdf493143de462115c773f2d9e387c9ffb531e11ee29ba721d5882c6
+size 1886997376
--- a/Jan-nano-128k-Q4_0.gguf
+++ b/Jan-nano-128k-Q4_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dd19984b257e245ec6121b0ce7e0103f79851dd5e6f88fe4f5c957da48507086
+size 2375773056
--- a/Jan-nano-128k-Q4_K_M.gguf
+++ b/Jan-nano-128k-Q4_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2de6f72d472602c9fcbda199a9090176be674ee2b6c95f1b9f63f7288230f3c
+size 2497280896
--- a/Jan-nano-128k-Q4_K_S.gguf
+++ b/Jan-nano-128k-Q4_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:49429ad4ea61442a3fbd65d8743e9696e5a6eb508bdd41df95ea7050a4ddeb25
+size 2383309696
--- a/Jan-nano-128k-Q5_0.gguf
+++ b/Jan-nano-128k-Q5_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:34a2396feeb6f0efccf7eaf4495096ef7cbfd73892f5feb24f98ada2e3b7b988
+size 2829937536
--- a/Jan-nano-128k-Q5_K_M.gguf
+++ b/Jan-nano-128k-Q5_K_M.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d35dfd42be61144e9bb660cb9cee89a113516cabf947a172965ac0f2169344e5
+size 2889513856
--- a/Jan-nano-128k-Q5_K_S.gguf
+++ b/Jan-nano-128k-Q5_K_S.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c1c356114cf9b38ba7e2898d44b3fbd1dbeb6bcb2c81487acb5026ab344ba0c
+size 2823711616
--- a/Jan-nano-128k-Q6_K.gguf
+++ b/Jan-nano-128k-Q6_K.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:630469b634ba5e1e9512dd81c4c805c250d68e69fb0c3b801dadb728154c5e99
+size 3306261376
--- a/Jan-nano-128k-Q8_0.gguf
+++ b/Jan-nano-128k-Q8_0.gguf
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:701664fdc926e46aa2ba2338e5534c150c2c4e77505ba0dca759c27ab411a80c
+size 4280405376
--- a/README.md
+++ b/README.md
@@ -0,0 +1,92 @@
+---
+license: apache-2.0
+language:
+- en
+base_model:
+- Menlo/Jan-nano-128k
+pipeline_tag: text-generation
+---
+# Jan-Nano-128k: Empowering deeper research through extended context understanding.
+
+[![GitHub](https://img.shields.io/badge/GitHub-Repository-blue?logo=github)](https://github.com/menloresearch/deep-research) 
+[![License](https://img.shields.io/badge/License-Apache%202.0-yellow)](https://opensource.org/licenses/Apache-2.0)
+
+<div align="center">
+  <img src="https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/NP7CvcjOtLX8mST0t7eAM.png" width="300" alt="Jan-Nano-128k">
+</div>
+
+**Authors:** [Alan Dao](https://scholar.google.com/citations?user=eGWws2UAAAAJ&hl=en), [Bach Vu Dinh](https://scholar.google.com/citations?user=7Lr6hdoAAAAJ&hl=vi), [Thinh Le](https://scholar.google.com/citations?user=8tcN7xMAAAAJ&hl=en)
+
+## Overview
+
+Jan-Nano-128k represents a significant advancement in compact language models for research applications. Building upon the success of [Jan-Nano](https://huggingface.co/Menlo/Jan-nano), this enhanced version features a **native 128k context window** that enables deeper, more comprehensive research capabilities without the performance degradation typically associated with context extension methods.
+
+**Key Improvements:**
+- **🔍 Research Deeper**: Extended context allows for processing entire research papers, lengthy documents, and complex multi-turn conversations
+- **⚡ Native 128k Window**: Built from the ground up to handle long contexts efficiently, maintaining performance across the full context range  
+- **📈 Enhanced Performance**: Unlike traditional context extension methods, Jan-Nano-128k shows improved performance with longer contexts
+
+This model maintains full compatibility with Model Context Protocol (MCP) servers while dramatically expanding the scope of research tasks it can handle in a single session.
+
+## Evaluation
+
+Jan-Nano-128k has been rigorously evaluated on the SimpleQA benchmark using our MCP-based methodology, demonstrating superior performance compared to its predecessor:
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/65713d70f56f9538679e5a56/Bc0ehij86l_NX52OfxeOj.png)
+
+## Why Jan-Nano-128k?
+
+Traditional approaches to extending context length, such as YaRN (Yet another RoPE extensioN), often result in performance degradation as context length increases. Jan-Nano-128k breaks this paradigm:
+
+This fundamental difference makes Jan-Nano-128k ideal for research applications requiring deep document analysis, multi-document synthesis, and complex reasoning over large information sets.
+
+## 🖥️ How to Run Locally
+
+![Jan-Nano Demo](replay.gif)
+
+Jan-Nano-128k is fully supported by [Jan - beta build](https://www.jan.ai/docs/desktop/beta), providing a seamless local AI experience with complete privacy and control.
+
+For additional tutorials and community guidance, visit our [Discussion Forums](https://huggingface.co/Menlo/Jan-nano-128k/discussions).
+
+### VLLM Deployment
+
+```bash
+vllm serve Menlo/Jan-nano-128k \
+    --host 0.0.0.0 \
+    --port 1234 \
+    --enable-auto-tool-choice \
+    --tool-call-parser hermes \
+    --rope-scaling '{"rope_type":"yarn","factor":3.2,"original_max_position_embeddings":40960}' --max-model-len 131072
+```
+
+**Note:** The chat template is included in the tokenizer. For troubleshooting, download the [Non-think chat template](https://qwen.readthedocs.io/en/latest/_downloads/c101120b5bebcc2f12ec504fc93a965e/qwen3_nonthinking.jinja).
+
+### Recommended Sampling Parameters
+
+```yaml
+Temperature: 0.7
+Top-p: 0.8
+Top-k: 20
+Min-p: 0.0
+```
+
+## 🤝 Community & Support
+
+- **Discussions**: [HuggingFace Community](https://huggingface.co/Menlo/Jan-nano-128k/discussions)
+- **Issues**: [GitHub Repository](https://github.com/menloresearch/deep-research/issues)
+- **Documentation**: [Official Docs](https://menloresearch.github.io/deep-research/)
+
+## 📄 Citation
+
+```bibtex
+@model{jan-nano-128k,
+  title={Jan-Nano-128k: Deep Research with Extended Context},
+  author={Dao, Alan and Dinh, Bach Vu and Le Thinh},
+  year={2024},
+  url={https://huggingface.co/Menlo/Jan-nano-128k}
+}
+```
+
+---
+
+*Jan-Nano-128k: Empowering deeper research through extended context understanding.*