commit 65d9f2f740b9daa655b1fda47947f593744a0d3c Author: ModelHub XC Date: Tue Aug 11 14:53:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: arun11karthik/cellsense-fim-0.5b-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..cd72141 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +cellsense-fim-0.5b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +cellsense-fim-0.5b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +cellsense-fim-0.5b-BF16.gguf filter=lfs diff=lfs merge=lfs -text +icon.png filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..25f9526 --- /dev/null +++ b/README.md @@ -0,0 +1,100 @@ +--- +library_name: gguf +base_model: +- arun11karthik/cellsense-fim-0.5b +pipeline_tag: text-generation +tags: +- cellsense +- fim +- code +- gguf +--- + +

+ CellSense +

+ +# arun11karthik/cellsense-fim-0.5b-GGUF + +GGUF quantisations of [`arun11karthik/cellsense-fim-0.5b`](https://huggingface.co/arun11karthik/cellsense-fim-0.5b), a fill-in-the-middle (FIM) code-completion model. + +## Available files + +| File | Type | Notes | +|------|------|-------| +| `cellsense-fim-0.5b-BF16.gguf` | BF16 | Full bfloat16 precision — highest quality | +| `cellsense-fim-0.5b-Q8_0.gguf` | Q8_0 | Near-lossless 8-bit quantisation | +| `cellsense-fim-0.5b-Q5_K_M.gguf` | Q5_K_M | Good quality / size trade-off | + +## Usage + +For fully local, no-GPU-required inference, GGUF builds are published at +[**`arun11karthik/cellsense-fim-0.5b-GGUF`**](https://huggingface.co/arun11karthik/cellsense-fim-0.5b-GGUF). +Ollama can pull and run these directly from the Hugging Face Hub — no manual download or `Modelfile` +required. This is the recommended path for running CellSense entirely on your own machine: with Ollama, +**no code or context ever leaves your computer.** + +### Available quantizations + +| Quantization | Size (approx.) | Notes | Pull with | +|--------------|:--------------:|-------|-----------| +| `Q5_K_M` | ~420 MB | Good quality / size trade-off | `ollama run hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q5_K_M` | +| `Q8_0` | ~531 MB | Near-lossless 8-bit quantization | `ollama run hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q8_0` | +| `BF16` | ~994 MB | Full bfloat16 precision — highest quality (recommended) | `ollama run hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:BF16` | + +### 1. Install Ollama and pull the model + +Install [Ollama](https://ollama.com), then pull a quantization (this also registers the model so +CellSense can use it): + +```bash +ollama pull hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q5_K_M +``` + +By default Ollama serves its API at `http://localhost:11434`. The model name as it appears in +`ollama list` — `hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q5_K_M` — is what you'll enter into +CellSense below. + +### 2. Install the CellSense JupyterLab plugin + +```bash +pip install jupyterlab-cellsense +jupyter lab +``` + +See the [CellSense repository](https://github.com/arunkarthik11/CellSense) for full installation +options. + +### 3. Point CellSense at your local Ollama model + +Open the CellSense panel from the left sidebar in JupyterLab, go to **Basic Settings**, and configure +the **Ollama** provider: + +| Setting | Value | +|---------|-------| +| **Provider** | `Ollama` | +| **Base URL** | `http://localhost:11434` | +| **Model Family** | `cellsense` | +| **Model** | `hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q5_K_M` (must match the tag in `ollama list`) | + +> ✅ **Set Model Family to `cellsense`.** CellSense now ships first-class support for the CellSense-FIM +> models, so the plugin builds prompts in exactly the repository-, import-, and task-aware FIM format +> these models were trained on — no extra configuration needed. + +Click **Save & Apply**, then start typing in a notebook cell — ghost-text completions from your local +model appear inline. Press **Tab** to accept. + +### Raw API check (optional) + +To confirm Ollama is serving the model with the correct FIM format before wiring up CellSense, query it +directly: + +```bash +curl http://localhost:11434/api/generate -d '{ + "model": "hf.co/arun11karthik/cellsense-fim-0.5b-GGUF:Q5_K_M", + "prompt": "<|fim_prefix|>import pandas as pd\ndf = pd.read_csv(\"data.csv\")\n<|fim_suffix|>\ndf.head()\n<|fim_middle|>", + "stream": false, + "options": { "temperature": 0.0, "num_predict": 128 } +}' +``` + diff --git a/cellsense-fim-0.5b-BF16.gguf b/cellsense-fim-0.5b-BF16.gguf new file mode 100644 index 0000000..8dd2d02 --- /dev/null +++ b/cellsense-fim-0.5b-BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:beec9f92e19b6a5bea5c844e7500545da0392afb9f6a4834c59db5c8b1d474cd +size 994156480 diff --git a/cellsense-fim-0.5b-Q5_K_M.gguf b/cellsense-fim-0.5b-Q5_K_M.gguf new file mode 100644 index 0000000..7cb2c08 --- /dev/null +++ b/cellsense-fim-0.5b-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b96ed48945c0deb6eafe8c76a82861077e244caed4d0d2f3a9a66c1937c69878 +size 420085696 diff --git a/cellsense-fim-0.5b-Q8_0.gguf b/cellsense-fim-0.5b-Q8_0.gguf new file mode 100644 index 0000000..bcb2ad1 --- /dev/null +++ b/cellsense-fim-0.5b-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a301e2dbbf0ecea239001f4741f09abf73d871b0fb81ebb720caa67dcd83f6e +size 531067840 diff --git a/icon.png b/icon.png new file mode 100644 index 0000000..3eb012a --- /dev/null +++ b/icon.png @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d76b72e1f3a1c165377900dbd23fa3ff15f31797cfff0c827839b03f032f3ed4 +size 116278