初始化项目，由ModelHub XC社区提供模型
Model: arun11karthik/cellsense-fim-7b-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
39
.gitattributes
vendored
Normal file
39
.gitattributes
vendored
Normal file
@@ -0,0 +1,39 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
cellsense-fim-7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
cellsense-fim-7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
cellsense-fim-7b-BF16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
icon.png filter=lfs diff=lfs merge=lfs -text
|
||||
100
README.md
Normal file
100
README.md
Normal file
@@ -0,0 +1,100 @@
|
||||
---
|
||||
library_name: gguf
|
||||
base_model:
|
||||
- arun11karthik/cellsense-fim-7b
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- cellsense
|
||||
- fim
|
||||
- code
|
||||
- gguf
|
||||
---
|
||||
|
||||
<p align="center">
|
||||
<img src="icon.png" alt="CellSense" width="180" height="180" />
|
||||
</p>
|
||||
|
||||
# arun11karthik/cellsense-fim-7b-GGUF
|
||||
|
||||
GGUF quantisations of [`arun11karthik/cellsense-fim-7b`](https://huggingface.co/arun11karthik/cellsense-fim-7b), a fill-in-the-middle (FIM) code-completion model.
|
||||
|
||||
## Available files
|
||||
|
||||
| File | Type | Notes |
|
||||
|------|------|-------|
|
||||
| `cellsense-fim-7b-BF16.gguf` | BF16 | Full bfloat16 precision — highest quality |
|
||||
| `cellsense-fim-7b-Q8_0.gguf` | Q8_0 | Near-lossless 8-bit quantisation |
|
||||
| `cellsense-fim-7b-Q5_K_M.gguf` | Q5_K_M | Good quality / size trade-off |
|
||||
|
||||
## Usage
|
||||
|
||||
For fully local, no-GPU-required inference, GGUF builds are published at
|
||||
[**`arun11karthik/cellsense-fim-7b-GGUF`**](https://huggingface.co/arun11karthik/cellsense-fim-7b-GGUF).
|
||||
Ollama can pull and run these directly from the Hugging Face Hub — no manual download or `Modelfile`
|
||||
required. This is the recommended path for running CellSense entirely on your own machine: with Ollama,
|
||||
**no code or context ever leaves your computer.**
|
||||
|
||||
### Available quantizations
|
||||
|
||||
| Quantization | Size (approx.) | Notes | Pull with |
|
||||
|--------------|:--------------:|-------|-----------|
|
||||
| `Q5_K_M` | 5.4 GB | Good quality / size trade-off | `ollama run hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q5_K_M` |
|
||||
| `Q8_0` | 8.1 GB | Near-lossless 8-bit quantization (recommended) | `ollama run hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q8_0` |
|
||||
| `BF16` | 15.2 GB | Full bfloat16 precision — highest quality | `ollama run hf.co/arun11karthik/cellsense-fim-7b-GGUF:BF16` |
|
||||
|
||||
### 1. Install Ollama and pull the model
|
||||
|
||||
Install [Ollama](https://ollama.com), then pull a quantization (this also registers the model so
|
||||
CellSense can use it):
|
||||
|
||||
```bash
|
||||
ollama pull hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q5_K_M
|
||||
```
|
||||
|
||||
By default Ollama serves its API at `http://localhost:11434`. The model name as it appears in
|
||||
`ollama list` — `hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q5_K_M` — is what you'll enter into
|
||||
CellSense below.
|
||||
|
||||
### 2. Install the CellSense JupyterLab plugin
|
||||
|
||||
```bash
|
||||
pip install jupyterlab-cellsense
|
||||
jupyter lab
|
||||
```
|
||||
|
||||
See the [CellSense repository](https://github.com/arunkarthik11/CellSense) for full installation
|
||||
options.
|
||||
|
||||
### 3. Point CellSense at your local Ollama model
|
||||
|
||||
Open the CellSense panel from the left sidebar in JupyterLab, go to **Basic Settings**, and configure
|
||||
the **Ollama** provider:
|
||||
|
||||
| Setting | Value |
|
||||
|---------|-------|
|
||||
| **Provider** | `Ollama` |
|
||||
| **Base URL** | `http://localhost:11434` |
|
||||
| **Model Family** | `cellsense` |
|
||||
| **Model** | `hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q5_K_M` (must match the tag in `ollama list`) |
|
||||
|
||||
> ✅ **Set Model Family to `cellsense`.** CellSense now ships first-class support for the CellSense-FIM
|
||||
> models, so the plugin builds prompts in exactly the repository-, import-, and task-aware FIM format
|
||||
> these models were trained on — no extra configuration needed.
|
||||
|
||||
Click **Save & Apply**, then start typing in a notebook cell — ghost-text completions from your local
|
||||
model appear inline. Press **Tab** to accept.
|
||||
|
||||
### Raw API check (optional)
|
||||
|
||||
To confirm Ollama is serving the model with the correct FIM format before wiring up CellSense, query it
|
||||
directly:
|
||||
|
||||
```bash
|
||||
curl http://localhost:11434/api/generate -d '{
|
||||
"model": "hf.co/arun11karthik/cellsense-fim-7b-GGUF:Q5_K_M",
|
||||
"prompt": "<|fim_prefix|>import pandas as pd\ndf = pd.read_csv(\"data.csv\")\n<|fim_suffix|>\ndf.head()\n<|fim_middle|>",
|
||||
"stream": false,
|
||||
"options": { "temperature": 0.0, "num_predict": 128 }
|
||||
}'
|
||||
```
|
||||
|
||||
3
cellsense-fim-7b-BF16.gguf
Normal file
3
cellsense-fim-7b-BF16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:965a19c0cf6c87f847b83fe7d6f25f884a95c6c4d5007f1ab0ed6bd98970fa60
|
||||
size 15237853312
|
||||
3
cellsense-fim-7b-Q5_K_M.gguf
Normal file
3
cellsense-fim-7b-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f266f983d5b90050ad905afed6ce5cec54993f24d137db47d7a24acdc14d8127
|
||||
size 5444831360
|
||||
3
cellsense-fim-7b-Q8_0.gguf
Normal file
3
cellsense-fim-7b-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:55a58d22f9780b168a99a8a5401609dbfb712b8682010f15b76a47c2f35d0ab6
|
||||
size 8098525312
|
||||
Reference in New Issue
Block a user