初始化项目,由ModelHub XC社区提供模型
Model: darkai-1/darkit-v2.0 Source: Original Platform
This commit is contained in:
3
Q4_K_M.gguf
Normal file
3
Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c7553f99f3b4b2e229ff7dc64a6cd0ebb654cd4f2b0b0d302792a41e426e4d8a
|
||||||
|
size 9001752960
|
||||||
3
Q5_K_M.gguf
Normal file
3
Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b2719f392c4c2d97ef707eda627faf0529a01591d68d75178aa75ee5bdb6359d
|
||||||
|
size 10514569600
|
||||||
3
Q8_0.gguf
Normal file
3
Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6cf59588d66fee143619965c818e5b8e3bf80514494db28d9f97893815bc9248
|
||||||
|
size 15698533760
|
||||||
62
README.md
Normal file
62
README.md
Normal file
@@ -0,0 +1,62 @@
|
|||||||
|
---
|
||||||
|
language: multilingual
|
||||||
|
license: apache-2.0
|
||||||
|
organization: darkai
|
||||||
|
author: darkai
|
||||||
|
library_name: llama.cpp
|
||||||
|
tags:
|
||||||
|
- darkit-2.0
|
||||||
|
- DarkAI Company
|
||||||
|
- text-generation
|
||||||
|
- programming
|
||||||
|
- reasoning
|
||||||
|
base_model: darkai/darkit-v2.0
|
||||||
|
model_type: custom
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
---
|
||||||
|
|
||||||
|
# DarkIT v2.0
|
||||||
|
|
||||||
|
DarkIT is a high-performance large language model designed for **advanced programming, reasoning, and natural conversation**.
|
||||||
|
|
||||||
|
is optimized to deliver strong results in:
|
||||||
|
- Code generation and debugging
|
||||||
|
- Logical reasoning & problem solving
|
||||||
|
- Instruction following in complex tasks
|
||||||
|
- No request is refused
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Key Specifications
|
||||||
|
|
||||||
|
- **Model Family:** DarkIT Coder
|
||||||
|
- **Model Size:** 15B parameters (optimized inference build)
|
||||||
|
- **Context Length:** 256K tokens
|
||||||
|
- **Format:** GGUF (quantized for efficient local deployment)
|
||||||
|
- **Target Use:** Local AI inference (CPU & RAM / GPU)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Performance Notes
|
||||||
|
|
||||||
|
- Optimized for speed and memory efficiency
|
||||||
|
- Stable output generation across long prompts
|
||||||
|
- Strong balance between creativity and correctness
|
||||||
|
- Suitable for both chat and developer workflows
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## ⚠️ Notes
|
||||||
|
|
||||||
|
- Designed for inference-only deployment
|
||||||
|
- Performance may vary depending on hardware and quantization level
|
||||||
|
- Best results with structured prompts
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
**DarkAI** is an independent AI research initiative focused on building efficient, powerful, and scalable language models for real-world applications.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
- **Company Website:** [DarkAI](https://darkai.site)
|
||||||
|
- **Owner:** [DARK on Telegram](https://t.me/sii_3)
|
||||||
3
config.json
Normal file
3
config.json
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
{
|
||||||
|
"architectures": ["darkit-2.0"]
|
||||||
|
}
|
||||||
93
notebook.ipynb
Normal file
93
notebook.ipynb
Normal file
@@ -0,0 +1,93 @@
|
|||||||
|
{
|
||||||
|
"cells": [
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": [
|
||||||
|
"!pip install llama-cpp-python huggingface_hub --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu124\n"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": [
|
||||||
|
"from huggingface_hub import HfApi\n",
|
||||||
|
"from llama_cpp import Llama\n",
|
||||||
|
"import os\n",
|
||||||
|
"\n",
|
||||||
|
"REPO_ID = \"darkai-1/darkit-v2.0\"\n",
|
||||||
|
"api = HfApi()\n",
|
||||||
|
"\n",
|
||||||
|
"files = api.list_repo_files(REPO_ID)\n",
|
||||||
|
"gguf_files = [f for f in files if f.endswith(\".gguf\")]\n",
|
||||||
|
"\n",
|
||||||
|
"for i, f in enumerate(gguf_files):\n",
|
||||||
|
" print(f\"[{i}] {f}\")\n",
|
||||||
|
"\n",
|
||||||
|
"choice = int(input(\"Select model number: \"))\n",
|
||||||
|
"filename = gguf_files[choice]\n",
|
||||||
|
"\n",
|
||||||
|
"llm = Llama.from_pretrained(\n",
|
||||||
|
" repo_id=REPO_ID,\n",
|
||||||
|
" filename=filename,\n",
|
||||||
|
" n_ctx=2048,\n",
|
||||||
|
" n_batch=128,\n",
|
||||||
|
" n_ubatch=128,\n",
|
||||||
|
" n_threads=os.cpu_count() or 4,\n",
|
||||||
|
" n_threads_batch=os.cpu_count() or 4,\n",
|
||||||
|
" n_gpu_layers=-1,\n",
|
||||||
|
" verbose=False,\n",
|
||||||
|
" no_perf=True,\n",
|
||||||
|
")\n"
|
||||||
|
]
|
||||||
|
},
|
||||||
|
{
|
||||||
|
"cell_type": "code",
|
||||||
|
"execution_count": null,
|
||||||
|
"metadata": {},
|
||||||
|
"outputs": [],
|
||||||
|
"source": [
|
||||||
|
"llm.set_cache(None)\n",
|
||||||
|
"\n",
|
||||||
|
"PROMPT = \"Hi how are you?\"\n",
|
||||||
|
"\n",
|
||||||
|
"stream = llm(\n",
|
||||||
|
" f\"<|im_start|>user\\n{PROMPT}<|im_end|>\\n<|im_start|>assistant\\n\",\n",
|
||||||
|
" max_tokens=128,\n",
|
||||||
|
" temperature=0.7,\n",
|
||||||
|
" top_p=0.8,\n",
|
||||||
|
" top_k=20,\n",
|
||||||
|
" stream=True,\n",
|
||||||
|
" stop=[\n",
|
||||||
|
" \"<|im_end|>\",\n",
|
||||||
|
" \"<|im_start|>\",\n",
|
||||||
|
" \"\\n\\nUser:\",\n",
|
||||||
|
" \"\\n\\nAssistant:\"\n",
|
||||||
|
" ],\n",
|
||||||
|
" echo=False\n",
|
||||||
|
")\n",
|
||||||
|
"\n",
|
||||||
|
"for chunk in stream:\n",
|
||||||
|
" text = chunk[\"choices\"][0][\"text\"]\n",
|
||||||
|
"\n",
|
||||||
|
" if text:\n",
|
||||||
|
" print(text, end=\"\", flush=True)\n",
|
||||||
|
"\n",
|
||||||
|
"print()\n"
|
||||||
|
]
|
||||||
|
}
|
||||||
|
],
|
||||||
|
"metadata": {
|
||||||
|
"kernelspec": {
|
||||||
|
"display_name": "Python 3",
|
||||||
|
"language": "python",
|
||||||
|
"name": "python3"
|
||||||
|
}
|
||||||
|
},
|
||||||
|
"nbformat": 4,
|
||||||
|
"nbformat_minor": 0
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user