初始化项目,由ModelHub XC社区提供模型
Model: darkai-1/darkit-v2.0 Source: Original Platform
This commit is contained in:
3
Q4_K_M.gguf
Normal file
3
Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c7553f99f3b4b2e229ff7dc64a6cd0ebb654cd4f2b0b0d302792a41e426e4d8a
|
||||
size 9001752960
|
||||
3
Q5_K_M.gguf
Normal file
3
Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b2719f392c4c2d97ef707eda627faf0529a01591d68d75178aa75ee5bdb6359d
|
||||
size 10514569600
|
||||
3
Q8_0.gguf
Normal file
3
Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6cf59588d66fee143619965c818e5b8e3bf80514494db28d9f97893815bc9248
|
||||
size 15698533760
|
||||
62
README.md
Normal file
62
README.md
Normal file
@@ -0,0 +1,62 @@
|
||||
---
|
||||
language: multilingual
|
||||
license: apache-2.0
|
||||
organization: darkai
|
||||
author: darkai
|
||||
library_name: llama.cpp
|
||||
tags:
|
||||
- darkit-2.0
|
||||
- DarkAI Company
|
||||
- text-generation
|
||||
- programming
|
||||
- reasoning
|
||||
base_model: darkai/darkit-v2.0
|
||||
model_type: custom
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# DarkIT v2.0
|
||||
|
||||
DarkIT is a high-performance large language model designed for **advanced programming, reasoning, and natural conversation**.
|
||||
|
||||
is optimized to deliver strong results in:
|
||||
- Code generation and debugging
|
||||
- Logical reasoning & problem solving
|
||||
- Instruction following in complex tasks
|
||||
- No request is refused
|
||||
|
||||
---
|
||||
|
||||
## Key Specifications
|
||||
|
||||
- **Model Family:** DarkIT Coder
|
||||
- **Model Size:** 15B parameters (optimized inference build)
|
||||
- **Context Length:** 256K tokens
|
||||
- **Format:** GGUF (quantized for efficient local deployment)
|
||||
- **Target Use:** Local AI inference (CPU & RAM / GPU)
|
||||
|
||||
---
|
||||
|
||||
## Performance Notes
|
||||
|
||||
- Optimized for speed and memory efficiency
|
||||
- Stable output generation across long prompts
|
||||
- Strong balance between creativity and correctness
|
||||
- Suitable for both chat and developer workflows
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ Notes
|
||||
|
||||
- Designed for inference-only deployment
|
||||
- Performance may vary depending on hardware and quantization level
|
||||
- Best results with structured prompts
|
||||
|
||||
---
|
||||
|
||||
**DarkAI** is an independent AI research initiative focused on building efficient, powerful, and scalable language models for real-world applications.
|
||||
|
||||
---
|
||||
|
||||
- **Company Website:** [DarkAI](https://darkai.site)
|
||||
- **Owner:** [DARK on Telegram](https://t.me/sii_3)
|
||||
3
config.json
Normal file
3
config.json
Normal file
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"architectures": ["darkit-2.0"]
|
||||
}
|
||||
93
notebook.ipynb
Normal file
93
notebook.ipynb
Normal file
@@ -0,0 +1,93 @@
|
||||
{
|
||||
"cells": [
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"!pip install llama-cpp-python huggingface_hub --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu124\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"from huggingface_hub import HfApi\n",
|
||||
"from llama_cpp import Llama\n",
|
||||
"import os\n",
|
||||
"\n",
|
||||
"REPO_ID = \"darkai-1/darkit-v2.0\"\n",
|
||||
"api = HfApi()\n",
|
||||
"\n",
|
||||
"files = api.list_repo_files(REPO_ID)\n",
|
||||
"gguf_files = [f for f in files if f.endswith(\".gguf\")]\n",
|
||||
"\n",
|
||||
"for i, f in enumerate(gguf_files):\n",
|
||||
" print(f\"[{i}] {f}\")\n",
|
||||
"\n",
|
||||
"choice = int(input(\"Select model number: \"))\n",
|
||||
"filename = gguf_files[choice]\n",
|
||||
"\n",
|
||||
"llm = Llama.from_pretrained(\n",
|
||||
" repo_id=REPO_ID,\n",
|
||||
" filename=filename,\n",
|
||||
" n_ctx=2048,\n",
|
||||
" n_batch=128,\n",
|
||||
" n_ubatch=128,\n",
|
||||
" n_threads=os.cpu_count() or 4,\n",
|
||||
" n_threads_batch=os.cpu_count() or 4,\n",
|
||||
" n_gpu_layers=-1,\n",
|
||||
" verbose=False,\n",
|
||||
" no_perf=True,\n",
|
||||
")\n"
|
||||
]
|
||||
},
|
||||
{
|
||||
"cell_type": "code",
|
||||
"execution_count": null,
|
||||
"metadata": {},
|
||||
"outputs": [],
|
||||
"source": [
|
||||
"llm.set_cache(None)\n",
|
||||
"\n",
|
||||
"PROMPT = \"Hi how are you?\"\n",
|
||||
"\n",
|
||||
"stream = llm(\n",
|
||||
" f\"<|im_start|>user\\n{PROMPT}<|im_end|>\\n<|im_start|>assistant\\n\",\n",
|
||||
" max_tokens=128,\n",
|
||||
" temperature=0.7,\n",
|
||||
" top_p=0.8,\n",
|
||||
" top_k=20,\n",
|
||||
" stream=True,\n",
|
||||
" stop=[\n",
|
||||
" \"<|im_end|>\",\n",
|
||||
" \"<|im_start|>\",\n",
|
||||
" \"\\n\\nUser:\",\n",
|
||||
" \"\\n\\nAssistant:\"\n",
|
||||
" ],\n",
|
||||
" echo=False\n",
|
||||
")\n",
|
||||
"\n",
|
||||
"for chunk in stream:\n",
|
||||
" text = chunk[\"choices\"][0][\"text\"]\n",
|
||||
"\n",
|
||||
" if text:\n",
|
||||
" print(text, end=\"\", flush=True)\n",
|
||||
"\n",
|
||||
"print()\n"
|
||||
]
|
||||
}
|
||||
],
|
||||
"metadata": {
|
||||
"kernelspec": {
|
||||
"display_name": "Python 3",
|
||||
"language": "python",
|
||||
"name": "python3"
|
||||
}
|
||||
},
|
||||
"nbformat": 4,
|
||||
"nbformat_minor": 0
|
||||
}
|
||||
Reference in New Issue
Block a user