ysn-rfd/Refact-1_6B-fim-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Refact-1_6B-fim-GGUF/README.md
ModelHub XC 5fbd840a0d 初始化项目，由ModelHub XC社区提供模型 
Model: ysn-rfd/Refact-1_6B-fim-GGUF
Source: Original Platform
2026-04-22 21:49:10 +08:00

13 KiB
Raw Permalink Blame History

base_model, datasets, language, library_name, license, metrics, pipeline_tag, tags, inference, widget, pretrain-datasets, model-index
base_model datasets language library_name license metrics pipeline_tag tags inference widget pretrain-datasets model-index
smallcloudai/Refact-1_6B-fim
bigcode/the-stack-dedup
rombodawg/2XUNCENSORED_MegaCodeTraining188k
bigcode/commitpackft
en
transformers bigscience-openrail-m
code_eval
text-generation
code
llama-cpp
matrixportal
true
text example_title group
def print_hello_world(): Hello world Python
books
arxiv
c4
falcon-refinedweb
wiki
github-issues
stack_markdown
self-made dataset of permissive github code
name results
Refact-1.6B
task dataset metrics
type
text-generation
name type
HumanEval openai_humaneval
type value name verified
pass@1 32.0 pass@1 (T=0.01) false
type value name verified
pass@1 31.5 pass@1 (T=0.2) false
type value name verified
pass@10 53.0 pass@10 (T=0.8) false
type value name verified
pass@100 76.9 pass@100 (T=0.8) false
task dataset metrics
type
text-generation
name type
HumanEvalSynthesize Python bigcode/humanevalpack
type value name verified
pass@1 35.8 pass@1 (T=0.2) false
type value name verified
pass@1 31.6 pass@1 (T=0.2) false
type value name verified
pass@1 29.1 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 26.3 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 18.38 pass@1 (T=0.2) false
type value name verified
pass@1 12.28 pass@1 (T=0.2) false
type value name verified
pass@1 15.12 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 13.17 pass@1 (T=0.2) false
type value name verified
pass@1 2.8 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 26.92 pass@1 (T=0.2) false
type value name verified
pass@1 26.85 pass@1 (T=0.2) false
type value name verified
pass@1 30.76 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 25.94 pass@1 (T=0.2) false
type value name verified
pass@1 8.44 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 26.46 pass@1 (T=0.2) false
type value name verified
pass@1 17.86 pass@1 (T=0.2) false
type value name verified
pass@1 20.94 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 18.78 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
type value name verified
pass@1 -1 pass@1 (T=0.2) false
task dataset metrics
type
text-generation
name type
MBPP mbpp
type value name verified
pass@1 31.15 pass@1 (T=0.01) false
task dataset metrics
type
text-generation
name type
DS-1000 (Overall Completion) ds1000
type value name verified
pass@1 10.1 pass@1 (T=0.2) false
task dataset metrics
type
text-generation
name type
MultiPL-HumanEval (C++) nuprl/MultiPL-E
type value name verified
pass@1 21.61 pass@1 (T=0.2) false
type value name verified
pass@1 13.91 pass@1 (T=0.2) false
type value name verified
pass@1 9.5 pass@1 (T=0.2) false
type value name verified
pass@1 53.57 pass@1 (T=0.2) false
type value name verified
pass@1 21.58 pass@1 (T=0.2) false
type value name verified
pass@1 13.75 pass@1 (T=0.2) false
type value name verified
pass@1 26.88 pass@1 (T=0.2) false
type value name verified
pass@1 15.26 pass@1 (T=0.2) false
type value name verified
pass@1 23.04 pass@1 (T=0.2) false
type value name verified
pass@1 12.1 pass@1 (T=0.2) false
type value name verified
pass@1 29.6 pass@1 (T=0.2) false
type value name verified
pass@1 13.77 pass@1 (T=0.2) false
type value name verified
pass@1 12.68 pass@1 (T=0.2) false
type value name verified
pass@1 4.29 pass@1 (T=0.2) false
type value name verified
pass@1 19.54 pass@1 (T=0.2) false
type value name verified
pass@1 18.33 pass@1 (T=0.2) false
type value name verified
pass@1 5.7 pass@1 (T=0.2) false
type value name verified
pass@1 17.68 pass@1 (T=0.2) false
type value name verified
pass@1 25 pass@1 (T=0.2) false

ysn-rfd/Refact-1_6B-fim-GGUF

This model was converted to GGUF format from smallcloudai/Refact-1_6B-fim using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.

✅ Quantized Models Download List

🔍 Recommended Quantizations

  • ✨ General CPU Use: Q4_K_M (Best balance of speed/quality)
  • 📱 ARM Devices: Q4_0 (Optimized for ARM CPUs)
  • 🏆 Maximum Quality: Q8_0 (Near-original quality)

📦 Full Quantization Options

🚀 Download 🔢 Type 📝 Notes
Download Q2_K Basic quantization
Download Q3_K_S Small size
Download Q3_K_M Balanced quality
Download Q3_K_L Better quality
Download Q4_0 Fast on ARM
Download Q4_K_S Fast, recommended
Download Q4_K_M ⭐ Best balance
Download Q5_0 Good quality
Download Q5_K_S Balanced
Download Q5_K_M High quality
Download Q6_K 🏆 Very good quality
Download Q8_0 ⚡ Fast, best quality
Download F16 Maximum accuracy

💡 Tip: Use F16 for maximum precision when quality is critical

🚀 Applications and Tools for Locally Quantized LLMs

🖥️ Desktop Applications

Application Description Download Link
Llama.cpp A fast and efficient inference engine for GGUF models. GitHub Repository
Ollama A streamlined solution for running LLMs locally. Website
AnythingLLM An AI-powered knowledge management tool. GitHub Repository
Open WebUI A user-friendly web interface for running local LLMs. GitHub Repository
GPT4All A user-friendly desktop application supporting various LLMs, compatible with GGUF models. GitHub Repository
LM Studio A desktop application designed to run and manage local LLMs, supporting GGUF format. Website
GPT4All Chat A chat application compatible with GGUF models for local, offline interactions. GitHub Repository

📱 Mobile Applications

Application Description Download Link
ChatterUI A simple and lightweight LLM app for mobile devices. GitHub Repository
Maid Mobile Artificial Intelligence Distribution for running AI models on mobile devices. GitHub Repository
PocketPal AI A mobile AI assistant powered by local models. GitHub Repository
Layla A flexible platform for running various AI models on mobile devices. Website

🎨 Image Generation Applications

Application Description Download Link
Stable Diffusion An open-source AI model for generating images from text. GitHub Repository
Stable Diffusion WebUI A web application providing access to Stable Diffusion models via a browser interface. GitHub Repository
Local Dream Android Stable Diffusion with Snapdragon NPU acceleration. Also supports CPU inference. GitHub Repository
Stable-Diffusion-Android (SDAI) An open-source AI art application for Android devices, enabling digital art creation. GitHub Repository