diff --git a/.gitattributes b/.gitattributes index b7e9e3a..27f921d 100644 --- a/.gitattributes +++ b/.gitattributes @@ -1,37 +1,49 @@ *.7z filter=lfs diff=lfs merge=lfs -text *.arrow filter=lfs diff=lfs merge=lfs -text *.bin filter=lfs diff=lfs merge=lfs -text -*.bin.* filter=lfs diff=lfs merge=lfs -text *.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text *.ftz filter=lfs diff=lfs merge=lfs -text *.gz filter=lfs diff=lfs merge=lfs -text *.h5 filter=lfs diff=lfs merge=lfs -text *.joblib filter=lfs diff=lfs merge=lfs -text *.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text *.model filter=lfs diff=lfs merge=lfs -text *.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text *.onnx filter=lfs diff=lfs merge=lfs -text *.ot filter=lfs diff=lfs merge=lfs -text *.parquet filter=lfs diff=lfs merge=lfs -text *.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text *.pt filter=lfs diff=lfs merge=lfs -text *.pth filter=lfs diff=lfs merge=lfs -text *.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text *.tflite filter=lfs diff=lfs merge=lfs -text *.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text *.xz filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text -*.zstandard filter=lfs diff=lfs merge=lfs -text -*.tfevents* filter=lfs diff=lfs merge=lfs -text -*.db* filter=lfs diff=lfs merge=lfs -text -*.ark* filter=lfs diff=lfs merge=lfs -text -**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text -**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text -**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text -*.safetensors filter=lfs diff=lfs merge=lfs -text -*.ckpt filter=lfs diff=lfs merge=lfs -text -*.gguf* filter=lfs diff=lfs merge=lfs -text -*.ggml filter=lfs diff=lfs merge=lfs -text -*.llamafile* filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +llama-3-sqlcoder-8b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md index 79f5dc4..84ae3bf 100644 --- a/README.md +++ b/README.md @@ -1,47 +1,53 @@ --- -license: Apache License 2.0 - -#model-type: -##如 gpt、phi、llama、chatglm、baichuan 等 -#- gpt - -#domain: -##如 nlp、cv、audio、multi-modal -#- nlp - -#language: -##语言代码列表 https://help.aliyun.com/document_detail/215387.html?spm=a2c4g.11186623.0.0.9f8d7467kni6Aa -#- cn - -#metrics: -##如 CIDEr、Blue、ROUGE 等 -#- CIDEr - -#tags: -##各种自定义，包括 pretrained、fine-tuned、instruction-tuned、RL-tuned 等训练方法和其他 -#- pretrained - -#tools: -##如 vllm、fastchat、llamacpp、AdaSeq 等 -#- vllm +license: cc-by-sa-4.0 +metrics: +- accuracy +pipeline_tag: text-generation +tags: +- code +base_model: defog/llama-3-sqlcoder-8b --- -### 当前模型的贡献者未提供更加详细的模型介绍。模型文件和权重，可浏览“模型文件”页面获取。 -#### 您可以通过如下git clone命令，或者ModelScope SDK来下载模型 -SDK下载 -```bash -#安装ModelScope -pip install modelscope +# QuantFactory/llama-3-sqlcoder-8b-GGUF +This is quantized version of [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) created using llama.cpp + +## Model Description + +A capable language model for text to SQL generation for Postgres, Redshift and Snowflake that is on-par with the most capable generalist frontier models. + +![image/png](https://cdn-uploads.huggingface.co/production/uploads/603bbad3fd770a9997b57cb6/h52Z_OKYBaDDQMFZyU5pF.png) + + +Developed by: Defog, Inc +Model type: [Text to SQL] +License: [CC-by-SA-4.0] +Finetuned from model: [Meta-Llama-3-8B-Instruct] + +## Demo Page +[https://defog.ai/sqlcoder-demo/](https://defog.ai/sqlcoder-demo/) + +## Ideal prompt and inference parameters +Set temperature to 0, and do not do sampling. + +### Prompt ``` -```python -#SDK模型下载 -from modelscope import snapshot_download -model_dir = snapshot_download('QuantFactory/llama-3-sqlcoder-8b-GGUF') -``` -Git下载 -``` -#Git模型下载 -git clone https://www.modelscope.cn/QuantFactory/llama-3-sqlcoder-8b-GGUF.git +<|begin_of_text|><|start_header_id|>user<|end_header_id|> + +Generate a SQL query to answer this question: `{user_question}` +{instructions} + +DDL statements: +{create_table_statements}<|eot_id|><|start_header_id|>assistant<|end_header_id|> + +The following SQL query best answers the question `{user_question}`: +```sql + ``` -

如果您是本模型的贡献者，我们邀请您根据模型贡献文档，及时完善模型卡片内容。

\ No newline at end of file +## Evaluation +This model was evaluated on SQL-Eval, a PostgreSQL based evaluation framework developed by Defog for testing and alignment of model capabilities. + +You can read more about the methodology behind SQLEval [here](https://defog.ai/blog/open-sourcing-sqleval/). + +## Contact defog +Contact defog on X at [@defogdata](https://twitter.com/defogdata), or on email at founders@defog.ai \ No newline at end of file diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file diff --git a/llama-3-sqlcoder-8b.Q2_K.gguf b/llama-3-sqlcoder-8b.Q2_K.gguf new file mode 100644 index 0000000..dbed74a --- /dev/null +++ b/llama-3-sqlcoder-8b.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d1e04e628c53b8c10d5431da8701f3de55358ab1300c896f5763f70c0c26ccc6 +size 3179131136 diff --git a/llama-3-sqlcoder-8b.Q3_K_L.gguf b/llama-3-sqlcoder-8b.Q3_K_L.gguf new file mode 100644 index 0000000..733fd18 --- /dev/null +++ b/llama-3-sqlcoder-8b.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8cdf28c2965b9d3fceb72dafacc929c7e50f284bb0e6d4d0e923c6901425dafb +size 4321956096 diff --git a/llama-3-sqlcoder-8b.Q3_K_M.gguf b/llama-3-sqlcoder-8b.Q3_K_M.gguf new file mode 100644 index 0000000..35ac8ef --- /dev/null +++ b/llama-3-sqlcoder-8b.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56a8e94d9f346985a44c1f41f7f523243844076f269468388a6dd7adf30135a8 +size 4018917632 diff --git a/llama-3-sqlcoder-8b.Q3_K_S.gguf b/llama-3-sqlcoder-8b.Q3_K_S.gguf new file mode 100644 index 0000000..8f7c94f --- /dev/null +++ b/llama-3-sqlcoder-8b.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6a0dcbce65147272ad3f232fe6f11ccc46768578e91cb4520d19934d31138e4 +size 3664498944 diff --git a/llama-3-sqlcoder-8b.Q4_0.gguf b/llama-3-sqlcoder-8b.Q4_0.gguf new file mode 100644 index 0000000..0b11a41 --- /dev/null +++ b/llama-3-sqlcoder-8b.Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9168bcc13ddc3c2ad09a38a00e5cd994b8d2f0eb15d028bc75598564fc10f2c7 +size 4661211392 diff --git a/llama-3-sqlcoder-8b.Q4_1.gguf b/llama-3-sqlcoder-8b.Q4_1.gguf new file mode 100644 index 0000000..2c1758d --- /dev/null +++ b/llama-3-sqlcoder-8b.Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a4c947f5ed6138932e4c71f92adace8788239fbcc9d1522c27c9c16b44b4287c +size 5130252544 diff --git a/llama-3-sqlcoder-8b.Q4_K_M.gguf b/llama-3-sqlcoder-8b.Q4_K_M.gguf new file mode 100644 index 0000000..5fe5561 --- /dev/null +++ b/llama-3-sqlcoder-8b.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c05b22878eb9883de60d7aa5961793541d2b040fc07a3ba61456149351eb5b1 +size 4920733952 diff --git a/llama-3-sqlcoder-8b.Q4_K_S.gguf b/llama-3-sqlcoder-8b.Q4_K_S.gguf new file mode 100644 index 0000000..477391d --- /dev/null +++ b/llama-3-sqlcoder-8b.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cef399e029d87b9a81864a9757e5364ef362280ef1b83f7598b13179ef497208 +size 4692668672 diff --git a/llama-3-sqlcoder-8b.Q5_0.gguf b/llama-3-sqlcoder-8b.Q5_0.gguf new file mode 100644 index 0000000..8cdbebd --- /dev/null +++ b/llama-3-sqlcoder-8b.Q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:533911a5e28ce4243c8790d4a8b9656b2cd2729571c0b2fa390d244ae5909da0 +size 5599293696 diff --git a/llama-3-sqlcoder-8b.Q5_1.gguf b/llama-3-sqlcoder-8b.Q5_1.gguf new file mode 100644 index 0000000..32c0ec9 --- /dev/null +++ b/llama-3-sqlcoder-8b.Q5_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:553b9ef8601f057c683eb36662ed0b4b9fe9f1ad78f4ccbf153245862d8ca2f2 +size 6068334848 diff --git a/llama-3-sqlcoder-8b.Q5_K_M.gguf b/llama-3-sqlcoder-8b.Q5_K_M.gguf new file mode 100644 index 0000000..80492ed --- /dev/null +++ b/llama-3-sqlcoder-8b.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88b48e4c0c8c242aa0874f041cce6843e636b88b43b06ea019c656c296ee74c1 +size 5732987136 diff --git a/llama-3-sqlcoder-8b.Q5_K_S.gguf b/llama-3-sqlcoder-8b.Q5_K_S.gguf new file mode 100644 index 0000000..5bea55d --- /dev/null +++ b/llama-3-sqlcoder-8b.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e70b2273a342d4d9c2c4ffcbaf3353dbd4a5ac99e3c06432d476f7c13b2703d +size 5599293696 diff --git a/llama-3-sqlcoder-8b.Q6_K.gguf b/llama-3-sqlcoder-8b.Q6_K.gguf new file mode 100644 index 0000000..cc176a0 --- /dev/null +++ b/llama-3-sqlcoder-8b.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9df124950b9a760f34eae68d885ed41978ca7d329de4928e15e2a785032cc653 +size 6596006144 diff --git a/llama-3-sqlcoder-8b.Q8_0.gguf b/llama-3-sqlcoder-8b.Q8_0.gguf new file mode 100644 index 0000000..0a03c1c --- /dev/null +++ b/llama-3-sqlcoder-8b.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aadb13786ece5c551549234c691b193fa3fd06789d5f82201af2d59ed4dfa0b5 +size 8540770560