commit e79044bb1fb76c03e0755b3a1b63111a7cfe1ccf Author: ModelHub XC Date: Wed Jun 17 14:10:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: praneethposina/customer_support_bot Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b91ffab --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +unsloth.F16.gguf filter=lfs diff=lfs merge=lfs -text +unsloth.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +unsloth.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +unsloth.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..f817d13 --- /dev/null +++ b/README.md @@ -0,0 +1,84 @@ +--- +license: apache-2.0 +datasets: +- bitext/Bitext-customer-support-llm-chatbot-training-dataset +language: +- en +base_model: +- unsloth/llama-3-8b-bnb-4bit +pipeline_tag: text-generation +tags: +- text-generation-inference +- transformers +- unsloth +- llama +- gguf +- Customer-Support-Bot +--- +# Customer Support Chatbot with LLaMA 3.1 + +> An end-to-end customer support chatbot solution powered by fine-tuned LLaMA 3.1 8B model, deployed using Flask, Docker, and AWS ECS. + +## Overview + +This project implements a sophisticated customer support chatbot leveraging the LLaMA 3.1 8B model fine-tuned on customer support conversations. The solution uses LoRA fine-tuning and various quantization techniques for optimized inference, deployed as a containerized application on AWS ECS with Fargate. + +## Features + +- **Fine-tuned LLaMA 3.1 Model**: Customized for customer support using the [Bitext customer support dataset](https://huggingface.co/datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset) +- **Optimized Inference**: Implements 4-bit, 8-bit, and 16-bit quantization +- **Containerized Deployment**: Docker-based deployment for consistency and scalability +- **Cloud Infrastructure**: Hosted on AWS ECS with Fargate for serverless container management +- **CI/CD Pipeline**: Automated deployment using AWS CodePipeline +- **Monitoring**: Comprehensive logging and monitoring via AWS CloudWatch + +## Model Details + +The fine-tuned model is hosted on Hugging Face: +- Model Repository: [praneethposina/customer_support_bot](https://huggingface.co/praneethposina/customer_support_bot) +- Github Repository: [github.com/praneethposina/Customer_Support_Chatbot](https://github.com/praneethposina/Customer_Support_Chatbot) +- Base Model: LLaMA 3.1 8B +- Training Dataset: Bitext Customer Support Dataset +- Optimization: LoRA fine-tuning with quantization + +## Tech Stack + +- **Backend**: Flask API +- **Model Serving**: Ollama +- **Containerization**: Docker +- **Cloud Services**: + - AWS ECS (Fargate) + - AWS CodePipeline + - AWS CloudWatch +- **Model Training**: LoRA, Quantization + +## Screenshots + +### Chatbot Interface + +![Chatbot SS](https://github.com/user-attachments/assets/220aea77-bb2b-4f50-b6a4-0541434d85ef) + +![Chatbot SS2](https://github.com/user-attachments/assets/da440735-59d7-4be7-a43d-d51de8983738) + +### AWS CloudWatch Monitoring + +![CloudWatch SS](https://github.com/user-attachments/assets/9794bc3e-4b9c-4626-9a7f-3936d4757328) + +### Docker Logs + +Docker ss +Docker ss2 + +## AWS Deployment + +1. Push Docker image to Amazon ECR +2. Configure AWS ECS Task Definition +3. Set up AWS CodePipeline for CI/CD +4. Configure CloudWatch monitoring + + +# Uploaded model + +- **Developed by:** praneethposina +- **License:** apache-2.0 +- **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000..a4ba21b --- /dev/null +++ b/config.json @@ -0,0 +1,3 @@ +{ + "model_type": "llama" +} \ No newline at end of file diff --git a/unsloth.F16.gguf b/unsloth.F16.gguf new file mode 100644 index 0000000..4659fe3 --- /dev/null +++ b/unsloth.F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:659ae07d470f88e07b07f6b876bc516354065525f12932cff5d4bad627afdfe1 +size 16068891328 diff --git a/unsloth.Q4_K_M.gguf b/unsloth.Q4_K_M.gguf new file mode 100644 index 0000000..8f26ac6 --- /dev/null +++ b/unsloth.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4cf8c073eb2c69a318f874ffea8879351315238619a2ebea14d6999da2a1f71f +size 4920734400 diff --git a/unsloth.Q5_K_M.gguf b/unsloth.Q5_K_M.gguf new file mode 100644 index 0000000..b71e164 --- /dev/null +++ b/unsloth.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:734c8043e4cee8c9f063bb1102b80474277743d29738eec6daa7d856883a12f5 +size 5732987584 diff --git a/unsloth.Q8_0.gguf b/unsloth.Q8_0.gguf new file mode 100644 index 0000000..2befd56 --- /dev/null +++ b/unsloth.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c5c50400326535014bbe0f861e8304ca355abb626c33508d6988703beedf06c +size 8540771008