初始化项目，由ModelHub XC社区提供模型

Model: praneethposina/customer_support_bot
Source: Original Platform

.gitattributes

@@ -0,0 +1,39 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+unsloth.F16.gguf filter=lfs diff=lfs merge=lfs -text
+unsloth.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+unsloth.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+unsloth.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,84 @@
+---
+license: apache-2.0
+datasets:
+- bitext/Bitext-customer-support-llm-chatbot-training-dataset
+language:
+- en
+base_model:
+- unsloth/llama-3-8b-bnb-4bit
+pipeline_tag: text-generation
+tags:
+- text-generation-inference
+- transformers
+- unsloth
+- llama
+- gguf
+- Customer-Support-Bot
+---
+# Customer Support Chatbot with LLaMA 3.1
+
+> An end-to-end customer support chatbot solution powered by fine-tuned LLaMA 3.1 8B model, deployed using Flask, Docker, and AWS ECS.
+
+## Overview
+
+This project implements a sophisticated customer support chatbot leveraging the LLaMA 3.1 8B model fine-tuned on customer support conversations. The solution uses LoRA fine-tuning and various quantization techniques for optimized inference, deployed as a containerized application on AWS ECS with Fargate.
+
+## Features
+
+- **Fine-tuned LLaMA 3.1 Model**: Customized for customer support using the [Bitext customer support dataset](https://huggingface.co/datasets/bitext/Bitext-customer-support-llm-chatbot-training-dataset)
+- **Optimized Inference**: Implements 4-bit, 8-bit, and 16-bit quantization
+- **Containerized Deployment**: Docker-based deployment for consistency and scalability
+- **Cloud Infrastructure**: Hosted on AWS ECS with Fargate for serverless container management
+- **CI/CD Pipeline**: Automated deployment using AWS CodePipeline
+- **Monitoring**: Comprehensive logging and monitoring via AWS CloudWatch
+
+## Model Details
+
+The fine-tuned model is hosted on Hugging Face:
+- Model Repository: [praneethposina/customer_support_bot](https://huggingface.co/praneethposina/customer_support_bot)
+- Github Repository: [github.com/praneethposina/Customer_Support_Chatbot](https://github.com/praneethposina/Customer_Support_Chatbot)
+- Base Model: LLaMA 3.1 8B
+- Training Dataset: Bitext Customer Support Dataset
+- Optimization: LoRA fine-tuning with quantization
+
+## Tech Stack
+
+- **Backend**: Flask API
+- **Model Serving**: Ollama
+- **Containerization**: Docker
+- **Cloud Services**: 
+  - AWS ECS (Fargate)
+  - AWS CodePipeline
+  - AWS CloudWatch
+- **Model Training**: LoRA, Quantization
+
+## Screenshots
+
+### Chatbot Interface
+
+![Chatbot SS](https://github.com/user-attachments/assets/220aea77-bb2b-4f50-b6a4-0541434d85ef)
+
+![Chatbot SS2](https://github.com/user-attachments/assets/da440735-59d7-4be7-a43d-d51de8983738)
+
+### AWS CloudWatch Monitoring
+
+![CloudWatch SS](https://github.com/user-attachments/assets/9794bc3e-4b9c-4626-9a7f-3936d4757328)
+
+### Docker Logs
+
+<img width="1270" alt="Docker ss" src="https://github.com/user-attachments/assets/a72d1c35-8203-4a05-b944-743ea6c0a6b8" />
+<img width="1268" alt="Docker ss2" src="https://github.com/user-attachments/assets/f1b0c0b1-2aad-462c-adf2-7a7ea9047a1a" />
+
+## AWS Deployment
+
+1. Push Docker image to Amazon ECR
+2. Configure AWS ECS Task Definition
+3. Set up AWS CodePipeline for CI/CD
+4. Configure CloudWatch monitoring
+
+
+# Uploaded  model
+
+- **Developed by:** praneethposina
+- **License:** apache-2.0
+- **Finetuned from model :** unsloth/llama-3-8b-bnb-4bit

config.json

@@ -0,0 +1,3 @@
+{
+    "model_type": "llama"
+}

unsloth.F16.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:659ae07d470f88e07b07f6b876bc516354065525f12932cff5d4bad627afdfe1
+size 16068891328

unsloth.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4cf8c073eb2c69a318f874ffea8879351315238619a2ebea14d6999da2a1f71f
+size 4920734400

unsloth.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:734c8043e4cee8c9f063bb1102b80474277743d29738eec6daa7d856883a12f5
+size 5732987584

unsloth.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c5c50400326535014bbe0f861e8304ca355abb626c33508d6988703beedf06c
+size 8540771008