225 lines
5.9 KiB
Markdown
225 lines
5.9 KiB
Markdown
|
---
|
|||
|
|
library_name: transformers
|
|||
|
|
tags:
|
|||
|
|
- emotional-ai
|
|||
|
|
- ICONN
|
|||
|
|
- chatbot
|
|||
|
|
- base
|
|||
|
|
co2_eq_emissions:
|
|||
|
|
emissions: 0.34
|
|||
|
|
source: CodeCarbon
|
|||
|
|
training_type: pretraining
|
|||
|
|
geographical_location: US-West
|
|||
|
|
hardware_used: 9 x B200
|
|||
|
|
pipeline_tag: text-generation
|
|||
|
|
license: apache-2.0
|
|||
|
|
---
|
|||
|
|
<div align="center" style="line-height: 1;">
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
<a href="https://huggingface.co/collections/ICONNAI/iconn-1-6851e8a88ed4eb66b4fd0132" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="ICONN 1 Models" src="https://img.shields.io/badge/📦_ICONN_1_Models-HuggingFace-1CBEEF?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://huggingface.co/spaces/ICONNAI/ICONN-Mini-Chat" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="ICONN 1 Chat" src="https://img.shields.io/badge/💬_ICONN_1_Chat-Online-65C7F9?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://huggingface.co/ICONNAI" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="ICONN on Hugging Face" src="https://img.shields.io/badge/🤗_ICONN_on_HF-ICONNAI-A4BCF0?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://opensource.org/license/apache-2-0" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="License Apache 2.0" src="https://img.shields.io/badge/⚖️_License-Apache_2.0-5C63DA?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://github.com/organizations/ICONN-AI/" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="ICONN on GitHub" src="https://img.shields.io/badge/🐙_ICONN_on_GitHub-ICONN--AI-8C8CFF?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://huggingface.co/ICONNAI" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="Follow ICONNAI" src="https://img.shields.io/badge/⭐_Follow_ICONNAI-HuggingFace-A4BCF0?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
<a href="https://huggingface.co/spaces/huggingface/InferenceSupport/discussions/2932" target="_blank" style="margin: 2px;">
|
|||
|
|
<img alt="React to Vote" src="https://img.shields.io/badge/🗳️_Vote_for_us_as_Inference_Provider-React_👍-1CBEEF?style=flat-square&labelColor=2C3E50" style="display: inline-block; vertical-align: middle;" />
|
|||
|
|
</a>
|
|||
|
|
|
|||
|
|
</div>
|
|||
|
|
|
|||
|
|
## ICONN 1
|
|||
|
|
Introducing **ICONN 1 Mini Beta**, a cutting-edge open-source AI model with just **7 billion parameters** — designed for natural, human-like language understanding and generation. Despite its compact size, it delivers powerful performance through efficient architecture and careful tuning. ICONN 1 Mini Beta represents the next step in accessible, conversational AI.
|
|||
|
|
|
|||
|
|
Developed entirely from scratch, ICONN-1-Mini-Beta is based on a new **ICONN** framework and comprises **7 billion parameters**.
|
|||
|
|
|
|||
|
|
ICONN-1 is released in three distinct forms to serve different application needs:
|
|||
|
|
- **ICONN-1-Mini-Beta**(This model) is a small 7B model trained for a lightweight alternative to ICONN 1.
|
|||
|
|
- **ICONN-1** is optimized for natural, emotionally resonant, and conversational interactions.
|
|||
|
|
- **ICONN-e1** is a specialized variant of the model fine-tuned for advanced reasoning, critical analysis, and complex problem-solving.
|
|||
|
|
|
|||
|
|
Together, these models represent a major leap forward in the evolution of AI systems—demonstrating not only deep reasoning but also a commitment to openness, accessibility, and human-aligned intelligence.
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
## Usage
|
|||
|
|
|
|||
|
|
To run **ICONN 1 Mini Beta**, you need:
|
|||
|
|
|
|||
|
|
- **Any hardware - CPU or GPU; Just make sure you have about 15GB storage space!**
|
|||
|
|
|
|||
|
|
> Run the code below to run ICONN 1 Mini Beta:
|
|||
|
|
|
|||
|
|
```python
|
|||
|
|
import os
|
|||
|
|
|
|||
|
|
import torch
|
|||
|
|
|
|||
|
|
from transformers import AutoModelForCausalLM, AutoTokenizer, TextIteratorStreamer
|
|||
|
|
|
|||
|
|
from threading import Thread
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
model_id = "ICONNAI/ICONN-1-Mini-Beta"
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
try:
|
|||
|
|
|
|||
|
|
model = AutoModelForCausalLM.from_pretrained(
|
|||
|
|
|
|||
|
|
model_id, torch_dtype=torch.float16, device_map="auto", trust_remote_code=True
|
|||
|
|
|
|||
|
|
)
|
|||
|
|
|
|||
|
|
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
|||
|
|
|
|||
|
|
except Exception as e:
|
|||
|
|
|
|||
|
|
exit(f"Exiting due to model loading error: {e}")
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
def generate_response(
|
|||
|
|
|
|||
|
|
message: str,
|
|||
|
|
|
|||
|
|
max_new_tokens: int = 2048,
|
|||
|
|
|
|||
|
|
temperature: float = 0.4,
|
|||
|
|
|
|||
|
|
top_p: float = 0.9,
|
|||
|
|
|
|||
|
|
top_k: int = 50,
|
|||
|
|
|
|||
|
|
repetition_penalty: float = 1.2,
|
|||
|
|
|
|||
|
|
) -> str:
|
|||
|
|
|
|||
|
|
conversation = [{"role": "user", "content": message}]
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
try:
|
|||
|
|
|
|||
|
|
input_ids = tokenizer.apply_chat_template(
|
|||
|
|
|
|||
|
|
conversation, return_tensors="pt", enable_thinking=True
|
|||
|
|
|
|||
|
|
)
|
|||
|
|
|
|||
|
|
except Exception as e:
|
|||
|
|
|
|||
|
|
return f"Error applying chat template: {e}"
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
input_ids = input_ids.to(model.device)
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
streamer = TextIteratorStreamer(tokenizer, timeout=20.0, skip_prompt=True, skip_special_tokens=True)
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
adjusted_top_k = int(max(1, top_k))
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
generate_kwargs = dict(
|
|||
|
|
|
|||
|
|
{"input_ids": input_ids},
|
|||
|
|
|
|||
|
|
streamer=streamer,
|
|||
|
|
|
|||
|
|
max_new_tokens=max_new_tokens,
|
|||
|
|
|
|||
|
|
do_sample=True,
|
|||
|
|
|
|||
|
|
top_p=top_p,
|
|||
|
|
|
|||
|
|
top_k=adjusted_top_k,
|
|||
|
|
|
|||
|
|
temperature=temperature,
|
|||
|
|
|
|||
|
|
num_beams=1,
|
|||
|
|
|
|||
|
|
repetition_penalty=repetition_penalty,
|
|||
|
|
|
|||
|
|
)
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
try:
|
|||
|
|
|
|||
|
|
t = Thread(target=model.generate, kwargs=generate_kwargs)
|
|||
|
|
|
|||
|
|
t.start()
|
|||
|
|
|
|||
|
|
except Exception as e:
|
|||
|
|
|
|||
|
|
return f"Error starting generation thread: {e}"
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
outputs = []
|
|||
|
|
|
|||
|
|
for text in streamer:
|
|||
|
|
|
|||
|
|
outputs.append(text)
|
|||
|
|
|
|||
|
|
return "".join(outputs)
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
if __name__ == "__main__":
|
|||
|
|
|
|||
|
|
question = "Can you explain briefly to me what is the Python programming language?"
|
|||
|
|
|
|||
|
|
print(f"User Question: {question}")
|
|||
|
|
|
|||
|
|
|
|||
|
|
|
|||
|
|
response = generate_response(question)
|
|||
|
|
|
|||
|
|
print(f"Bot Response: {response}")
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## Cite Us
|
|||
|
|
|
|||
|
|
**If you use ICONN 1, please cite us as follows:**
|
|||
|
|
|
|||
|
|
```DoI
|
|||
|
|
|
|||
|
|
@misc{iconnai_2025,
|
|||
|
|
author = { ICONNAI },
|
|||
|
|
title = { ICONN-1-Mini-Beta (Revision e29b435) },
|
|||
|
|
year = 2025,
|
|||
|
|
url = { https://huggingface.co/ICONNAI/ICONN-1-Mini-Beta },
|
|||
|
|
doi = { 10.57967/hf/5860 },
|
|||
|
|
publisher = { Hugging Face }
|
|||
|
|
}
|
|||
|
|
|
|||
|
|
```
|