初始化项目,由ModelHub XC社区提供模型
Model: mlfoundations/tabula-8b Source: Original Platform
This commit is contained in:
37
README.md
Normal file
37
README.md
Normal file
@@ -0,0 +1,37 @@
|
||||
---
|
||||
license: llama3
|
||||
datasets:
|
||||
- jpgard/t4-full
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
This repository contains the TabuLa-8B (Tabular Llama-8B) model.
|
||||
TabuLa-8B is a foundation model for prediction (classification and binned regression) on tabular data.
|
||||
|
||||
TabuLa-8B is described in the paper ["Large Scale Transfer Learning for Tabular Data via Language Modeling."](https://arxiv.org/abs/2406.12031)
|
||||
|
||||
For more details on the model, see the paper, which includes a Model Card detailing the model architecture, training, and evaluation.
|
||||
TabuLa-8B was trained with [rtfm](https://github.com/mlfoundations/rtfm),
|
||||
using the [T4 dataset](https://huggingface.co/datasets/mlfoundations/t4-full).
|
||||
|
||||
TabuLa-8B is built with Meta Llama 3.
|
||||
|
||||
# Usage and Examples
|
||||
|
||||
You can load the model with `transformers` via
|
||||
```
|
||||
from transformers import AutoTokenizer, AutoModelForCausalLM
|
||||
|
||||
tokenizer = AutoTokenizer.from_pretrained("mlfoundations/tabula-8b")
|
||||
model = AutoModelForCausalLM.from_pretrained("mlfoundations/tabula-8b")
|
||||
```
|
||||
|
||||
For more information on how to prepare data and run inference (including a demo notebook for performing inference on your data), see the examples in [rtfm](https://github.com/mlfoundations/rtfm).
|
||||
|
||||
# License and Terms of Use
|
||||
|
||||
TabuLa-8B is fine-tuned from the Llama-3 8B model.
|
||||
As a result, we release it under the [Llama 3 license](https://llama.meta.com/llama3/license/),
|
||||
and by using the model you agree to abide by the [Llama 3 Community License Agreement](https://llama.meta.com/llama3/license/)
|
||||
and the Llama 3 [Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
|
||||
Reference in New Issue
Block a user