--- library_name: transformers pipeline_tag: text-generation language: - en license: other license_name: appvoid-noncommercial-model-license-1.0 license_link: LICENSE tags: - palmer - text-editing - rewriting - paraphrasing - grammar-correction - edge - small-language-model widget: - text: Make this more concise. output: url: images/4.png - text: Make this friendlier. output: url: images/1.png - text: Improve clarity without changing the meaning. output: url: images/2.png - text: Improve clarity without changing the meaning. output: url: images/3.png extra_gated_prompt: >- You agree to use this model in good faith, respect the LICENSE in this repository, comply with the applicable Falcon upstream terms, and not use the model to harm any person or group. Commercial use requires a separate license. new_version: appvoid/palmer-007 ---
Palmer 006 logo
# a small model is all you need We celebrate three years of experiments with the release of `palmer-006`, our flagship and extremely small language model for local experimentation, edge hardware, small SBCs, and low-power devices. Note that this model serves primarily as a language model and has not been validated nor finetuned as a general-purpose chat assistant. Thus further finetuning is required to properly work as an instruction-tuned model. ## updates - [πŸ¦β€πŸ”₯ A wild palmer appeared, go catch it!](https://huggingface.co/CEAMFA/palmer-007-preview-GGUF) - No longer promoting arithmark, after doing proper evals, palmer-006 is barely better than the base model used to train. Model is [#5 on open slm leaderboard](https://huggingface.co/spaces/AxiomicLabs/Open_SLM_Leaderboard) - Second spot on [BananaMindBench Leaderboard](https://huggingface.co/spaces/BananaMind/BananaMindBench-Leaderboard)!!πŸŽ‰πŸŽ‰ ## ● details Palmer 006 benchmark comparison We first lightly fine-tuned the base model on a diverse set of highly curated data points. We then β€œpalmerized” it by merging models, followed by another light fine-tuning round. Finally, we adjusted Mamba for maximum token speed. With only 90M parameters, this turned the model into a competitive baseline against models above 125M parameters. > As seen in the benchmark, we are getting closer to the performance of bigger models with our current technique, even on models of this size. Note: We used `acc_norm` whenever available. ## ● quick test You can load `model.gguf` model into a llama-server, then run the script inside this repo as follows: ```python python completion.py prompt.txt ``` ## ● license Open research, education, hobby use, modification, and redistribution are permitted. Commercial deployment, internal business use, paid products, hosted APIs, and client work require a separate commercial license from appvoid. For commercial licensing: [nosoyhackercodigo@gmail.com](mailto:nosoyhackercodigo@gmail.com) πŸ‘‹ But hey! If you already have a [donation subscription](https://ko-fi.com/appvoid), you can claim access to a free commercial license through the email above. You will keep the rights as long as the subscription is active. ## ● upstream attribution **palmer-006 is built using artificial intelligence technology from the Technology Innovation Institute.** ## ● fun facts - the new logo represents palmer's eye, pointing how small this new model is - palmer models still exists to some extent due to inspiration from Karpathy's idea of a self-contained "cognitive core". - we just like light finetuning because we prefer starting "real" experiments with the strongest baseline possible - [we have an org with early access checkpoints](https://huggingface.co/CEAMFA)