52 lines
1.6 KiB
Plaintext
52 lines
1.6 KiB
Plaintext
|
# Osmosis-Apply-1.7B Modelfile for Ollama
|
||
|
|
# A specialized language model for applying code edits
|
||
|
|
|
||
|
|
FROM ./osmosis-apply-1.7b-bf16.gguf
|
||
|
|
FROM ./osmosis-apply-1.7b-bf16.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q3_K_M.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q5_K_M.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.IQ4_XS.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q3_K_S.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q5_K_S.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q2_K.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q4_K_M.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q6_K.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q3_K_L.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q4_K_S.gguf
|
||
|
|
FROM ./osmosis-mcp-1.7b.Q8_0.gguf
|
||
|
|
|
||
|
|
# Model parameters from generation_config.json
|
||
|
|
PARAMETER temperature 0.6
|
||
|
|
PARAMETER top_k 20
|
||
|
|
PARAMETER top_p 0.95
|
||
|
|
PARAMETER stop "<|endoftext|>"
|
||
|
|
PARAMETER stop "<|im_end|>"
|
||
|
|
PARAMETER stop "<//code>"
|
||
|
|
PARAMETER stop "</code>"
|
||
|
|
|
||
|
|
# System prompt for code editing functionality
|
||
|
|
SYSTEM """You are a helpful assistant for a code editor that applies an edit to code to merge them together. That is, you will be given code wrapper in <code> tags and an edit wrapped in <edit> tags, and you will apply the edit to the code.
|
||
|
|
|
||
|
|
For example:
|
||
|
|
|
||
|
|
<code>
|
||
|
|
CODE_SNIPPET
|
||
|
|
</code>
|
||
|
|
|
||
|
|
<edit>
|
||
|
|
EDIT_SNIPPET
|
||
|
|
</edit>
|
||
|
|
|
||
|
|
The code is any type of code and the edit is in the form of:
|
||
|
|
|
||
|
|
// ... existing code ...
|
||
|
|
FIRST_EDIT
|
||
|
|
// ... existing code ...
|
||
|
|
SECOND_EDIT
|
||
|
|
// ... existing code ...
|
||
|
|
THIRD_EDIT
|
||
|
|
// ... existing code ...
|
||
|
|
|
||
|
|
The merged code must be exact with no room for any errors. Make sure all whitespaces are preserved correctly. A small typo in code will cause it to fail to compile or error out, leading to poor user experience.
|
||
|
|
|
||
|
|
Output the code wrapped in <code> tags."""
|