初始化项目，由ModelHub XC社区提供模型

Model: yibinlei/effir-mistral-drop-16-attn
Source: Original Platform

README.md

@@ -0,0 +1,42 @@
+---
+library_name: transformers
+base_model: mistralai/Mistral-7B-v0.1
+tags:
+- effir
+- retrieval
+- mteb
+- mistral
+- peft
+- lora
+- custom_code
+---
+
+# EffiR Mistral Drop 16 Attn
+
+EffiR Mistral dense retriever with direct layer dropping.
+
+Use `trust_remote_code=True`.
+
+```python
+from transformers import AutoConfig, AutoModelForCausalLM, AutoTokenizer
+from peft import PeftModel
+from huggingface_hub import hf_hub_download
+import torch
+
+repo = "yibinlei/effir-mistral-drop-16-attn"
+
+tokenizer = AutoTokenizer.from_pretrained(repo, trust_remote_code=True)
+config = AutoConfig.from_pretrained(repo, trust_remote_code=True)
+model = AutoModelForCausalLM.from_pretrained(
+    repo,
+    config=config,
+    trust_remote_code=True,
+    attn_implementation="eager",
+    torch_dtype=torch.bfloat16,
+)
+
+input_emb_path = hf_hub_download(repo, "embedding/input_emb.pth")
+model.set_input_embeddings(torch.load(input_emb_path, map_location="cpu"))
+model = PeftModel.from_pretrained(model, repo)
+model = model.merge_and_unload()
+```