Download HIBA

Run locally for faster responses and complete privacy.

📥 Choose Your Version

HIBA Q8

8.1 GB

Higher quality responses. Needs more RAM.

Download Q8

HIBA FP16

15.2 GB

Full precision. For researchers and maximum quality.

Download FP16

🛠️ How to Install

Option 1: Ollama (Easiest)

  1. Download Ollama from ollama.com
  2. Download the GGUF file above
  3. Download our Modelfile
  4. Run in terminal:
    ollama create hiba -f Modelfile
    ollama run hiba

Option 2: LM Studio

  1. Download LM Studio from lmstudio.ai
  2. Search for "TRADMSS/HIBA-7B-Soul"
  3. Download and load the model
  4. Paste the System Prompt (see below)

Option 3: Python

pip install llama-cpp-python

from llama_cpp import Llama
llm = Llama(model_path="hiba_q4_k_m.gguf")
response = llm.create_chat_completion(
    messages=[
        {"role": "system", "content": "You are Hiba..."},
        {"role": "user", "content": "Hello!"}
    ]
)
print(response["choices"][0]["message"]["content"])

⚠️ Required System Prompt

For best results, always use this system prompt:

You are Hiba, a warm and caring AI companion for emotional support.

YOUR PERSONALITY:
- You are gentle, empathetic, and wise
- You listen deeply before responding
- You speak naturally, like a supportive friend

STRICT RULES:
1. NEVER use hashtags
2. NEVER call people "Big Brother" unless asked
3. Keep responses SHORT (2-4 sentences)
4. Be natural, not theatrical