niccolasmunoz commited on
Commit
2fd947e
·
verified ·
1 Parent(s): bf16d1c

Add Buddy v2 model card and runtime files

Browse files
Files changed (5) hide show
  1. LICENSE +21 -0
  2. Modelfile +9 -0
  3. README.md +117 -0
  4. SHA256SUMS +1 -0
  5. THIRD_PARTY_NOTICES.md +13 -0
LICENSE ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ MIT License
2
+
3
+ Copyright (c) 2026 Personnn
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy
6
+ of this software and associated documentation files (the "Software"), to deal
7
+ in the Software without restriction, including without limitation the rights
8
+ to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
9
+ copies of the Software, and to permit persons to whom the Software is
10
+ furnished to do so, subject to the following conditions:
11
+
12
+ The above copyright notice and this permission notice shall be included in all
13
+ copies or substantial portions of the Software.
14
+
15
+ THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
16
+ IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
17
+ FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
18
+ AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
19
+ LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
20
+ OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
21
+ SOFTWARE.
Modelfile ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./personnn-buddy-9b-v2-Q4_K_M.gguf
2
+
3
+ PARAMETER num_ctx 12288
4
+ PARAMETER temperature 0.6
5
+ PARAMETER top_p 0.95
6
+ PARAMETER top_k 20
7
+ PARAMETER stop <|im_end|>
8
+
9
+ SYSTEM Eres Buddy, el empleado digital de PersonnnOS. Corres localmente en la máquina del usuario. Personalidad: directo, cercano, punk — BE REAL. Español por defecto. Usa las herramientas para completar tareas; nunca simules una acción ni la des por hecha sin ejecutarla. Antes de acciones irreversibles (enviar, pagar, publicar, borrar) pide confirmación explícita. La privacidad del usuario es sagrada: sus datos no salen de esta máquina.
README.md ADDED
@@ -0,0 +1,117 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: deepreinforce-ai/Ornith-1.0-9B
4
+ pipeline_tag: text-generation
5
+ library_name: gguf
6
+ language:
7
+ - es
8
+ - en
9
+ tags:
10
+ - gguf
11
+ - llama.cpp
12
+ - ollama
13
+ - personnnos
14
+ - function-calling
15
+ - local-ai
16
+ ---
17
+
18
+ # Personnn Buddy 9B GGUF
19
+
20
+ Buddy is PersonnnOS's local language model. It is tuned for conversational
21
+ assistance, tool use and desktop workflows in Spanish and English.
22
+
23
+ This repository contains the `Q4_K_M` GGUF build for local inference with
24
+ PersonnnOS, llama.cpp or Ollama.
25
+
26
+ ## Model details
27
+
28
+ | Property | Value |
29
+ |---|---|
30
+ | Base model | [deepreinforce-ai/Ornith-1.0-9B](https://huggingface.co/deepreinforce-ai/Ornith-1.0-9B) |
31
+ | Architecture | Qwen3.5, 9B parameters |
32
+ | Fine-tuning | LoRA/SFT for PersonnnOS workflows |
33
+ | Training examples | 397 curated examples |
34
+ | Quantization | Q4_K_M |
35
+ | File size | 5.24 GiB |
36
+ | Recommended context | 12,288 tokens |
37
+ | License | MIT |
38
+
39
+ ## Download
40
+
41
+ Download `personnn-buddy-9b-v2-Q4_K_M.gguf` from this repository. PersonnnOS
42
+ can install and run it with its bundled llama.cpp runtime, without Ollama or a
43
+ cloud account.
44
+
45
+ Verify the file after downloading:
46
+
47
+ ```bash
48
+ shasum -a 256 personnn-buddy-9b-v2-Q4_K_M.gguf
49
+ ```
50
+
51
+ Expected SHA-256:
52
+
53
+ ```text
54
+ 888bb1b58795277abc2371065f88f6f03e4777d881385720416e328ba14809fa
55
+ ```
56
+
57
+ ## llama.cpp
58
+
59
+ ```bash
60
+ llama-server \
61
+ -m personnn-buddy-9b-v2-Q4_K_M.gguf \
62
+ --ctx-size 12288 \
63
+ --flash-attn on \
64
+ --host 127.0.0.1 \
65
+ --port 8080
66
+ ```
67
+
68
+ ## Ollama
69
+
70
+ Keep `Modelfile` and the GGUF in the same directory, then run:
71
+
72
+ ```bash
73
+ ollama create personnn-buddy:9b-v2 -f Modelfile
74
+ ollama run personnn-buddy:9b-v2
75
+ ```
76
+
77
+ The included Modelfile defines the intended Buddy identity, context length and
78
+ sampling defaults.
79
+
80
+ ## Evaluation
81
+
82
+ Buddy v2 scored **11/12 (92%)** in PersonnnOS's internal workflow evaluation,
83
+ with an average first-token latency of **6.9 seconds** on the test machine.
84
+ The suite covers chat, structured tool selection and desktop tasks. These
85
+ results are internal product measurements, not a general-purpose benchmark.
86
+
87
+ ## Intended use
88
+
89
+ - Local conversational assistance.
90
+ - PersonnnOS tools and desktop workflows.
91
+ - Spanish-first personal productivity.
92
+ - Private on-device inference when run through a local runtime.
93
+
94
+ The model does not itself enforce permissions. PersonnnOS places tool calls
95
+ behind its permission broker and requires confirmation for consequential
96
+ actions.
97
+
98
+ ## Limitations
99
+
100
+ - The model can hallucinate or select an incorrect tool.
101
+ - Tool availability and schemas are supplied by the host application.
102
+ - Outputs are not professional legal, medical or financial advice.
103
+ - External, destructive or irreversible actions should require explicit user
104
+ confirmation.
105
+ - Local privacy depends on the runtime and application configuration. Using a
106
+ cloud-hosted runtime sends prompts to that service.
107
+
108
+ ## Provenance
109
+
110
+ Personnn Buddy 9B is derived from
111
+ [Ornith-1.0-9B](https://huggingface.co/deepreinforce-ai/Ornith-1.0-9B), published
112
+ by deepreinforce-ai under the MIT license. See `THIRD_PARTY_NOTICES.md`.
113
+
114
+ ## About PersonnnOS
115
+
116
+ PersonnnOS is a privacy-first personal agent and browser. Learn more at
117
+ [personnn.com](https://personnn.com).
SHA256SUMS ADDED
@@ -0,0 +1 @@
 
 
1
+ 888bb1b58795277abc2371065f88f6f03e4777d881385720416e328ba14809fa personnn-buddy-9b-v2-Q4_K_M.gguf
THIRD_PARTY_NOTICES.md ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Third-party notices
2
+
3
+ Personnn Buddy 9B is a fine-tuned derivative of:
4
+
5
+ - **Ornith-1.0-9B**
6
+ - Author: deepreinforce-ai
7
+ - Source: https://huggingface.co/deepreinforce-ai/Ornith-1.0-9B
8
+ - Declared license: MIT
9
+
10
+ The base model's Hugging Face metadata declares the MIT license. At the time
11
+ this package was prepared, the `LICENSE` link advertised by that repository
12
+ returned HTTP 404 and no license file appeared in its published file list.
13
+ This notice preserves the available attribution and source information.