One alternating fine-tuning chart
Browse files- README.md +1 -3
- assets/finetune-droidcall.svg +0 -58
- assets/finetune-mobile-actions.svg +0 -58
- assets/finetune.svg +85 -0
README.md
CHANGED
|
@@ -76,9 +76,7 @@ Every turn returns one JSON object with `function_calls`, the model's `reasoning
|
|
| 76 |
|
| 77 |
Needle was designed to be customised. Its capacity is a ladder, and a subnetwork as small as 2 layers, fine-tuned on one product's tools, runs optimally on devices far smaller than the full model needs. Fine-tuning on DroidCall lifts every subnetwork by 18 to 36 points, and from 4 layers up the tuned subnetwork passes DeepSeek V4 Flash, starting at 29M parameters.
|
| 78 |
|
| 79 |
-

|
| 82 |
|
| 83 |
The Python package fine-tunes with LoRA on the frozen base at the full 20 layers, then `needle build [--layers N]` merges the adapter, slices any subnetwork from 2 to 20 layers and exports a 4-bit `.cact` that runs on the same engine. The 2-bit post-training and quantisation behind the shipped model, enriched with Cactus proprietary datasets, run on the [Cactus Platform](https://cactuscompute.com/dashboard).
|
| 84 |
|
|
|
|
| 76 |
|
| 77 |
Needle was designed to be customised. Its capacity is a ladder, and a subnetwork as small as 2 layers, fine-tuned on one product's tools, runs optimally on devices far smaller than the full model needs. Fine-tuning on DroidCall lifts every subnetwork by 18 to 36 points, and from 4 layers up the tuned subnetwork passes DeepSeek V4 Flash, starting at 29M parameters.
|
| 78 |
|
| 79 |
+

|
|
|
|
|
|
|
| 80 |
|
| 81 |
The Python package fine-tunes with LoRA on the frozen base at the full 20 layers, then `needle build [--layers N]` merges the adapter, slices any subnetwork from 2 to 20 layers and exports a 4-bit `.cact` that runs on the same engine. The 2-bit post-training and quantisation behind the shipped model, enriched with Cactus proprietary datasets, run on the [Cactus Platform](https://cactuscompute.com/dashboard).
|
| 82 |
|
assets/finetune-droidcall.svg
DELETED
assets/finetune-mobile-actions.svg
DELETED
assets/finetune.svg
ADDED
|
|