# Granite Switch Composed Model

## Base Model

- Identifier: ibm-granite/granite-4.1-3b
- Model type: granite
- Architectures: GraniteForCausalLM
- Hidden size: 2560
- Hidden layers: 40
- Attention heads: 40
- Vocab size: 100352

## Embedded Adapters

Total adapters: **12**

| # | Name | Technology | Control Token | Token ID | Rank | Alpha | Target Modules | Source |
|---|------|------------|---------------|----------|------|-------|----------------|--------|
| 1 | citations | lora | `<\|citations\|>` | 100352 | 16 | 32 | k_proj, o_proj, q_proj, v_proj | ibm-granite/granitelib-rag-r1.0 |
| 2 | query_rewrite | alora | `<\|query_rewrite\|>` | 100353 | 32 | 32 | down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj | ibm-granite/granitelib-rag-r1.0 |
| 3 | query_clarification | alora | `<\|query_clarification\|>` | 100354 | 32 | 64 | down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj | ibm-granite/granitelib-rag-r1.0 |
| 4 | hallucination_detection | lora | `<\|hallucination_detection\|>` | 100355 | 16 | 32 | down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj | ibm-granite/granitelib-rag-r1.0 |
| 5 | answerability | alora | `<\|answerability\|>` | 100356 | 16 | 32 | down_proj, gate_proj, k_proj, o_proj, q_proj, up_proj, v_proj | ibm-granite/granitelib-rag-r1.0 |
| 6 | factuality-detection | alora | `<\|factuality-detection\|>` | 100357 | 32 | 64 | k_proj, q_proj, v_proj | ibm-granite/granitelib-guardian-r1.0 |
| 7 | policy-guardrails | alora | `<\|policy-guardrails\|>` | 100358 | 16 | 32 | k_proj, o_proj, q_proj, v_proj | ibm-granite/granitelib-guardian-r1.0 |
| 8 | factuality-correction | alora | `<\|factuality-correction\|>` | 100359 | 32 | 64 | k_proj, q_proj, v_proj | ibm-granite/granitelib-guardian-r1.0 |
| 9 | guardian-core | alora | `<\|guardian-core\|>` | 100360 | 16 | 64 | k_proj, o_proj, q_proj, v_proj | ibm-granite/granitelib-guardian-r1.0 |
| 10 | uncertainty | alora | `<\|uncertainty\|>` | 100361 | 32 | 64 | k_proj, o_proj, q_proj, v_proj | ibm-granite/granitelib-core-r1.0 |
| 11 | requirement-check | alora | `<\|requirement-check\|>` | 100362 | 16 | 64 | k_proj, o_proj, q_proj, v_proj | ibm-granite/granitelib-core-r1.0 |
| 12 | context-attribution | lora | `<\|context-attribution\|>` | 100363 | 16 | 32 | k_proj, q_proj, v_proj | ibm-granite/granitelib-core-r1.0 |

## Composition Details

- base_param_count: 3,402,836,480
- composed_param_count: 4,149,977,600
- Param delta: +21.96%
- compose_settings:
  - exclude_adapters:
    - "context_relevance"
  - target_model: "granite-4.1-3b"
- adapter_sources:
  - "ibm-granite/granitelib-rag-r1.0": "6e4a75e35f1cb272e8d15b4615fb0a123398d1cf"
  - "ibm-granite/granitelib-guardian-r1.0": "882ccf11cf1e4cdc3a66044f17872e55078dbc85"
  - "ibm-granite/granitelib-core-r1.0": "8f78babf3f0d5baba230464838050a71fe59dee5"