56.4 kB

Ctrl+K

1 contributor

History: 1 commit

cfontes

GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache

dfc39f1 verified 9 days ago

README.md

5.27 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
apply.sh

1.68 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_01_prefill_offset.py

4.89 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_02_drafter_resume.py

4.09 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_03_engine_wiring.py

3.2 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_04_chunk_alignment.py

4.47 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_05_fixed_chunks.py

2.68 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_06_finalize.py

2.59 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
patch_07_canonical_end.py

2.98 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
prefix_cache.py

3.47 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
test_agentic.py

16.4 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
test_growth.py

1.45 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
test_semantic.py

1.82 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago
test_stress.py

1.5 kB
GLM-5.3 EXL3 3.38bpw on 4x DGX Spark: serving kit + incremental KV prefix cache 9 days ago