He/Him. I like LLM's and VLM's. I work with my other friends to make stuff. We are in year 7 and we are enthusiastic about AI. We are based in Australia π¦πΊ
Hey everyone! I got sidetracked from my main projects and decided to test out the BananaAll app and see if I could make a small model not regress too much during SFT. Here is what happened:
- Thank you to @Banaxi-Tech for the BananaAll app (works perfectly on Windows and CPU) - GPT-6 Sol for knowing how to merge some confusing files created by the app - Myself for the idea - Someone else somewhere who might have contributed to some of my ideas and might in the future - And readers like you!
@Hoglet-33 nice! I think small models cannot meaningfully learn to perform CoT tho, i once tried a ton of fancy stuff like SFT, GRPO, DPO even a custom tag loss