Best Gemma 4 merge for creative writing

#2
by megaray99 - opened

This is without a doubt the best merge for creative writing. One small request: as Artemis v1.1 has come out, if you even make another version would you please consider using that latest version for the merge instead of v1? Thank you again for this merge, it is awesome!

I'm glad you're enjoying it. I ran a few experiments with Artemis v1.1, but then I settled on Artemis v1 to maximize creativity. From the author's notes comparing the two versions:

The v1 release was overdue. It was a good early attempt that pulled out the best writing potential in Gemma 4. However, v1 might require some handholding, token banning, etc., for stability and to avoid dash spiraling. With that said, many fans still vouched for [what is now] v1.
The v1.1 release addresses the issues of v1 while retaining as much of the charm that v1 had.

I wanted max creativity from that ingredient, and I figured that the other merge ingredients would smooth out the rough edges of v1. Artemis v1 yielded better results than v1.1 as I was testing the merge recipe, so I kept it in the final blend.

I have sometimes found that the latest version of a model isn't always the best ingredient for a merge recipe where other models can compensate for issues.

Understood, it is very true that latest is not always the greatest. Thanks again for your work on this merge. Truly astounding!

Hi @megaray99 . For creative writing, do you mean like storytelling? If so, can you share your system prompt and sampler settings? Thanks.

The model is very good, mate.

Hi @megaray99 . For creative writing, do you mean like storytelling? If so, can you share your system prompt and sampler settings? Thanks.

Yes, I do mean storytelling. I use the default oobabooga system prompt in chat-instruct mode. But I always end my story prompts with the text "Please make this story as long as possible: elaborate - basically take this prompt as just a seed, but you add whatever you need to make it into a very detailed novel length story based on the prompt specifications. As you are aiming for a long form novel, You can build the story over multiple responses, it doesn't have to be all in one response." This keeps the story open ended (otherwise normally it tries to rush to finish the story in one response). To continue, I just click "send" button on an empty prompt, and it will pick up and continue the story in the next response. I can get a story to continue indefinitely this way. The sampler settings are very important, I went through tons of iterations and tuning to arrive at this, but I found these settings unleash the full creativity of this merge while maintaining near perfect coherence:

temperature: 1.1
top_p: 0.8
min_p: 0.2
top_n_sigma: 0.8
xtc_probability: 0.5
xtc_threshold: 0.1

Keep in mind I'm using imatrix q6 quant, so if you have lower quant you may need to lower the temp and tighten the top_p,min_p and top_n_sigma parameters

Sign up or log in to comment