Exploring Temperature Settings in Creative Writing: A Haiku Generation Case Study with OpenAI API
Every time you prompt a large language model, you're witnessing the result of thousands of sequential sampling decisions—each token drawn from a probability distribution over the model's vocabulary. In standard chat interfaces, these distributions are sampled with fixed settings that users cannot adjust. But API
