최신 모델에서 눈에 띄게 퇴보한 창의적 글쓰기 능력
Creative writing has visibly regressed in newer models
핵심 요약
최신 AI 모델들이 창의적인 서사보다는 지나치게 안전하고 기업적인 말투를 구사하며 글쓰기 품질이 저하되었다는 지적.
- 창의적 글쓰기 퇴보 — 최신 모델들이 생생한 묘사 대신 지나치게 안전하고 기업적인 문체를 사용함.
- 모델 간 성능 비교 — Claude Opus 4.7과 Sonnet 4의 예시를 통해 서사적 표현의 차이를 보여줌.
- RLHF의 부작용 — 안전성 위주의 평가 방식이 창의적이고 흥미로운 서사를 억제하고 있음.
Hi
I'm testing different models for my game. I've noticed that creative writing has visibly regressed over time. From actual entertaining and explicit prose towards LinkedIn-ish cringe MBA approved enterprise I'm a helpful and safe assistant-ish style.
Example from my game:
Claude Opus 4.7:
The village square reeks of woodsmoke and goblin-stink. At the far end, the warband bunches together — lean, scab-knuckled, blades already bare and twitching in their grips. Their leader stands a half-pace forward, eyes flicking across the crowd like a butcher pricing meat.
Sneek bares too many teeth in a grin, the gums black where they've rotted. One filthy fist is wrapped around a length of rope. The other end is knotted at the wrists of a villager — old, grey-haired, head bowed so low his chin scrapes his chest. A dark stain spreads down the front of his trousers.
Sneek Grain. THREE sacks. Old man's tools — all of them, the good iron, don't think Sneek doesn't know. And the girl, the strong one, yes — bring them out, OR. We. Burn. The well.
Claude Sonnet 4 (already retired by Anthropic, only accessible over other providers):
The square reeks of unwashed goblin musk and human terror-sweat. Lean, feral shapes mass at the far end — yellow eyes gleaming, rust-stained weapons already drawn. Their leader stands a half-step ahead, scarred lips pulled back in a predator's grin as his beady eyes rake over the crowd like he's already dividing the spoils.
Sneek holds a frayed length of rope in his gnarled claws, yellowed teeth jutting at odd angles from blackened gums. On the other end: Jorik the miller's son, wrists bound and bleeding, his head hanging in defeat as snot drips from his broken nose onto the dirt below.
Sneek Grain! THREE SACKS of your finest! The old man's hammer and tongs! And THAT girl there — she looks STRONG enough for Sneek's purposes! Bring them NOW or we'll poison your precious well and watch you all DIE of thirst!
Sonnet 4's version is actually fun to read whereas Opus 4.7 sounds flattened down and boring.
What do you think?
I think it's a shame that all the big labs are moving towards erasing interesting/creative narrative prose/writing and we're all collectively converging towards sounding like corporate-safe LinkedIn managers.
I guess that's what happens if all the RLHF evaluators are flagging anything that could be harmful or dangerous as wrong

