Kat ⊷ the Poet Engineer
- things i find severely lacking in current llm benchmarks but i feel are important for iterative, open-ended knowledge work: - problem-setting. a major part of creative/exploratory work is defining what the problem even looks like. benchmarks skip that and hand you the problem pre-formed. it's the same issue with using exams to predict how someone handles real world problems.
- what does ai actually add to open-ended creative work? my first attempt at giving it a process signature: from a real project's transcripts i pulled 146 ideation events; the cubes are the moments ai forked the ideas open, laid along a 3d chronological trace of the sessions. https://t.co/XcxC9pUfJZ https://t.co/hg7NfEwyR3
Text
things i find severely lacking in current llm benchmarks but i feel are important for iterative, open-ended knowledge work: - problem-setting. a major part of creative/exploratory work is defining what the problem even looks like. benchmarks skip that and hand you the problem pre-formed. it's the same issue with using exams to predict how someone handles real world problems.
2w ago· 1 savePreview
Video
what does ai actually add to open-ended creative work? my first attempt at giving it a process signature: from a real project's transcripts i pulled 146 ideation events; the cubes are the moments ai forked the ideas open, laid along a 3d chronological trace of the sessions. https://t.co/XcxC9pUfJZ https://t.co/hg7NfEwyR3
2w ago· 1 savePreview