Download presentation
Presentation is loading. Please wait.
Published byHelena Sames Modified over 9 years ago
1
creativity / a pleasing field / of bloom: Generating Haiku Poems Read all about it: Gaiku: Generating Haiku with Word Association Norms Yael Netzer, David Gabay, Yoav Goldberg and Michael Elhadad ISI NL Seminar Yoav Goldberg
2
Motivation Why work on poetry generation?
3
Motivation Its cool Seem like a fun thing to do We like doing fun stuff and being cool (also, nice that wife is actually interested in what you do for a couple of weeks)
4
Motivation Its cool Seem like a fun thing to do We like doing fun stuff and being cool (also, nice that wife is actually interested in what you do for a couple of weeks) You can have fun and do cool stuff too! give computational creativity a shot
5
Key Ideas - constraints Form constraints aid creativity help focus on content force interesting solutions
6
Key Ideas - associativeness Associations are central to human thinking Associations are at the core of creativity Associations are key to poetry perception Many associative layers can be active simultaneously and contribute to meaning
7
People like to interpret / fill the gaps Poetry reading is also a creative process
8
Haiku
9
Form of poetry Originated in Japan, 16 th Century Three lines of 5,7,5 phonetic units (mora) Use present tense and use no judgmental words Adopted in Western languages, 20 th Century Basho Haiku old pond... a frog leaps in waters sound
10
Haiku
11
Amarican Haiku Mainly I've been back to my books and writings and being nice and quiet and lazy.
12
Amarican Haiku The American Haiku is not exactly the Japanese Haiku. The Japanese Haiku is strictly disciplined to seventeen syllables but since the language structure is different I don't think American Haikus (short three-line poems intended to be completely packed with Void of Whole) should worry about syllables because American speech is something again...bursting to pop. Above all, a Haiku must be very simple and free of all poetic trickery and make a little picture and yet be as airy and graceful as a Vivaldi Pastorella."
13
old pond... a frog leaps in waters sound pond frog plop! old pond frog leaping splash
14
picnic in the sun-dappled courtyard my freckled banana my father and I paint the barn compare wars
15
iced over pond I skip a rock the entire width blossomless but not unloved the old magnolia fishing guides boat in the background a new trip a holy cow a carton of milk seeking a church blind snakes on the wet grass tombstoned terror first date the little pile of anchovies Holding up my purring cat to the moon I sighed
16
Poetry Generation
17
Bo y Sul
18
Bo y Sul Structure
19
Bo y Sul Structure Content
20
Bo y Sul 3 lines, Grammatical, Haiku-like Inspiring, Interesting, Intriguing, Joyful, …
21
Previous works -Manurung [2003] -Manurung et al. [2000] -Gervas [2001] -Knight [2010] future previous Emphasize on Structure, less on Content
22
Body / Structure
23
Data Driven Haiku Corpus –~3,500 Haiku in English –Various sources amateurish sites childrens writings translations of classic Japanese Haiku of Bashu and others official sites of Haiku Associations (e.g., Haiku Path - Haiku Society of America).
24
Pattern Extraction POS Tag Count Line 1 Patterns: 280 JJ NN 276 NN NN... Line 2 Patterns: 64 DT_the JJ NN … Line 3 Patterns: …. Count Pattern Transitions: P(line2==DT_the NN | line1==JJ NN) =... … NN IN_of NNP DT_a NN IN_of NNS NN NN NNS CC NNS IN_on DT_a NN NN …
25
Generation Line 1 Patterns: 280 JJ NN 276 NN NN... Line 2 Patterns: 64 DT_the JJ NN … Line 3 Patterns: …. Pattern Transitions: P(line2==DT_the NN | line1==JJ NN) =... … Google 1T-Web / Proj Gutenberg POS Tagged
26
Generation Google 1T-Web / Proj Gutenberg POS Tagged JJ NNS DT_a JJ NN IN_of NN Line 1 Patterns: 280 JJ NN 276 NN NN... Line 2 Patterns: 64 DT_the JJ NN … Line 3 Patterns: …. Pattern Transitions: P(line2==DT_the NN | line1==JJ NN) =... …
27
Generation Google 1T-Web / Proj Gutenberg POS Tagged match JJ NNS DT_a JJ NN IN_of NN Line 1 Patterns: 280 JJ NN 276 NN NN... Line 2 Patterns: 64 DT_the JJ NN … Line 3 Patterns: …. Pattern Transitions: P(line2==DT_the NN | line1==JJ NN) =... …
28
Generation Google 1T-Web / Proj Gutenberg POS Tagged match JJ NNS DT_a JJ NN IN_of NN pouring cats a pilot care of fighter Line 1 Patterns: 280 JJ NN 276 NN NN... Line 2 Patterns: 64 DT_the JJ NN … Line 3 Patterns: …. Pattern Transitions: P(line2==DT_the NN | line1==JJ NN) =... …
29
Generation Line 1 Patterns: AA BB CC / 12 BB CC DD / 10 … Line 2 Patterns: CC DD EE / 20 … Line 3 Patterns: …. Pattern Transitions: P(Line2=AA BB | Line1= XX YY) … Google 1T-Web / Proj Gutenberg POS Tagged match Grammatical output Preserves Haiku Texture JJ NNS DT_a JJ NN IN_of NN pouring cats a pilot care of fighter
30
Generation Line 1 Patterns: AA BB CC / 12 BB CC DD / 10 … Line 2 Patterns: CC DD EE / 20 … Line 3 Patterns: …. Pattern Transitions: P(Line2=AA BB | Line1= XX YY) … Google 1T-Web / Proj Gutenberg POS Tagged match Grammatical output Preserves Haiku Texture JJ NNS DT_a JJ NN IN_of NN pouring cats a pilot care of fighter Not a great story, though.
31
Soul?
32
Requirements: good story –cohesive –surprising –provoke feelings/emotions –metaphorical –Should leave the reader wondering… … Creative!
33
Soul? An idea: capture story seed as sequence of concepts butterfly, spring, flower thief, steal, jail mosquito, blood, vampire but not any seed will do cat, feline, claw too cohesive computer, coat, queen too divergent
34
Soul? Is WordNet a good soul? not really it may give cohesiveness, but bad stories
36
Butterfly Spring Flower The connection between these words is reconstructable by human It is not available in WordNet Where can we find such relations?
37
Word Association Norms
38
Word Association Norms (WAN) Collection of cue words a set of free associations (targets) with quantitative and statistical measures. (mouse CAT 0.5, RAT 0.08, CHEESE 0.07, HOLE 0.05…) Given a cue - collect immediate responses of first word that comes to mind. Largest WAN we know for English is the University of South Florida Free Association Norms (Nelson et al., 1998). http://w3.usf.edu/FreeAssociation/ 5,019 cue words and 10,469 additional target that were collected with more than 6,000 participants since 1973. WAN – weighted directed graph, nodes are stemmed words.
39
water flower butterfly spring fall green water bloom
40
Why Word Associations Added value of WAN: an insight on language, not found in WordNet or are hard to acquire from corpora [Sinopalnikova & Smrz 2004] Associative thinking takes part in the process of writing and reading poetry Haiku, because so short - relies on lexical associations for concept progression Hypothesis: word-associations are good catalyzers for creativity, can be used as a building block in the creative process of Haiku generation.
41
Filling body with soul: Theme Selection Generating the seed of the story: –Start with a word random walk on a word graph Many possible variants. We currently use: start with the node of the seed word do several short random walks keep resulting word set
43
Filling body with soul Input: seed word -generate structural skeleton -perform several short random walks on Assoc. graph, creating an association set -choose first line containing seed word -choose other lines containing a word from the set This is adequate, but relations might be too straightforward
44
Searching for a better soul Generate several poems for the pattern, then select the best one (people do that too: try out various ideas, write, rewrite, throw away, chose best one)
45
Searching for a better soul Generate several poems for the pattern, then select the best one (people do that too: try out various ideas, write, rewrite, throw away, chose best one) We rank haikus based on associativity measure This ranking catches further residual relations
46
Education plays a role too.. At first we used Google web n-grams SILVER : golden age of animation saves a lot of money with fish
47
Education plays a role too.. At first we used Google web n-grams SILVER : golden age of animation saves a lot of money with fish ANIMAL : animal nature wild italian housewives on a happy face
48
Education plays a role too.. At first we used Google web n-grams SILVER : golden age of animation saves a lot of money with fish ANIMAL : animal nature wild italian housewives on a happy face FREE : the sample solution free nude adult webcams on a statutory holiday
49
Education plays a role too.. At first we used Google web n-grams then we decided to switch to Gutenberg project SILVER : golden age of animation saves a lot of money with fish ANIMAL : animal nature wild italian housewives on a happy face FREE : the sample solution free nude adult webcams on a statutory holiday CUTE : cute college girls young pussy cum hardcore horse zoophilia
50
Evaluation?
51
Turing Test Was this Haiku written by human or computer? How would you rate it between 1 to 5? Settings: –AUTO: 15 Haiku created by Gaiku without any manual selection, 10 random human Haiku (same seed words) –SEL: 17 Haiku created by Gaiku, selected manually out of several runs, 9 award winning human Haiku 52 subjects
52
Results: AUTO set
53
Results: SEL set
54
Interesting observations Every subject was wrong at least 3 times –at least once in each direction CS students better at recognizing computer poems than Foreign Literature Students Foreign Literature students assign higher scores in general
55
Some subjects comments: On computer generated: this is too stupid to be written by a computer On human generated: this metaphor is too trivial to be written by a human
56
Thoughts on Turing tests People are not very good at judging what a computer can or cant do Who is under test in a Turing test? –The computer program? –The human haiku writers? –The human participating in the test?
57
Regardless of evaluation limitations I feel Gaiku is indeed a reasonable Haiku poet It is certainly better than me at writing Haiku poems I find myself constantly amazed by some of its outputs I find many of them to be intriguing / thought-provoking / amusing / fascinating. I can definitely recognize Gaiku outputs from Human poems. But maybe it just means it has a distinct style?
58
The Best of Gaiku Best in SEL. Classified as human - 77.2%, average grade 3.09 Best in AUTO. Classified as human - 72.2%, average grade 2.75 early dew the water contains teaspoons of honey cherry tree poisonous flowers lie blooming
59
iced over pond I skip a rock the entire width blossomless but not unloved the old magnolia fishing guides boat in the background a new trip a holy cow a carton of milk seeking a church blind snakes on the wet grass tombstoned terror first date the little pile of anchovies Holding up my purring cat to the moon I sighed
60
iced over pond I skip a rock the entire width blossomless but not unloved the old magnolia fishing guides boat in the background a new trip a holy cow a carton of milk seeking a church blind snakes on the wet grass tombstoned terror first date the little pile of anchovies Holding up my purring cat to the moon I sighed
61
iced over pond I skip a rock the entire width blossomless but not unloved the old magnolia fishing guides boat in the background a new trip a holy cow a carton of milk seeking a church blind snakes on the wet grass tombstoned terror first date the little pile of anchovies Holding up my purring cat to the moon I sighed
62
Interesting stuff to be explored Better modeling of association progression –Can we model Surprise? Suspense? –Higher-order associations Can we create association priming? Can we create association-garden-pathing? There is more to haikus than associations Can we generate based on a theme, not just a seed word?
Similar presentations
© 2024 SlidePlayer.com Inc.
All rights reserved.