Skip to content

Commit 5e8475d

Browse files
author
leandro
committed
add figures ch05
1 parent 7b4899f commit 5e8475d

5 files changed

+28
-0
lines changed

05_text-generation.ipynb

+28
Original file line numberDiff line numberDiff line change
@@ -41,13 +41,34 @@
4141
"# Text Generation"
4242
]
4343
},
44+
{
45+
"cell_type": "markdown",
46+
"metadata": {},
47+
"source": [
48+
"<img alt=\"LM Meta Learning\" width=\"800\" caption=\"During pretraining, language models are exposed to sequences of tasks that can be adapted during inference (courtesy of Tom B. Brown)\" src=\"images/chapter05_lm-meta-learning.png\" id=\"lm-meta-learning\"/>"
49+
]
50+
},
51+
{
52+
"cell_type": "markdown",
53+
"metadata": {},
54+
"source": [
55+
"<img alt=\"Meena\" width=\"300\" caption=\"Meena on the left telling a corny joke to a human on the right (courtesy of Daniel Adiwardana and Thang Luong)\" src=\"images/chapter05_meena.png\" id=\"meena\"/>"
56+
]
57+
},
4458
{
4559
"cell_type": "markdown",
4660
"metadata": {},
4761
"source": [
4862
"## The Challenge with Generating Coherent Text"
4963
]
5064
},
65+
{
66+
"cell_type": "markdown",
67+
"metadata": {},
68+
"source": [
69+
"<img alt=\"Text generation\" width=\"700\" caption=\"Generating text from an input sequence by adding a new word to the input at each step\" src=\"images/chapter05_text-generation.png\" id=\"text-generation\"/> "
70+
]
71+
},
5172
{
5273
"cell_type": "markdown",
5374
"metadata": {},
@@ -320,6 +341,13 @@
320341
"## Beam Search Decoding"
321342
]
322343
},
344+
{
345+
"cell_type": "markdown",
346+
"metadata": {},
347+
"source": [
348+
"<img alt=\"Beam search\" width=\"700\" caption=\"Beam search with two beams—the most probable sequences at each timestep are highlighted in blue\" src=\"images/chapter05_beam-search.png\" id=\"beam-search\"/> "
349+
]
350+
},
323351
{
324352
"cell_type": "code",
325353
"execution_count": null,

images/chapter05_beam-search.png

35.6 KB
Loading

images/chapter05_lm-meta-learning.png

163 KB
Loading

images/chapter05_meena.png

88.8 KB
Loading

images/chapter05_text-generation.png

168 KB
Loading

0 commit comments

Comments
 (0)