updates

Author: bhargavvader

loading_corpora.ipynb

@@ -234,7 +234,7 @@
    "source": [
     "It seems messy, but nothing we can't clean. This basic method replaces some of the issues with the formatting, and prints the errors if any for debugging. Let us clean one of the raw text files. \n",
     "\n",
-    "Note: we skip any text data which isn't utf-8 encoded here. I do this to keep things clean; you might want more data and not have that in."
+    "Note: we skip any text data which isn't utf-8 encoded here. I do this to keep things clean; you might want more data or anticipate special characters and not include that restriction."
    ]
   },
   {
@@ -273,7 +273,7 @@
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "Nice. This is looking a lot cleaner. We can now run some of our lucem_illud text cleaning methods we talked about in week 4. "
+    "Nice. This is looking a lot cleaner. We can now run some of our lucem_illud text cleaning methods we discuss/model in week 4. "
    ]
   },
   {
@@ -2329,7 +2329,7 @@
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "Great - now let us create a dataframe with the movie names, the raw words, the tokenized words, and so on.\n",
+    "Great! Now let us create a Pandas dataframe with movie names, raw words, tokenized words, and so on.\n",
     "The file \"sources_movies.zip\" has this information. Similar information files are found for the other datasets too, in their respective folders."
    ]
   },
@@ -2404,7 +2404,7 @@
     "\n",
     "First, let us create a dictionary mapping file-id to all the text. Each movie will be mapped to a list of the tokenized words.\n",
     "\n",
-    "In this example, I only use it to load 1000 movies. You can comment this out or increase/decrease the number as you see fit."
+    "In this example, I only use it to load 1000 movies. You can comment this out or increase/decrease the number as inspired."
    ]
   },
   {
@@ -2504,63 +2504,63 @@
        "  </thead>\n",
        "  <tbody>\n",
        "    <tr>\n",
-       "      <th>3603861</th>\n",
-       "      <td>Another Fine Mess</td>\n",
-       "      <td>Comedy, Short</td>\n",
-       "      <td>1930</td>\n",
+       "      <th>6861982</th>\n",
+       "      <td>Blonde Crazy</td>\n",
+       "      <td>Comedy, Crime, Drama</td>\n",
+       "      <td>1931</td>\n",
        "      <td>English</td>\n",
-       "      <td>[Dear, ladies, and, gentlemen, Hal, Roach, pre...</td>\n",
+       "      <td>[Who, cares, for, starlit, skies, when, you, '...</td>\n",
        "    </tr>\n",
        "    <tr>\n",
-       "      <th>6421562</th>\n",
-       "      <td>East of Shanghai</td>\n",
-       "      <td>Comedy, Romance, Thriller</td>\n",
+       "      <th>6606107</th>\n",
+       "      <td>Five and Ten</td>\n",
+       "      <td>Drama, Romance</td>\n",
        "      <td>1931</td>\n",
        "      <td>English</td>\n",
-       "      <td>[Hello, Em, Hello, Fred, I, think, you, 'll, l...</td>\n",
+       "      <td>[Subtitles, Lu, s, Filipe, Bernardes, Mr, Rari...</td>\n",
        "    </tr>\n",
        "    <tr>\n",
-       "      <th>3130930</th>\n",
-       "      <td>The Skin Game</td>\n",
-       "      <td>Drama</td>\n",
+       "      <th>6406611</th>\n",
+       "      <td>Five Star Final</td>\n",
+       "      <td>Crime, Drama</td>\n",
        "      <td>1931</td>\n",
        "      <td>English</td>\n",
-       "      <td>[Captioning, made, possible, by, lions, gate, ...</td>\n",
+       "      <td>[Extra, Extra, Extra, Five, star, final, Indis...</td>\n",
        "    </tr>\n",
        "    <tr>\n",
-       "      <th>4735124</th>\n",
-       "      <td>The Lost Atlantis</td>\n",
-       "      <td>Adventure, Fantasy</td>\n",
-       "      <td>1932</td>\n",
-       "      <td>English</td>\n",
-       "      <td>[All, in, one, word, Atlantis, An, ancient, dr...</td>\n",
+       "      <th>3251135</th>\n",
+       "      <td>The Smiling Lieutenant</td>\n",
+       "      <td>Comedy, Romance, Musical</td>\n",
+       "      <td>1931</td>\n",
+       "      <td>English, French</td>\n",
+       "      <td>[Bell_Rings, Bell_Rings, Sighing, Yawns, Yes, ...</td>\n",
        "    </tr>\n",
        "    <tr>\n",
-       "      <th>96272</th>\n",
-       "      <td>I Am a Fugitive from a Chain Gang</td>\n",
-       "      <td>Crime, Drama, Film-Noir</td>\n",
+       "      <th>6909562</th>\n",
+       "      <td>Faithless</td>\n",
+       "      <td>Drama</td>\n",
        "      <td>1932</td>\n",
        "      <td>English</td>\n",
-       "      <td>[Hey, pipe, down, you, mugs, Sorry, to, break,...</td>\n",
+       "      <td>[But, Carol, this, bank, is, your, guardian, W...</td>\n",
        "    </tr>\n",
        "  </tbody>\n",
        "</table>\n",
        "</div>"
       ],
       "text/plain": [
-       "                                Movie Name                      Genre  Year  \\\n",
-       "3603861                  Another Fine Mess              Comedy, Short  1930   \n",
-       "6421562                   East of Shanghai  Comedy, Romance, Thriller  1931   \n",
-       "3130930                      The Skin Game                      Drama  1931   \n",
-       "4735124                  The Lost Atlantis         Adventure, Fantasy  1932   \n",
-       "96272    I Am a Fugitive from a Chain Gang    Crime, Drama, Film-Noir  1932   \n",
+       "                     Movie Name                     Genre  Year  \\\n",
+       "6861982            Blonde Crazy      Comedy, Crime, Drama  1931   \n",
+       "6606107            Five and Ten            Drama, Romance  1931   \n",
+       "6406611         Five Star Final              Crime, Drama  1931   \n",
+       "3251135  The Smiling Lieutenant  Comedy, Romance, Musical  1931   \n",
+       "6909562               Faithless                     Drama  1932   \n",
        "\n",
-       "         Country                                    Tokenized Texts  \n",
-       "3603861  English  [Dear, ladies, and, gentlemen, Hal, Roach, pre...  \n",
-       "6421562  English  [Hello, Em, Hello, Fred, I, think, you, 'll, l...  \n",
-       "3130930  English  [Captioning, made, possible, by, lions, gate, ...  \n",
-       "4735124  English  [All, in, one, word, Atlantis, An, ancient, dr...  \n",
-       "96272    English  [Hey, pipe, down, you, mugs, Sorry, to, break,...  "
+       "                 Country                                    Tokenized Texts  \n",
+       "6861982          English  [Who, cares, for, starlit, skies, when, you, '...  \n",
+       "6606107          English  [Subtitles, Lu, s, Filipe, Bernardes, Mr, Rari...  \n",
+       "6406611          English  [Extra, Extra, Extra, Five, star, final, Indis...  \n",
+       "3251135  English, French  [Bell_Rings, Bell_Rings, Sighing, Yawns, Yes, ...  \n",
+       "6909562          English  [But, Carol, this, bank, is, your, guardian, W...  "
       ]
      },
      "execution_count": 28,
@@ -2584,7 +2584,7 @@
    "cell_type": "markdown",
    "metadata": {},
    "source": [
-    "You are encouraged to try the similar process and load other datasets."
+    "You are encouraged to try the similar process and load the other datasets."
    ]
   }
  ],