============
Bag of Words
============

.. figure:: icons/bagofwords.png

Generates a bag of words from the input corpus.

Signals
-------

**Inputs**:

-  **Corpus**

   Corpus instance.

**Outputs**:

-  **Corpus**

   Corpus with bag of words.

Description
-----------

**Bag of Words** model creates a corpus with word counts for each data instance (document). The count can be either absolute, binary (contains or does not contain) or sublinear (logarithm of the term frequency). Bag of words model is required in combination with :doc:`Word Enrichment <wordenrichment>` and could be used for predictive modelling.

.. figure:: images/Bag-of-Words-stamped.png

1. Parameters for `bag of words <https://en.wikipedia.org/wiki/Tf%E2%80%93idf>`_ model:
	- Term Frequency:
		- Count: number of occurences of a word in a document
		- Binary: word appears or does not appear in the document
		- Sublinear: logarithm of term frequency (count)
	- Document Frequency:
		- (None)
		- IDF: `inverse document frequency <http://nlp.stanford.edu/IR-book/html/htmledition/inverse-document-frequency-1.html>`_
		- `Smooth IDF <http://scikit-learn.org/stable/modules/generated/sklearn.feature_extraction.text.TfidfTransformer.html>`_: adds one to document frequencies to prevent zero division.
	- Regulariation:
		- (None)
		- L1 (Sum of elements): normalizes vector length to sum of elements
		- L2 (Euclidean): normalizes vector length to sum of squares

2. Produce a report.

3. If *Commit Automatically* is on, changes are communicated automatically. Alternatively press *Commit*.

Example
-------

In the first example we will simply check how the bag of words model looks like. Load *bookexcerpts.tab* with :doc:`Corpus <corpus>` widget and connect it to **Bag of Words**. Here we kept the defaults - a simple count of term frequencies. Check what the **Bag of Words** outputs with **Data Table**. The final column in white represents term frequencies for each document.

.. figure:: images/Bag-of-Words-Example1.png

In the second example we will try to predict document category. We are still using the *bookexcerpts.tab* data set, which we sent through :doc:`Preprocess Text <preprocesstext>` with default parameters. Then we connected **Preprocess Text** to **Bag of Words** to obtain term frequencies by which we will compute the model.

.. figure:: images/Bag-of-Words-Example2.png

Connect **Bag of Words** to **Test & Score** for predictive modelling. Connect **SVM** or any other classifier to **Test & Score** as well (both on the left side). **Test & Score** will now compute performance scores for each learner on the input. Here we got quite impressive results with SVM. Now we can check, where the model made a mistake.

Add **Confusion Matrix** to **Test & Score**. Confusion matrix displays correctly and incorrectly classified documents. *Select Misclassified* will output misclassified documents, which we can further inspect with :doc:`Corpus Viewer <corpusviewer>`.