---
title: "corpus"
source: https://www.jemoka.com/posts/kbhcorpus/
---

usually we use \(N\) to denote the number of tokens, and \(V\) the &ldquo;vocab&rdquo; or set of word types.
Corpora is usually considered in context of:
specific writers at specific time for specific varieties of specific languages for a specific function Particularly hard: code switching, gender, demographics, variety, etc.
Herdan&rsquo;s Law \begin{equation} |V| = kN^{\beta} \end{equation}
with \(\beta\) being a constant between \(0.67 &lt; \beta &lt; 0.75\).
The vocab size is roughly proportional to the number of tokens.
