Overview of files ================= Data directory -------------- The Data directory contains two types of data files. - Files with the extension "tsm" are term-sentence files which offer information of occurrences of words in each of the seven books employed. The format is "term-index:sentence number1, sentence number2, ....." for each line which describes a term-index of a considered word and sentence numbers at which the considered word appears in the book. - Files with the extension "voc" are vocabulary files which offer a list of words in each book. The format is "term-index:term-string" for each line which describes the correspondence between a term-index and a term-string. Source Code directory -------------- The following source codes (R and Python scripts) are included in the folder. With these scripts, it is possible to reproduce the main results described in the paper. 1. **calcACFandWTD.R**: This script calculates ACFs and WTDs for each of frequent words appear in the employed seven books. 2. **fitACF.py**: This script fits the stretched exponential function and the step-down function to the calculated ACFs and it also classifies a considered word as Type-I or Type-II based on their BICs. 3. **fitWTDforTypeI.py**: This script fits the hierarchical and the q-exponential distributions to the calculated WTDs. 4. **fitWTDforTypeII.py**: This script fits the exponential, the Weibull and the q-exponential distributions to the calculated WTDs. 5. **simulateWordOccurrences.R**: This script generates a hierarchical probability distribution of word occurrences in a virtual book and simulate word occurrence signals along the book. 6. **calcWtdForSim.R**: This script calculate WTDs from simulated word occurrence signals of the virtual book. 7. **fitWtdForSim.py**: This script fits the hierarchical and the q-exponential distributions to the WTDs of the simmulaed word occurrences.