Phrase Frequency Counter
Overview
- Takes the output of the autocomplete tools as input
- Produces a sorted list of the most common phrases and how many times they have occurred within the input file
- Also produces a list of the top N=20 phrases
- Both written in Python
PHP & Python
- Two versions
- Difference due to differences in delimiting of data
- Versions are separate and can be used independently
PHP
frequencycount.py
*toptermfinder.py
- Takes the resulting top N terms from all input files and consolidates them into one file, finding the phrases with the most occurrences overall
Python
frequencycount_forpython.py
PHP ver.
Input:
Output:
$ python frequencycounter.py <input> <output>
PHP cont
(in same directory) Another test file:
Output:
PHP
Convert output (N = 20)
toptermfinder.py takes all of these lists in one directory and finds the most common phrases
directory: USArest
Python
$ python frequencycounter_forpython.py <input1> <input2> <output>
input1
input2
Python cont
output is similar to PHP ver.
