function in jsngram.text2 module

Description

Normalize a text file or files in a directory including subdirectories. Uses normal_text for Unicode normalization.

Example
jsngram.text2.normalize_texts('/scratch/a.txt', '/scratch/b.txt')
jsngram.text2.normalize_texts('/scratch/c', '/scratch/d')
jsngram.text2.normalize_texts('/scratch/e')
      
Usage

jsngram.text2.normalize_texts(src, dest=None)

Normalize text files at src to dest. Argument dest must be a directory when src is a directory. Argument dest is assumed to be a file when src is a file. The src will be overwritten when dest = None.