Wolfgang Seeker eae35e9b27 add tokenizer files for German, add/change code to train German pos tagger ...

- add files to specify rules for German tokenization
- change generate_specials.py to generate from an external file (abbrev.de.tab)
- copy gazetteer.json from lang_data/en/

- init_model.py
	- change doc freq threshold to 0
- add train_german_tagger.py
	- expects conll09-formatted input

2016-02-18 13:24:20 +01:00

..

train_german_tagger.py

add tokenizer files for German, add/change code to train German pos tagger

2016-02-18 13:24:20 +01:00

train.py

…