spaCy/spacy/en.pxd

from libcpp.vector cimport vector

from spacy.spacy cimport StringHash
from spacy.spacy cimport Lexeme
from spacy.spacy cimport Lexeme_addr

from spacy.spacy cimport Language
from spacy.tokens cimport Tokens


cdef class English(spacy.Language):
    cdef int find_split(self, unicode word, size_t length)

cdef English EN

cpdef Lexeme_addr lookup(unicode word) except 0
cpdef Tokens tokenize(unicode string)
cpdef unicode unhash(StringHash hash_value)
* Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals 2014-07-07 02:21:06 +00:00			`from libcpp.vector cimport vector`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 18:51:42 +00:00
* Reorganized, moving language-independent stuff to spacy. The functions in spacy ask for the dictionaries and split function on input, but the language-specific modules are curried versions that use the globals 2014-07-07 02:21:06 +00:00			`from spacy.spacy cimport StringHash`
* Refactor for string view features. Working on setting up flags and enums. 2014-07-07 14:58:48 +00:00			`from spacy.spacy cimport Lexeme`
			`from spacy.spacy cimport Lexeme_addr`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 18:51:42 +00:00
* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 10:47:21 +00:00			`from spacy.spacy cimport Language`
			`from spacy.tokens cimport Tokens`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 18:51:42 +00:00

* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 10:47:21 +00:00			`cdef class English(spacy.Language):`
			`cdef int find_split(self, unicode word, size_t length)`

			`cdef English EN`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 18:51:42 +00:00
			`cpdef Lexeme_addr lookup(unicode word) except 0`
* Reorganized code to accomodate Tokens class. Need string views before group_by and count_by can be done well. 2014-07-07 10:47:21 +00:00			`cpdef Tokens tokenize(unicode string)`
* Initial commit. Tests passing for punctuation handling. Need contractions, file transport, tokenize function, etc. 2014-07-05 18:51:42 +00:00			`cpdef unicode unhash(StringHash hash_value)`