spaCy/spacy/attrs.pxd

# Reserve 64 values for flag features
from . cimport symbols

cdef enum attr_id_t:
    NULL_ATTR
    IS_ALPHA
    IS_ASCII
    IS_DIGIT
    IS_LOWER
    IS_PUNCT
    IS_SPACE
    IS_TITLE
    IS_UPPER
    LIKE_URL
    LIKE_NUM
    LIKE_EMAIL
    IS_STOP
    IS_OOV
    IS_BRACKET
    IS_QUOTE
    IS_LEFT_PUNCT
    IS_RIGHT_PUNCT
    IS_CURRENCY

    FLAG19 = 19
    FLAG20
    FLAG21
    FLAG22
    FLAG23
    FLAG24
    FLAG25
    FLAG26
    FLAG27
    FLAG28
    FLAG29
    FLAG30
    FLAG31
    FLAG32
    FLAG33
    FLAG34
    FLAG35
    FLAG36
    FLAG37
    FLAG38
    FLAG39
    FLAG40
    FLAG41
    FLAG42
    FLAG43
    FLAG44
    FLAG45
    FLAG46
    FLAG47
    FLAG48
    FLAG49
    FLAG50
    FLAG51
    FLAG52
    FLAG53
    FLAG54
    FLAG55
    FLAG56
    FLAG57
    FLAG58
    FLAG59
    FLAG60
    FLAG61
    FLAG62
    FLAG63

    ID
    ORTH
    LOWER
    NORM
    SHAPE
    PREFIX
    SUFFIX

    LENGTH
    CLUSTER
    LEMMA
    POS
    TAG
    DEP
    ENT_IOB
    ENT_TYPE
    HEAD
    SENT_START
    SPACY
    PROB

    LANG
    ENT_KB_ID = symbols.ENT_KB_ID
    ENT_ID = symbols.ENT_ID
* Add attrs.pxd 2015-01-26 11:22:09 +00:00			`# Reserve 64 values for flag features`
Fix attrs alignment 2019-07-12 15:59:47 +00:00			`from . cimport symbols`

Fix cpdef enum in attrs.pyx 2017-09-17 17:28:53 +00:00			`cdef enum attr_id_t:`
* Refactor symbols, so that frequency rank can be derived from the orth id of a word. 2015-10-06 13:39:50 +00:00			`NULL_ATTR`
* Host IS_ flags in attrs.pxd, and add properties for them on Token and Lexeme objects 2015-07-26 14:37:16 +00:00			`IS_ALPHA`
			`IS_ASCII`
			`IS_DIGIT`
			`IS_LOWER`
			`IS_PUNCT`
			`IS_SPACE`
			`IS_TITLE`
			`IS_UPPER`
			`LIKE_URL`
			`LIKE_NUM`
			`LIKE_EMAIL`
			`IS_STOP`
* Add is_oov property, and fix up handling of attributes 2015-07-26 23:50:06 +00:00			`IS_OOV`
introduce lang field for LexemeC to hold language id put noun_chunk logic into iterators.py for each language separately 2016-03-10 12:01:34 +00:00			`IS_BRACKET`
			`IS_QUOTE`
			`IS_LEFT_PUNCT`
			`IS_RIGHT_PUNCT`
removed 18 and replaced 18 with is_currency 2018-02-11 17:51:09 +00:00			`IS_CURRENCY`
introduce lang field for LexemeC to hold language id put noun_chunk logic into iterators.py for each language separately 2016-03-10 12:01:34 +00:00
removed 18 and replaced 18 with is_currency 2018-02-11 17:51:09 +00:00			`FLAG19 = 19`
* Add attrs.pxd 2015-01-26 11:22:09 +00:00			`FLAG20`
			`FLAG21`
			`FLAG22`
			`FLAG23`
			`FLAG24`
			`FLAG25`
			`FLAG26`
			`FLAG27`
			`FLAG28`
			`FLAG29`
			`FLAG30`
			`FLAG31`
			`FLAG32`
			`FLAG33`
			`FLAG34`
			`FLAG35`
			`FLAG36`
			`FLAG37`
			`FLAG38`
			`FLAG39`
			`FLAG40`
			`FLAG41`
			`FLAG42`
			`FLAG43`
			`FLAG44`
			`FLAG45`
			`FLAG46`
			`FLAG47`
			`FLAG48`
			`FLAG49`
			`FLAG50`
			`FLAG51`
			`FLAG52`
			`FLAG53`
			`FLAG54`
			`FLAG55`
			`FLAG56`
			`FLAG57`
			`FLAG58`
			`FLAG59`
			`FLAG60`
			`FLAG61`
			`FLAG62`
			`FLAG63`

			`ID`
			`ORTH`
			`LOWER`
			`NORM`
			`SHAPE`
			`PREFIX`
			`SUFFIX`

			`LENGTH`
			`CLUSTER`
			`LEMMA`
			`POS`
			`TAG`
* Fix Issue #43: TAG attr not supported. Also add DEP attr, while I'm at it. Need better way of ensuring future changes don't break in similar way. 2015-04-07 04:00:43 +00:00			`DEP`
* Upd attrs id list 2015-07-15 23:26:54 +00:00			`ENT_IOB`
			`ENT_TYPE`
			`HEAD`
Add SENT_START attribute, for custom sentence boundary detection 2016-05-05 10:11:57 +00:00			`SENT_START`
* Upd attrs id list 2015-07-15 23:26:54 +00:00			`SPACY`
* Add PROB attribute in attrs.pxd 2015-08-26 17:14:19 +00:00			`PROB`
introduce lang field for LexemeC to hold language id put noun_chunk logic into iterators.py for each language separately 2016-03-10 12:01:34 +00:00
Fix LANG symbol 2018-02-17 17:10:50 +00:00			`LANG`
Fix attrs alignment 2019-07-12 15:59:47 +00:00			`ENT_KB_ID = symbols.ENT_KB_ID`
serialize ENT_ID (#4852) * expand serialization test for custom token attribute * add failing test for issue 4849 * define ENT_ID as attr and use in doc serialization * fix few typos 2020-01-06 13:57:34 +00:00			`ENT_ID = symbols.ENT_ID`