spaCy/spacy/typedefs.pxd

from libc.stdint cimport uint16_t, uint32_t, uint64_t, uintptr_t
from libc.stdint cimport uint8_t


# Reserve 64 values for flag features
cpdef enum attr_id_t:
    FLAG0
    FLAG1
    FLAG2
    FLAG3
    FLAG4
    FLAG5
    FLAG6
    FLAG7
    FLAG8
    FLAG9
    FLAG10
    FLAG11
    FLAG12
    FLAG13
    FLAG14
    FLAG15
    FLAG16
    FLAG17
    FLAG18
    FLAG19
    FLAG20
    FLAG21
    FLAG22
    FLAG23
    FLAG24
    FLAG25
    FLAG26
    FLAG27
    FLAG28
    FLAG29
    FLAG30
    FLAG31
    FLAG32
    FLAG33
    FLAG34
    FLAG35
    FLAG36
    FLAG37
    FLAG38
    FLAG39
    FLAG40
    FLAG41
    FLAG42
    FLAG43
    FLAG44
    FLAG45
    FLAG46
    FLAG47
    FLAG48
    FLAG49
    FLAG50
    FLAG51
    FLAG52
    FLAG53
    FLAG54
    FLAG55
    FLAG56
    FLAG57
    FLAG58
    FLAG59
    FLAG60
    FLAG61
    FLAG62
    FLAG63

    ID
    ORTH
    LOWER
    NORM
    SHAPE
    PREFIX
    SUFFIX

    LENGTH
    CLUSTER
    LEMMA
    POS
    TAG
    DEP
    ENT


ctypedef uint64_t hash_t
ctypedef char* utf8_t
ctypedef uint32_t attr_t
ctypedef uint64_t flags_t
ctypedef uint32_t id_t
ctypedef uint16_t len_t
ctypedef uint16_t tag_t
* Fiddle with data types on Lexeme, to compress them to a much smaller size. 2014-10-30 04:42:15 +00:00			`from libc.stdint cimport uint16_t, uint32_t, uint64_t, uintptr_t`
* Working morphology and lemmatisation. POS tagging quite fast. 2014-12-09 21:09:32 +00:00			`from libc.stdint cimport uint8_t`
* Add typedefs file 2014-09-17 21:10:32 +00:00
* Tmp 2014-12-20 18:36:29 +00:00
* Work on train 2014-12-21 20:25:43 +00:00			`# Reserve 64 values for flag features`
			`cpdef enum attr_id_t:`
			`FLAG0`
			`FLAG1`
			`FLAG2`
			`FLAG3`
			`FLAG4`
			`FLAG5`
			`FLAG6`
			`FLAG7`
			`FLAG8`
			`FLAG9`
			`FLAG10`
			`FLAG11`
			`FLAG12`
			`FLAG13`
			`FLAG14`
			`FLAG15`
			`FLAG16`
			`FLAG17`
			`FLAG18`
			`FLAG19`
			`FLAG20`
			`FLAG21`
			`FLAG22`
			`FLAG23`
			`FLAG24`
			`FLAG25`
			`FLAG26`
			`FLAG27`
			`FLAG28`
			`FLAG29`
			`FLAG30`
			`FLAG31`
			`FLAG32`
			`FLAG33`
			`FLAG34`
			`FLAG35`
			`FLAG36`
			`FLAG37`
			`FLAG38`
			`FLAG39`
			`FLAG40`
			`FLAG41`
			`FLAG42`
			`FLAG43`
			`FLAG44`
			`FLAG45`
			`FLAG46`
			`FLAG47`
			`FLAG48`
			`FLAG49`
			`FLAG50`
			`FLAG51`
			`FLAG52`
			`FLAG53`
			`FLAG54`
			`FLAG55`
			`FLAG56`
			`FLAG57`
			`FLAG58`
			`FLAG59`
			`FLAG60`
			`FLAG61`
			`FLAG62`
			`FLAG63`

			`ID`
* Rename sic to orth 2015-01-22 15:08:25 +00:00			`ORTH`
* Rename NORM1 and NORM2 attrs to lower and norm 2015-01-23 19:17:03 +00:00			`LOWER`
			`NORM`
* Work on train 2014-12-21 20:25:43 +00:00			`SHAPE`
			`PREFIX`
			`SUFFIX`

			`LENGTH`
			`CLUSTER`
			`LEMMA`
* Tmp 2014-12-24 06:42:00 +00:00			`POS`
* Fix Issue #43: TAG attr not supported. Also add DEP attr, while I'm at it. Need better way of ensuring future changes don't break in similar way. 2015-04-07 03:54:53 +00:00			`TAG`
			`DEP`
			`ENT`
* Work on train 2014-12-21 20:25:43 +00:00


* Add typedefs file 2014-09-17 21:10:32 +00:00			`ctypedef uint64_t hash_t`
			`ctypedef char* utf8_t`
* Add typedef for attr_t. Change flag_t to flags_t 2014-12-03 00:06:31 +00:00			`ctypedef uint32_t attr_t`
			`ctypedef uint64_t flags_t`
* Fiddle with data types on Lexeme, to compress them to a much smaller size. 2014-10-30 04:42:15 +00:00			`ctypedef uint32_t id_t`
			`ctypedef uint16_t len_t`
			`ctypedef uint16_t tag_t`