spaCy/spacy/syntax/transition_system.pxd

from cymem.cymem cimport Pool
from thinc.typedefs cimport weight_t

from ..structs cimport TokenC
from ..gold cimport GoldParse
from ..gold cimport GoldParseC
from ..strings cimport StringStore

from .stateclass cimport StateClass
from ._state cimport StateC


cdef struct Transition:
    int clas
    int move
    int label

    weight_t score

    bint (*is_valid)(const StateC* state, int label) nogil
    weight_t (*get_cost)(StateClass state, const GoldParseC* gold, int label) nogil
    int (*do)(StateC* state, int label) nogil


ctypedef weight_t (*get_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil
ctypedef weight_t (*move_cost_func_t)(StateClass state, const GoldParseC* gold) nogil
ctypedef weight_t (*label_cost_func_t)(StateClass state, const GoldParseC* gold, int label) nogil

ctypedef int (*do_func_t)(StateC* state, int label) nogil

ctypedef void* (*init_state_t)(Pool mem, int length, void* tokens) except NULL

cdef class TransitionSystem:
    cdef Pool mem
    cdef StringStore strings
    cdef Transition* c
    cdef readonly int n_moves
    cdef int _size
    cdef public int root_label
    cdef public freqs
    cdef init_state_t init_beam_state

    cdef int initialize_state(self, StateC* state) nogil
    cdef int finalize_state(self, StateC* state) nogil

    cdef int preprocess_gold(self, GoldParse gold) except -1

    cdef Transition lookup_transition(self, object name) except *

    cdef Transition init_transition(self, int clas, int move, int label) except *

    cdef int set_valid(self, int* output, const StateC* st) nogil

    cdef int set_costs(self, int* is_valid, weight_t* costs,
                       StateClass state, GoldParse gold) except -1
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00			`from cymem.cymem cimport Pool`
			`from thinc.typedefs cimport weight_t`

			`from ..structs cimport TokenC`
* Move spacy.syntax.conll to spacy.gold 2015-05-24 19:35:02 +00:00			`from ..gold cimport GoldParse`
* Have oracle functions take a struct instead of a Python object 2015-06-02 18:01:06 +00:00			`from ..gold cimport GoldParseC`
* Use StringStore to encode label names, instead of label_ids 2015-03-14 15:06:35 +00:00			`from ..strings cimport StringStore`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
* Move StateClass into the interface for is_valid 2015-06-09 21:23:28 +00:00			`from .stateclass cimport StateClass`
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 01:58:14 +00:00			`from ._state cimport StateC`
* Move StateClass into the interface for is_valid 2015-06-09 21:23:28 +00:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
			`cdef struct Transition:`
			`int clas`
			`int move`
			`int label`

			`weight_t score`

* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 01:58:14 +00:00			`bint (is_valid)(const StateC state, int label) nogil`
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 13:31:12 +00:00			`weight_t (get_cost)(StateClass state, const GoldParseC gold, int label) nogil`
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 01:58:14 +00:00			`int (do)(StateC state, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00

* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 13:31:12 +00:00			`ctypedef weight_t (get_cost_func_t)(StateClass state, const GoldParseC gold, int label) nogil`
			`ctypedef weight_t (move_cost_func_t)(StateClass state, const GoldParseC gold) nogil`
			`ctypedef weight_t (label_cost_func_t)(StateClass state, const GoldParseC gold, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 01:58:14 +00:00			`ctypedef int (do_func_t)(StateC state, int label) nogil`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
Allow beam parsing for NER 2017-03-11 17:12:01 +00:00			`ctypedef void* (init_state_t)(Pool mem, int length, void tokens) except NULL`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
			`cdef class TransitionSystem:`
			`cdef Pool mem`
* Use StringStore to encode label names, instead of label_ids 2015-03-14 15:06:35 +00:00			`cdef StringStore strings`
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model 2016-01-19 18:09:33 +00:00			`cdef Transition* c`
* Tmp commit 2015-02-23 19:04:53 +00:00			`cdef readonly int n_moves`
* Allow users to add_label, in order to extend the entity recogniser to new classes. Does not by itself add a class to the model 2016-01-19 18:09:33 +00:00			`cdef int _size`
* Remove gil from parser.call 2015-07-14 21:47:03 +00:00			`cdef public int root_label`
* Serialization round trip now working with decent API, but with rough spots in the organisation and requiring vocabulary to be fixed ahead of time. 2015-07-19 13:18:17 +00:00			`cdef public freqs`
Allow beam parsing for NER 2017-03-11 17:12:01 +00:00			`cdef init_state_t init_beam_state`
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00
* Add a parse_batch method to Parser, that releases the GIL around a batch of documents. 2016-02-01 07:34:55 +00:00			`cdef int initialize_state(self, StateC* state) nogil`
			`cdef int finalize_state(self, StateC* state) nogil`
* NER seems to be working, scoring 69 F. Need to add decision-history features --- currently only use current word, 2 words context. Need refactoring. 2015-03-10 17:00:23 +00:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc. 2015-03-09 11:06:01 +00:00			`cdef int preprocess_gold(self, GoldParse gold) except -1`
Remove trailing whitespace 2015-04-19 08:31:31 +00:00
* Refactoring working for parser, but now need to rig up features for NER, and then debug oracle etc. 2015-03-09 11:06:01 +00:00			`cdef Transition lookup_transition(self, object name) except *`
Remove trailing whitespace 2015-04-19 08:31:31 +00:00
* Add base TransitionSystem class. Still need to rethink how non-monotonic labelling will work for best_valid 2015-02-21 15:38:18 +00:00			`cdef Transition init_transition(self, int clas, int move, int label) except *`

* Pass a StateC pointer into the transition and validation methods in the parser, so that the GIL can be released over a batch of documents 2016-02-01 02:00:15 +00:00			`cdef int set_valid(self, int* output, const StateC* st) nogil`
* Whitespace 2015-08-08 21:35:59 +00:00
* Update for thinc 5.0, including changing cost from int to weight_t, and updating the tagger and parser 2016-01-30 13:31:12 +00:00			`cdef int set_costs(self, int* is_valid, weight_t* costs,`
* Rejig parser interface to use new thinc.api.Example class, in prep of theano model. Comment out beam search 2015-06-26 04:25:36 +00:00			`StateClass state, GoldParse gold) except -1`