Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/spacy/gold.pxd

64 lines
1.3 KiB
Cython
Raw Normal View History

* Refactored transition system code now compiling. Still need to hook up label oracle, and test
2015-02-22 05:32:07 +00:00
from cymem.cymem cimport Pool
* Add file to hold GoldParse class
2015-02-21 16:06:58 +00:00
Example class for training data (#4543) * OrigAnnot class instead of gold.orig_annot list of zipped tuples * from_orig to replace from_annot_tuples * rename to RawAnnot * some unit tests for GoldParse creation and internal format * removing orig_annot and switching to lists instead of tuple * rewriting tuples to use RawAnnot (+ debug statements, WIP) * fix pop() changing the data * small fixes * pop-append fixes * return RawAnnot for existing GoldParse to have uniform interface * clean up imports * fix merge_sents * add unit test for 4402 with new structure (not working yet) * introduce DocAnnot * typo fixes * add unit test for merge_sents * rename from_orig to from_raw * fixing unit tests * fix nn parser * read_annots to produce text, doc_annot pairs * _make_golds fix * rename golds_to_gold_annots * small fixes * fix encoding * have golds_to_gold_annots use DocAnnot * missed a spot * merge_sents as function in DocAnnot * allow specifying only part of the token-level annotations * refactor with Example class + underlying dicts * pipeline components to work with Example objects (wip) * input checking * fix yielding * fix calls to update * small fixes * fix scorer unit test with new format * fix kwargs order * fixes for ud and conllu scripts * fix reading data for conllu script * add in proper errors (not fixed numbering yet to avoid merge conflicts) * fixing few more small bugs * fix EL script
2019-11-11 16:35:27 +00:00
from spacy.tokens import Doc
WIP on stringstore change. 27 failures
2017-05-28 12:06:40 +00:00
from .typedefs cimport attr_t
* Move spacy.syntax.conll to spacy.gold
2015-05-24 19:35:02 +00:00
from .syntax.transition_system cimport Transition
* Tmp
2015-03-09 05:46:22 +00:00
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00
cdef struct GoldParseC:
int* tags
int* heads
Fix arc eager label costs for uint64
2017-05-30 18:37:24 +00:00
int* has_dep
Add support for sent_start to GoldParse
2017-08-26 01:03:14 +00:00
int* sent_start
WIP on stringstore change. 27 failures
2017-05-28 12:06:40 +00:00
attr_t* labels
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00
int** brackets
Transition* ner
* Add file to hold GoldParse class
2015-02-21 16:06:58 +00:00
cdef class GoldParse:
* Refactored transition system code now compiling. Still need to hook up label oracle, and test
2015-02-22 05:32:07 +00:00
cdef Pool mem
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00
cdef GoldParseC c
Example class for training data (#4543) * OrigAnnot class instead of gold.orig_annot list of zipped tuples * from_orig to replace from_annot_tuples * rename to RawAnnot * some unit tests for GoldParse creation and internal format * removing orig_annot and switching to lists instead of tuple * rewriting tuples to use RawAnnot (+ debug statements, WIP) * fix pop() changing the data * small fixes * pop-append fixes * return RawAnnot for existing GoldParse to have uniform interface * clean up imports * fix merge_sents * add unit test for 4402 with new structure (not working yet) * introduce DocAnnot * typo fixes * add unit test for merge_sents * rename from_orig to from_raw * fixing unit tests * fix nn parser * read_annots to produce text, doc_annot pairs * _make_golds fix * rename golds_to_gold_annots * small fixes * fix encoding * have golds_to_gold_annots use DocAnnot * missed a spot * merge_sents as function in DocAnnot * allow specifying only part of the token-level annotations * refactor with Example class + underlying dicts * pipeline components to work with Example objects (wip) * input checking * fix yielding * fix calls to update * small fixes * fix scorer unit test with new format * fix kwargs order * fixes for ud and conllu scripts * fix reading data for conllu script * add in proper errors (not fixed numbering yet to avoid merge conflicts) * fixing few more small bugs * fix EL script
2019-11-11 16:35:27 +00:00
cdef readonly TokenAnnotation orig
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00
* Refactored transition system code now compiling. Still need to hook up label oracle, and test
2015-02-22 05:32:07 +00:00
cdef int length
Make GoldParse attributes writeable
2017-05-22 09:50:29 +00:00
cdef public int loss
cdef public list words
cdef public list tags
Call morph morphology in GoldParse
2018-09-25 19:34:53 +00:00
cdef public list morphology
Make GoldParse attributes writeable
2017-05-22 09:50:29 +00:00
cdef public list heads
cdef public list labels
cdef public dict orths
cdef public list ner
cdef public dict brackets
Example class for training data (#4543) * OrigAnnot class instead of gold.orig_annot list of zipped tuples * from_orig to replace from_annot_tuples * rename to RawAnnot * some unit tests for GoldParse creation and internal format * removing orig_annot and switching to lists instead of tuple * rewriting tuples to use RawAnnot (+ debug statements, WIP) * fix pop() changing the data * small fixes * pop-append fixes * return RawAnnot for existing GoldParse to have uniform interface * clean up imports * fix merge_sents * add unit test for 4402 with new structure (not working yet) * introduce DocAnnot * typo fixes * add unit test for merge_sents * rename from_orig to from_raw * fixing unit tests * fix nn parser * read_annots to produce text, doc_annot pairs * _make_golds fix * rename golds_to_gold_annots * small fixes * fix encoding * have golds_to_gold_annots use DocAnnot * missed a spot * merge_sents as function in DocAnnot * allow specifying only part of the token-level annotations * refactor with Example class + underlying dicts * pipeline components to work with Example objects (wip) * input checking * fix yielding * fix calls to update * small fixes * fix scorer unit test with new format * fix kwargs order * fixes for ud and conllu scripts * fix reading data for conllu script * add in proper errors (not fixed numbering yet to avoid merge conflicts) * fixing few more small bugs * fix EL script
2019-11-11 16:35:27 +00:00
cdef public dict cats
fixes in kb and gold
2019-07-17 15:18:26 +00:00
cdef public dict links
* Refactored transition system code now compiling. Still need to hook up label oracle, and test
2015-02-22 05:32:07 +00:00
* Remove cruft from conll.pyx --- unused stuff about evlauation, which now lives in spacy.scorer
2015-05-24 15:35:49 +00:00
cdef readonly list cand_to_gold
cdef readonly list gold_to_cand
Example class for training data (#4543) * OrigAnnot class instead of gold.orig_annot list of zipped tuples * from_orig to replace from_annot_tuples * rename to RawAnnot * some unit tests for GoldParse creation and internal format * removing orig_annot and switching to lists instead of tuple * rewriting tuples to use RawAnnot (+ debug statements, WIP) * fix pop() changing the data * small fixes * pop-append fixes * return RawAnnot for existing GoldParse to have uniform interface * clean up imports * fix merge_sents * add unit test for 4402 with new structure (not working yet) * introduce DocAnnot * typo fixes * add unit test for merge_sents * rename from_orig to from_raw * fixing unit tests * fix nn parser * read_annots to produce text, doc_annot pairs * _make_golds fix * rename golds_to_gold_annots * small fixes * fix encoding * have golds_to_gold_annots use DocAnnot * missed a spot * merge_sents as function in DocAnnot * allow specifying only part of the token-level annotations * refactor with Example class + underlying dicts * pipeline components to work with Example objects (wip) * input checking * fix yielding * fix calls to update * small fixes * fix scorer unit test with new format * fix kwargs order * fixes for ud and conllu scripts * fix reading data for conllu script * add in proper errors (not fixed numbering yet to avoid merge conflicts) * fixing few more small bugs * fix EL script
2019-11-11 16:35:27 +00:00
cdef class TokenAnnotation:
cdef public list ids
cdef public list words
cdef public list tags
cdef public list heads
cdef public list deps
cdef public list entities
cdef public list morphology
cdef public list brackets
cdef class DocAnnotation:
cdef public object cats
cdef public object links
cdef class Example:
cdef public object doc
cdef public list token_annotations
cdef public DocAnnotation doc_annotation
cdef public object goldparse
* Remove cruft from conll.pyx --- unused stuff about evlauation, which now lives in spacy.scorer
2015-05-24 15:35:49 +00:00
* Have oracle functions take a struct instead of a Python object
2015-06-02 18:01:06 +00:00