Rooba
/
spaCy
mirror of https://github.com/explosion/spaCy.git
1
1
Fork 0
Code Issues Packages Projects Releases Wiki Activity
spaCy/examples/training/textcat_example_data/cooking.json

3487 lines
78 KiB
JSON
Raw Normal View History

Add textcat to train CLI (#4226) * Add doc.cats to spacy.gold at the paragraph level Support `doc.cats` as `"cats": [{"label": string, "value": number}]` in the spacy JSON training format at the paragraph level. * `spacy.gold.docs_to_json()` writes `docs.cats` * `GoldCorpus` reads in cats in each `GoldParse` * Update instances of gold_tuples to handle cats Update iteration over gold_tuples / gold_parses to handle addition of cats at the paragraph level. * Add textcat to train CLI * Add textcat options to train CLI * Add textcat labels in `TextCategorizer.begin_training()` * Add textcat evaluation to `Scorer`: * For binary exclusive classes with provided label: F1 for label * For 2+ exclusive classes: F1 macro average * For multilabel (not exclusive): ROC AUC macro average (currently relying on sklearn) * Provide user info on textcat evaluation settings, potential incompatibilities * Provide pipeline to Scorer in `Language.evaluate` for textcat config * Customize train CLI output to include only metrics relevant to current pipeline * Add textcat evaluation to evaluate CLI * Fix handling of unset arguments and config params Fix handling of unset arguments and model confiug parameters in Scorer initialization. * Temporarily add sklearn requirement * Remove sklearn version number * Improve Scorer handling of models without textcats * Fixing Scorer handling of models without textcats * Update Scorer output for python 2.7 * Modify inf in Scorer for python 2.7 * Auto-format Also make small adjustments to make auto-formatting with black easier and produce nicer results * Move error message to Errors * Update documentation * Add cats to annotation JSON format [ci skip] * Fix tpl flag and docs [ci skip] * Switch to internal roc_auc_score Switch to internal `roc_auc_score()` adapted from scikit-learn. * Add AUCROCScore tests and improve errors/warnings * Add tests for AUCROCScore and roc_auc_score * Add missing error for only positive/negative values * Remove unnecessary warnings and errors * Make reduced roc_auc_score functions private Because most of the checks and warnings have been stripped for the internal functions and access is only intended through `ROCAUCScore`, make the functions for roc_auc_score adapted from scikit-learn private. * Check that data corresponds with multilabel flag Check that the training instances correspond with the multilabel flag, adding the multilabel flag if required. * Add textcat score to early stopping check * Add more checks to debug-data for textcat * Add example training data for textcat * Add more checks to textcat train CLI * Check configuration when extending base model * Fix typos * Update textcat example data * Provide licensing details and licenses for data * Remove two labels with no positive instances from jigsaw-toxic-comment data. Co-authored-by: Ines Montani <ines@ines.io>
2019-09-15 20:31:31 +00:00
[
{
"id":0,
"paragraphs":[
{
"raw":"How should I cook bacon in an oven?\nI've heard of people cooking bacon in an oven by laying the strips out on a cookie sheet. When using this method, how long should I cook the bacon for, and at what temperature?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"How",
"ner":"O"
},
{
"id":1,
"orth":"should",
"ner":"O"
},
{
"id":2,
"orth":"I",
"ner":"O"
},
{
"id":3,
"orth":"cook",
"ner":"O"
},
{
"id":4,
"orth":"bacon",
"ner":"O"
},
{
"id":5,
"orth":"in",
"ner":"O"
},
{
"id":6,
"orth":"an",
"ner":"O"
},
{
"id":7,
"orth":"oven",
"ner":"O"
},
{
"id":8,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":9,
"orth":"\n",
"ner":"O"
},
{
"id":10,
"orth":"I",
"ner":"O"
},
{
"id":11,
"orth":"'ve",
"ner":"O"
},
{
"id":12,
"orth":"heard",
"ner":"O"
},
{
"id":13,
"orth":"of",
"ner":"O"
},
{
"id":14,
"orth":"people",
"ner":"O"
},
{
"id":15,
"orth":"cooking",
"ner":"O"
},
{
"id":16,
"orth":"bacon",
"ner":"O"
},
{
"id":17,
"orth":"in",
"ner":"O"
},
{
"id":18,
"orth":"an",
"ner":"O"
},
{
"id":19,
"orth":"oven",
"ner":"O"
},
{
"id":20,
"orth":"by",
"ner":"O"
},
{
"id":21,
"orth":"laying",
"ner":"O"
},
{
"id":22,
"orth":"the",
"ner":"O"
},
{
"id":23,
"orth":"strips",
"ner":"O"
},
{
"id":24,
"orth":"out",
"ner":"O"
},
{
"id":25,
"orth":"on",
"ner":"O"
},
{
"id":26,
"orth":"a",
"ner":"O"
},
{
"id":27,
"orth":"cookie",
"ner":"O"
},
{
"id":28,
"orth":"sheet",
"ner":"O"
},
{
"id":29,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":30,
"orth":"When",
"ner":"O"
},
{
"id":31,
"orth":"using",
"ner":"O"
},
{
"id":32,
"orth":"this",
"ner":"O"
},
{
"id":33,
"orth":"method",
"ner":"O"
},
{
"id":34,
"orth":",",
"ner":"O"
},
{
"id":35,
"orth":"how",
"ner":"O"
},
{
"id":36,
"orth":"long",
"ner":"O"
},
{
"id":37,
"orth":"should",
"ner":"O"
},
{
"id":38,
"orth":"I",
"ner":"O"
},
{
"id":39,
"orth":"cook",
"ner":"O"
},
{
"id":40,
"orth":"the",
"ner":"O"
},
{
"id":41,
"orth":"bacon",
"ner":"O"
},
{
"id":42,
"orth":"for",
"ner":"O"
},
{
"id":43,
"orth":",",
"ner":"O"
},
{
"id":44,
"orth":"and",
"ner":"O"
},
{
"id":45,
"orth":"at",
"ner":"O"
},
{
"id":46,
"orth":"what",
"ner":"O"
},
{
"id":47,
"orth":"temperature",
"ner":"O"
},
{
"id":48,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":49,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"What is the difference between white and brown eggs?\nI always use brown extra large eggs, but I can't honestly say why I do this other than habit at this point. Are there any distinct advantages or disadvantages like flavor, shelf life, etc?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"What",
"ner":"O"
},
{
"id":1,
"orth":"is",
"ner":"O"
},
{
"id":2,
"orth":"the",
"ner":"O"
},
{
"id":3,
"orth":"difference",
"ner":"O"
},
{
"id":4,
"orth":"between",
"ner":"O"
},
{
"id":5,
"orth":"white",
"ner":"O"
},
{
"id":6,
"orth":"and",
"ner":"O"
},
{
"id":7,
"orth":"brown",
"ner":"O"
},
{
"id":8,
"orth":"eggs",
"ner":"O"
},
{
"id":9,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":10,
"orth":"\n",
"ner":"O"
},
{
"id":11,
"orth":"I",
"ner":"O"
},
{
"id":12,
"orth":"always",
"ner":"O"
},
{
"id":13,
"orth":"use",
"ner":"O"
},
{
"id":14,
"orth":"brown",
"ner":"O"
},
{
"id":15,
"orth":"extra",
"ner":"O"
},
{
"id":16,
"orth":"large",
"ner":"O"
},
{
"id":17,
"orth":"eggs",
"ner":"O"
},
{
"id":18,
"orth":",",
"ner":"O"
},
{
"id":19,
"orth":"but",
"ner":"O"
},
{
"id":20,
"orth":"I",
"ner":"O"
},
{
"id":21,
"orth":"ca",
"ner":"O"
},
{
"id":22,
"orth":"n't",
"ner":"O"
},
{
"id":23,
"orth":"honestly",
"ner":"O"
},
{
"id":24,
"orth":"say",
"ner":"O"
},
{
"id":25,
"orth":"why",
"ner":"O"
},
{
"id":26,
"orth":"I",
"ner":"O"
},
{
"id":27,
"orth":"do",
"ner":"O"
},
{
"id":28,
"orth":"this",
"ner":"O"
},
{
"id":29,
"orth":"other",
"ner":"O"
},
{
"id":30,
"orth":"than",
"ner":"O"
},
{
"id":31,
"orth":"habit",
"ner":"O"
},
{
"id":32,
"orth":"at",
"ner":"O"
},
{
"id":33,
"orth":"this",
"ner":"O"
},
{
"id":34,
"orth":"point",
"ner":"O"
},
{
"id":35,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":36,
"orth":"Are",
"ner":"O"
},
{
"id":37,
"orth":"there",
"ner":"O"
},
{
"id":38,
"orth":"any",
"ner":"O"
},
{
"id":39,
"orth":"distinct",
"ner":"O"
},
{
"id":40,
"orth":"advantages",
"ner":"O"
},
{
"id":41,
"orth":"or",
"ner":"O"
},
{
"id":42,
"orth":"disadvantages",
"ner":"O"
},
{
"id":43,
"orth":"like",
"ner":"O"
},
{
"id":44,
"orth":"flavor",
"ner":"O"
},
{
"id":45,
"orth":",",
"ner":"O"
},
{
"id":46,
"orth":"shelf",
"ner":"O"
},
{
"id":47,
"orth":"life",
"ner":"O"
},
{
"id":48,
"orth":",",
"ner":"O"
},
{
"id":49,
"orth":"etc",
"ner":"O"
},
{
"id":50,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":51,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"What is the difference between baking soda and baking powder?\nAnd can I use one in place of the other in certain recipes?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"What",
"ner":"O"
},
{
"id":1,
"orth":"is",
"ner":"O"
},
{
"id":2,
"orth":"the",
"ner":"O"
},
{
"id":3,
"orth":"difference",
"ner":"O"
},
{
"id":4,
"orth":"between",
"ner":"O"
},
{
"id":5,
"orth":"baking",
"ner":"O"
},
{
"id":6,
"orth":"soda",
"ner":"O"
},
{
"id":7,
"orth":"and",
"ner":"O"
},
{
"id":8,
"orth":"baking",
"ner":"O"
},
{
"id":9,
"orth":"powder",
"ner":"O"
},
{
"id":10,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":11,
"orth":"\n",
"ner":"O"
},
{
"id":12,
"orth":"And",
"ner":"O"
},
{
"id":13,
"orth":"can",
"ner":"O"
},
{
"id":14,
"orth":"I",
"ner":"O"
},
{
"id":15,
"orth":"use",
"ner":"O"
},
{
"id":16,
"orth":"one",
"ner":"O"
},
{
"id":17,
"orth":"in",
"ner":"O"
},
{
"id":18,
"orth":"place",
"ner":"O"
},
{
"id":19,
"orth":"of",
"ner":"O"
},
{
"id":20,
"orth":"the",
"ner":"O"
},
{
"id":21,
"orth":"other",
"ner":"O"
},
{
"id":22,
"orth":"in",
"ner":"O"
},
{
"id":23,
"orth":"certain",
"ner":"O"
},
{
"id":24,
"orth":"recipes",
"ner":"O"
},
{
"id":25,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":26,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"In a tomato sauce recipe, how can I cut the acidity?\nIt seems that every time I make a tomato sauce for pasta, the sauce is a little bit too acid for my taste. I've tried using sugar or sodium bicarbonate, but I'm not satisfied with the results.\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"In",
"ner":"O"
},
{
"id":1,
"orth":"a",
"ner":"O"
},
{
"id":2,
"orth":"tomato",
"ner":"O"
},
{
"id":3,
"orth":"sauce",
"ner":"O"
},
{
"id":4,
"orth":"recipe",
"ner":"O"
},
{
"id":5,
"orth":",",
"ner":"O"
},
{
"id":6,
"orth":"how",
"ner":"O"
},
{
"id":7,
"orth":"can",
"ner":"O"
},
{
"id":8,
"orth":"I",
"ner":"O"
},
{
"id":9,
"orth":"cut",
"ner":"O"
},
{
"id":10,
"orth":"the",
"ner":"O"
},
{
"id":11,
"orth":"acidity",
"ner":"O"
},
{
"id":12,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":13,
"orth":"\n",
"ner":"O"
},
{
"id":14,
"orth":"It",
"ner":"O"
},
{
"id":15,
"orth":"seems",
"ner":"O"
},
{
"id":16,
"orth":"that",
"ner":"O"
},
{
"id":17,
"orth":"every",
"ner":"O"
},
{
"id":18,
"orth":"time",
"ner":"O"
},
{
"id":19,
"orth":"I",
"ner":"O"
},
{
"id":20,
"orth":"make",
"ner":"O"
},
{
"id":21,
"orth":"a",
"ner":"O"
},
{
"id":22,
"orth":"tomato",
"ner":"O"
},
{
"id":23,
"orth":"sauce",
"ner":"O"
},
{
"id":24,
"orth":"for",
"ner":"O"
},
{
"id":25,
"orth":"pasta",
"ner":"O"
},
{
"id":26,
"orth":",",
"ner":"O"
},
{
"id":27,
"orth":"the",
"ner":"O"
},
{
"id":28,
"orth":"sauce",
"ner":"O"
},
{
"id":29,
"orth":"is",
"ner":"O"
},
{
"id":30,
"orth":"a",
"ner":"O"
},
{
"id":31,
"orth":"little",
"ner":"O"
},
{
"id":32,
"orth":"bit",
"ner":"O"
},
{
"id":33,
"orth":"too",
"ner":"O"
},
{
"id":34,
"orth":"acid",
"ner":"O"
},
{
"id":35,
"orth":"for",
"ner":"O"
},
{
"id":36,
"orth":"my",
"ner":"O"
},
{
"id":37,
"orth":"taste",
"ner":"O"
},
{
"id":38,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":39,
"orth":"I",
"ner":"O"
},
{
"id":40,
"orth":"'ve",
"ner":"O"
},
{
"id":41,
"orth":"tried",
"ner":"O"
},
{
"id":42,
"orth":"using",
"ner":"O"
},
{
"id":43,
"orth":"sugar",
"ner":"O"
},
{
"id":44,
"orth":"or",
"ner":"O"
},
{
"id":45,
"orth":"sodium",
"ner":"O"
},
{
"id":46,
"orth":"bicarbonate",
"ner":"O"
},
{
"id":47,
"orth":",",
"ner":"O"
},
{
"id":48,
"orth":"but",
"ner":"O"
},
{
"id":49,
"orth":"I",
"ner":"O"
},
{
"id":50,
"orth":"'m",
"ner":"O"
},
{
"id":51,
"orth":"not",
"ner":"O"
},
{
"id":52,
"orth":"satisfied",
"ner":"O"
},
{
"id":53,
"orth":"with",
"ner":"O"
},
{
"id":54,
"orth":"the",
"ner":"O"
},
{
"id":55,
"orth":"results",
"ner":"O"
},
{
"id":56,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":57,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"What ingredients (available in specific regions) can I substitute for parsley?\nI have a recipe that calls for fresh parsley. I have substituted other fresh herbs for their dried equivalents but I don't have fresh or dried parsley. Is there something else (ex another dried herb) that I can use instead of parsley?\nI know it is used mainly for looks rather than taste but I have a pasta recipe that calls for 2 tablespoons of parsley in the sauce and then another 2 tablespoons on top when it is done. I know the parsley on top is more for looks but there must be something about the taste otherwise it would call for parsley within the sauce as well.\nI would especially like to hear about substitutes available in Southeast Asia and other parts of the world where the obvious answers (such as cilantro) are not widely available.\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"What",
"ner":"O"
},
{
"id":1,
"orth":"ingredients",
"ner":"O"
},
{
"id":2,
"orth":"(",
"ner":"O"
},
{
"id":3,
"orth":"available",
"ner":"O"
},
{
"id":4,
"orth":"in",
"ner":"O"
},
{
"id":5,
"orth":"specific",
"ner":"O"
},
{
"id":6,
"orth":"regions",
"ner":"O"
},
{
"id":7,
"orth":")",
"ner":"O"
},
{
"id":8,
"orth":"can",
"ner":"O"
},
{
"id":9,
"orth":"I",
"ner":"O"
},
{
"id":10,
"orth":"substitute",
"ner":"O"
},
{
"id":11,
"orth":"for",
"ner":"O"
},
{
"id":12,
"orth":"parsley",
"ner":"O"
},
{
"id":13,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":14,
"orth":"\n",
"ner":"O"
},
{
"id":15,
"orth":"I",
"ner":"O"
},
{
"id":16,
"orth":"have",
"ner":"O"
},
{
"id":17,
"orth":"a",
"ner":"O"
},
{
"id":18,
"orth":"recipe",
"ner":"O"
},
{
"id":19,
"orth":"that",
"ner":"O"
},
{
"id":20,
"orth":"calls",
"ner":"O"
},
{
"id":21,
"orth":"for",
"ner":"O"
},
{
"id":22,
"orth":"fresh",
"ner":"O"
},
{
"id":23,
"orth":"parsley",
"ner":"O"
},
{
"id":24,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":25,
"orth":"I",
"ner":"O"
},
{
"id":26,
"orth":"have",
"ner":"O"
},
{
"id":27,
"orth":"substituted",
"ner":"O"
},
{
"id":28,
"orth":"other",
"ner":"O"
},
{
"id":29,
"orth":"fresh",
"ner":"O"
},
{
"id":30,
"orth":"herbs",
"ner":"O"
},
{
"id":31,
"orth":"for",
"ner":"O"
},
{
"id":32,
"orth":"their",
"ner":"O"
},
{
"id":33,
"orth":"dried",
"ner":"O"
},
{
"id":34,
"orth":"equivalents",
"ner":"O"
},
{
"id":35,
"orth":"but",
"ner":"O"
},
{
"id":36,
"orth":"I",
"ner":"O"
},
{
"id":37,
"orth":"do",
"ner":"O"
},
{
"id":38,
"orth":"n't",
"ner":"O"
},
{
"id":39,
"orth":"have",
"ner":"O"
},
{
"id":40,
"orth":"fresh",
"ner":"O"
},
{
"id":41,
"orth":"or",
"ner":"O"
},
{
"id":42,
"orth":"dried",
"ner":"O"
},
{
"id":43,
"orth":"parsley",
"ner":"O"
},
{
"id":44,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":45,
"orth":"Is",
"ner":"O"
},
{
"id":46,
"orth":"there",
"ner":"O"
},
{
"id":47,
"orth":"something",
"ner":"O"
},
{
"id":48,
"orth":"else",
"ner":"O"
},
{
"id":49,
"orth":"(",
"ner":"O"
},
{
"id":50,
"orth":"ex",
"ner":"O"
},
{
"id":51,
"orth":"another",
"ner":"O"
},
{
"id":52,
"orth":"dried",
"ner":"O"
},
{
"id":53,
"orth":"herb",
"ner":"O"
},
{
"id":54,
"orth":")",
"ner":"O"
},
{
"id":55,
"orth":"that",
"ner":"O"
},
{
"id":56,
"orth":"I",
"ner":"O"
},
{
"id":57,
"orth":"can",
"ner":"O"
},
{
"id":58,
"orth":"use",
"ner":"O"
},
{
"id":59,
"orth":"instead",
"ner":"O"
},
{
"id":60,
"orth":"of",
"ner":"O"
},
{
"id":61,
"orth":"parsley",
"ner":"O"
},
{
"id":62,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":63,
"orth":"\n",
"ner":"O"
},
{
"id":64,
"orth":"I",
"ner":"O"
},
{
"id":65,
"orth":"know",
"ner":"O"
},
{
"id":66,
"orth":"it",
"ner":"O"
},
{
"id":67,
"orth":"is",
"ner":"O"
},
{
"id":68,
"orth":"used",
"ner":"O"
},
{
"id":69,
"orth":"mainly",
"ner":"O"
},
{
"id":70,
"orth":"for",
"ner":"O"
},
{
"id":71,
"orth":"looks",
"ner":"O"
},
{
"id":72,
"orth":"rather",
"ner":"O"
},
{
"id":73,
"orth":"than",
"ner":"O"
},
{
"id":74,
"orth":"taste",
"ner":"O"
},
{
"id":75,
"orth":"but",
"ner":"O"
},
{
"id":76,
"orth":"I",
"ner":"O"
},
{
"id":77,
"orth":"have",
"ner":"O"
},
{
"id":78,
"orth":"a",
"ner":"O"
},
{
"id":79,
"orth":"pasta",
"ner":"O"
},
{
"id":80,
"orth":"recipe",
"ner":"O"
},
{
"id":81,
"orth":"that",
"ner":"O"
},
{
"id":82,
"orth":"calls",
"ner":"O"
},
{
"id":83,
"orth":"for",
"ner":"O"
},
{
"id":84,
"orth":"2",
"ner":"O"
},
{
"id":85,
"orth":"tablespoons",
"ner":"O"
},
{
"id":86,
"orth":"of",
"ner":"O"
},
{
"id":87,
"orth":"parsley",
"ner":"O"
},
{
"id":88,
"orth":"in",
"ner":"O"
},
{
"id":89,
"orth":"the",
"ner":"O"
},
{
"id":90,
"orth":"sauce",
"ner":"O"
},
{
"id":91,
"orth":"and",
"ner":"O"
},
{
"id":92,
"orth":"then",
"ner":"O"
},
{
"id":93,
"orth":"another",
"ner":"O"
},
{
"id":94,
"orth":"2",
"ner":"O"
},
{
"id":95,
"orth":"tablespoons",
"ner":"O"
},
{
"id":96,
"orth":"on",
"ner":"O"
},
{
"id":97,
"orth":"top",
"ner":"O"
},
{
"id":98,
"orth":"when",
"ner":"O"
},
{
"id":99,
"orth":"it",
"ner":"O"
},
{
"id":100,
"orth":"is",
"ner":"O"
},
{
"id":101,
"orth":"done",
"ner":"O"
},
{
"id":102,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":103,
"orth":"I",
"ner":"O"
},
{
"id":104,
"orth":"know",
"ner":"O"
},
{
"id":105,
"orth":"the",
"ner":"O"
},
{
"id":106,
"orth":"parsley",
"ner":"O"
},
{
"id":107,
"orth":"on",
"ner":"O"
},
{
"id":108,
"orth":"top",
"ner":"O"
},
{
"id":109,
"orth":"is",
"ner":"O"
},
{
"id":110,
"orth":"more",
"ner":"O"
},
{
"id":111,
"orth":"for",
"ner":"O"
},
{
"id":112,
"orth":"looks",
"ner":"O"
},
{
"id":113,
"orth":"but",
"ner":"O"
},
{
"id":114,
"orth":"there",
"ner":"O"
},
{
"id":115,
"orth":"must",
"ner":"O"
},
{
"id":116,
"orth":"be",
"ner":"O"
},
{
"id":117,
"orth":"something",
"ner":"O"
},
{
"id":118,
"orth":"about",
"ner":"O"
},
{
"id":119,
"orth":"the",
"ner":"O"
},
{
"id":120,
"orth":"taste",
"ner":"O"
},
{
"id":121,
"orth":"otherwise",
"ner":"O"
},
{
"id":122,
"orth":"it",
"ner":"O"
},
{
"id":123,
"orth":"would",
"ner":"O"
},
{
"id":124,
"orth":"call",
"ner":"O"
},
{
"id":125,
"orth":"for",
"ner":"O"
},
{
"id":126,
"orth":"parsley",
"ner":"O"
},
{
"id":127,
"orth":"within",
"ner":"O"
},
{
"id":128,
"orth":"the",
"ner":"O"
},
{
"id":129,
"orth":"sauce",
"ner":"O"
},
{
"id":130,
"orth":"as",
"ner":"O"
},
{
"id":131,
"orth":"well",
"ner":"O"
},
{
"id":132,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":133,
"orth":"\n",
"ner":"O"
},
{
"id":134,
"orth":"I",
"ner":"O"
},
{
"id":135,
"orth":"would",
"ner":"O"
},
{
"id":136,
"orth":"especially",
"ner":"O"
},
{
"id":137,
"orth":"like",
"ner":"O"
},
{
"id":138,
"orth":"to",
"ner":"O"
},
{
"id":139,
"orth":"hear",
"ner":"O"
},
{
"id":140,
"orth":"about",
"ner":"O"
},
{
"id":141,
"orth":"substitutes",
"ner":"O"
},
{
"id":142,
"orth":"available",
"ner":"O"
},
{
"id":143,
"orth":"in",
"ner":"O"
},
{
"id":144,
"orth":"Southeast",
"ner":"O"
},
{
"id":145,
"orth":"Asia",
"ner":"O"
},
{
"id":146,
"orth":"and",
"ner":"O"
},
{
"id":147,
"orth":"other",
"ner":"O"
},
{
"id":148,
"orth":"parts",
"ner":"O"
},
{
"id":149,
"orth":"of",
"ner":"O"
},
{
"id":150,
"orth":"the",
"ner":"O"
},
{
"id":151,
"orth":"world",
"ner":"O"
},
{
"id":152,
"orth":"where",
"ner":"O"
},
{
"id":153,
"orth":"the",
"ner":"O"
},
{
"id":154,
"orth":"obvious",
"ner":"O"
},
{
"id":155,
"orth":"answers",
"ner":"O"
},
{
"id":156,
"orth":"(",
"ner":"O"
},
{
"id":157,
"orth":"such",
"ner":"O"
},
{
"id":158,
"orth":"as",
"ner":"O"
},
{
"id":159,
"orth":"cilantro",
"ner":"O"
},
{
"id":160,
"orth":")",
"ner":"O"
},
{
"id":161,
"orth":"are",
"ner":"O"
},
{
"id":162,
"orth":"not",
"ner":"O"
},
{
"id":163,
"orth":"widely",
"ner":"O"
},
{
"id":164,
"orth":"available",
"ner":"O"
},
{
"id":165,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":166,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"What is the internal temperature a steak should be cooked to for Rare/Medium Rare/Medium/Well?\nI'd like to know when to take my steaks off the grill and please everybody.\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"What",
"ner":"O"
},
{
"id":1,
"orth":"is",
"ner":"O"
},
{
"id":2,
"orth":"the",
"ner":"O"
},
{
"id":3,
"orth":"internal",
"ner":"O"
},
{
"id":4,
"orth":"temperature",
"ner":"O"
},
{
"id":5,
"orth":"a",
"ner":"O"
},
{
"id":6,
"orth":"steak",
"ner":"O"
},
{
"id":7,
"orth":"should",
"ner":"O"
},
{
"id":8,
"orth":"be",
"ner":"O"
},
{
"id":9,
"orth":"cooked",
"ner":"O"
},
{
"id":10,
"orth":"to",
"ner":"O"
},
{
"id":11,
"orth":"for",
"ner":"O"
},
{
"id":12,
"orth":"Rare",
"ner":"O"
},
{
"id":13,
"orth":"/",
"ner":"O"
},
{
"id":14,
"orth":"Medium",
"ner":"O"
},
{
"id":15,
"orth":"Rare",
"ner":"O"
},
{
"id":16,
"orth":"/",
"ner":"O"
},
{
"id":17,
"orth":"Medium",
"ner":"O"
},
{
"id":18,
"orth":"/",
"ner":"O"
},
{
"id":19,
"orth":"Well",
"ner":"O"
},
{
"id":20,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":21,
"orth":"\n",
"ner":"O"
},
{
"id":22,
"orth":"I",
"ner":"O"
},
{
"id":23,
"orth":"'d",
"ner":"O"
},
{
"id":24,
"orth":"like",
"ner":"O"
},
{
"id":25,
"orth":"to",
"ner":"O"
},
{
"id":26,
"orth":"know",
"ner":"O"
},
{
"id":27,
"orth":"when",
"ner":"O"
},
{
"id":28,
"orth":"to",
"ner":"O"
},
{
"id":29,
"orth":"take",
"ner":"O"
},
{
"id":30,
"orth":"my",
"ner":"O"
},
{
"id":31,
"orth":"steaks",
"ner":"O"
},
{
"id":32,
"orth":"off",
"ner":"O"
},
{
"id":33,
"orth":"the",
"ner":"O"
},
{
"id":34,
"orth":"grill",
"ner":"O"
},
{
"id":35,
"orth":"and",
"ner":"O"
},
{
"id":36,
"orth":"please",
"ner":"O"
},
{
"id":37,
"orth":"everybody",
"ner":"O"
},
{
"id":38,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":39,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"How should I poach an egg?\nWhat's the best method to poach an egg without it turning into an eggy soupy mess?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"How",
"ner":"O"
},
{
"id":1,
"orth":"should",
"ner":"O"
},
{
"id":2,
"orth":"I",
"ner":"O"
},
{
"id":3,
"orth":"poach",
"ner":"O"
},
{
"id":4,
"orth":"an",
"ner":"O"
},
{
"id":5,
"orth":"egg",
"ner":"O"
},
{
"id":6,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":7,
"orth":"\n",
"ner":"O"
},
{
"id":8,
"orth":"What",
"ner":"O"
},
{
"id":9,
"orth":"'s",
"ner":"O"
},
{
"id":10,
"orth":"the",
"ner":"O"
},
{
"id":11,
"orth":"best",
"ner":"O"
},
{
"id":12,
"orth":"method",
"ner":"O"
},
{
"id":13,
"orth":"to",
"ner":"O"
},
{
"id":14,
"orth":"poach",
"ner":"O"
},
{
"id":15,
"orth":"an",
"ner":"O"
},
{
"id":16,
"orth":"egg",
"ner":"O"
},
{
"id":17,
"orth":"without",
"ner":"O"
},
{
"id":18,
"orth":"it",
"ner":"O"
},
{
"id":19,
"orth":"turning",
"ner":"O"
},
{
"id":20,
"orth":"into",
"ner":"O"
},
{
"id":21,
"orth":"an",
"ner":"O"
},
{
"id":22,
"orth":"eggy",
"ner":"O"
},
{
"id":23,
"orth":"soupy",
"ner":"O"
},
{
"id":24,
"orth":"mess",
"ner":"O"
},
{
"id":25,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":26,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"How can I make my Ice Cream \"creamier\"\nMy ice cream doesn't feel creamy enough. I got the recipe from Good Eats, and I can't tell if it's just the recipe or maybe that I'm just not getting my \"batter\" cold enough before I try to make it (I let it chill overnight in the refrigerator, but it doesn't always come out of the machine looking like \"soft serve\" as he said on the show - it's usually a little thinner).\nRecipe: http://www.foodnetwork.com/recipes/alton-brown/serious-vanilla-ice-cream-recipe/index.html\nThanks!\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"How",
"ner":"O"
},
{
"id":1,
"orth":"can",
"ner":"O"
},
{
"id":2,
"orth":"I",
"ner":"O"
},
{
"id":3,
"orth":"make",
"ner":"O"
},
{
"id":4,
"orth":"my",
"ner":"O"
},
{
"id":5,
"orth":"Ice",
"ner":"O"
},
{
"id":6,
"orth":"Cream",
"ner":"O"
},
{
"id":7,
"orth":"\"",
"ner":"O"
},
{
"id":8,
"orth":"creamier",
"ner":"O"
},
{
"id":9,
"orth":"\"",
"ner":"O"
},
{
"id":10,
"orth":"\n",
"ner":"O"
},
{
"id":11,
"orth":"My",
"ner":"O"
},
{
"id":12,
"orth":"ice",
"ner":"O"
},
{
"id":13,
"orth":"cream",
"ner":"O"
},
{
"id":14,
"orth":"does",
"ner":"O"
},
{
"id":15,
"orth":"n't",
"ner":"O"
},
{
"id":16,
"orth":"feel",
"ner":"O"
},
{
"id":17,
"orth":"creamy",
"ner":"O"
},
{
"id":18,
"orth":"enough",
"ner":"O"
},
{
"id":19,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":20,
"orth":" ",
"ner":"O"
},
{
"id":21,
"orth":"I",
"ner":"O"
},
{
"id":22,
"orth":"got",
"ner":"O"
},
{
"id":23,
"orth":"the",
"ner":"O"
},
{
"id":24,
"orth":"recipe",
"ner":"O"
},
{
"id":25,
"orth":"from",
"ner":"O"
},
{
"id":26,
"orth":"Good",
"ner":"O"
},
{
"id":27,
"orth":"Eats",
"ner":"O"
},
{
"id":28,
"orth":",",
"ner":"O"
},
{
"id":29,
"orth":"and",
"ner":"O"
},
{
"id":30,
"orth":"I",
"ner":"O"
},
{
"id":31,
"orth":"ca",
"ner":"O"
},
{
"id":32,
"orth":"n't",
"ner":"O"
},
{
"id":33,
"orth":"tell",
"ner":"O"
},
{
"id":34,
"orth":"if",
"ner":"O"
},
{
"id":35,
"orth":"it",
"ner":"O"
},
{
"id":36,
"orth":"'s",
"ner":"O"
},
{
"id":37,
"orth":"just",
"ner":"O"
},
{
"id":38,
"orth":"the",
"ner":"O"
},
{
"id":39,
"orth":"recipe",
"ner":"O"
},
{
"id":40,
"orth":"or",
"ner":"O"
},
{
"id":41,
"orth":"maybe",
"ner":"O"
},
{
"id":42,
"orth":"that",
"ner":"O"
},
{
"id":43,
"orth":"I",
"ner":"O"
},
{
"id":44,
"orth":"'m",
"ner":"O"
},
{
"id":45,
"orth":"just",
"ner":"O"
},
{
"id":46,
"orth":"not",
"ner":"O"
},
{
"id":47,
"orth":"getting",
"ner":"O"
},
{
"id":48,
"orth":"my",
"ner":"O"
},
{
"id":49,
"orth":"\"",
"ner":"O"
},
{
"id":50,
"orth":"batter",
"ner":"O"
},
{
"id":51,
"orth":"\"",
"ner":"O"
},
{
"id":52,
"orth":"cold",
"ner":"O"
},
{
"id":53,
"orth":"enough",
"ner":"O"
},
{
"id":54,
"orth":"before",
"ner":"O"
},
{
"id":55,
"orth":"I",
"ner":"O"
},
{
"id":56,
"orth":"try",
"ner":"O"
},
{
"id":57,
"orth":"to",
"ner":"O"
},
{
"id":58,
"orth":"make",
"ner":"O"
},
{
"id":59,
"orth":"it",
"ner":"O"
},
{
"id":60,
"orth":"(",
"ner":"O"
},
{
"id":61,
"orth":"I",
"ner":"O"
},
{
"id":62,
"orth":"let",
"ner":"O"
},
{
"id":63,
"orth":"it",
"ner":"O"
},
{
"id":64,
"orth":"chill",
"ner":"O"
},
{
"id":65,
"orth":"overnight",
"ner":"O"
},
{
"id":66,
"orth":"in",
"ner":"O"
},
{
"id":67,
"orth":"the",
"ner":"O"
},
{
"id":68,
"orth":"refrigerator",
"ner":"O"
},
{
"id":69,
"orth":",",
"ner":"O"
},
{
"id":70,
"orth":"but",
"ner":"O"
},
{
"id":71,
"orth":"it",
"ner":"O"
},
{
"id":72,
"orth":"does",
"ner":"O"
},
{
"id":73,
"orth":"n't",
"ner":"O"
},
{
"id":74,
"orth":"always",
"ner":"O"
},
{
"id":75,
"orth":"come",
"ner":"O"
},
{
"id":76,
"orth":"out",
"ner":"O"
},
{
"id":77,
"orth":"of",
"ner":"O"
},
{
"id":78,
"orth":"the",
"ner":"O"
},
{
"id":79,
"orth":"machine",
"ner":"O"
},
{
"id":80,
"orth":"looking",
"ner":"O"
},
{
"id":81,
"orth":"like",
"ner":"O"
},
{
"id":82,
"orth":"\"",
"ner":"O"
},
{
"id":83,
"orth":"soft",
"ner":"O"
},
{
"id":84,
"orth":"serve",
"ner":"O"
},
{
"id":85,
"orth":"\"",
"ner":"O"
},
{
"id":86,
"orth":"as",
"ner":"O"
},
{
"id":87,
"orth":"he",
"ner":"O"
},
{
"id":88,
"orth":"said",
"ner":"O"
},
{
"id":89,
"orth":"on",
"ner":"O"
},
{
"id":90,
"orth":"the",
"ner":"O"
},
{
"id":91,
"orth":"show",
"ner":"O"
},
{
"id":92,
"orth":"-",
"ner":"O"
},
{
"id":93,
"orth":"it",
"ner":"O"
},
{
"id":94,
"orth":"'s",
"ner":"O"
},
{
"id":95,
"orth":"usually",
"ner":"O"
},
{
"id":96,
"orth":"a",
"ner":"O"
},
{
"id":97,
"orth":"little",
"ner":"O"
},
{
"id":98,
"orth":"thinner",
"ner":"O"
},
{
"id":99,
"orth":")",
"ner":"O"
},
{
"id":100,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":101,
"orth":"\n",
"ner":"O"
},
{
"id":102,
"orth":"Recipe",
"ner":"O"
},
{
"id":103,
"orth":":",
"ner":"O"
},
{
"id":104,
"orth":"http://www.foodnetwork.com/recipes/alton-brown/serious-vanilla-ice-cream-recipe/index.html",
"ner":"O"
},
{
"id":105,
"orth":"\n",
"ner":"O"
},
{
"id":106,
"orth":"Thanks",
"ner":"O"
},
{
"id":107,
"orth":"!",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":108,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":0.0
},
{
"label":"not_baking",
"value":1.0
}
]
},
{
"raw":"How long and at what temperature do the various parts of a chicken need to be cooked?\nI'm interested in baking thighs, legs, breasts and wings. How long do each of these items need to bake and at what temperature?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"How",
"ner":"O"
},
{
"id":1,
"orth":"long",
"ner":"O"
},
{
"id":2,
"orth":"and",
"ner":"O"
},
{
"id":3,
"orth":"at",
"ner":"O"
},
{
"id":4,
"orth":"what",
"ner":"O"
},
{
"id":5,
"orth":"temperature",
"ner":"O"
},
{
"id":6,
"orth":"do",
"ner":"O"
},
{
"id":7,
"orth":"the",
"ner":"O"
},
{
"id":8,
"orth":"various",
"ner":"O"
},
{
"id":9,
"orth":"parts",
"ner":"O"
},
{
"id":10,
"orth":"of",
"ner":"O"
},
{
"id":11,
"orth":"a",
"ner":"O"
},
{
"id":12,
"orth":"chicken",
"ner":"O"
},
{
"id":13,
"orth":"need",
"ner":"O"
},
{
"id":14,
"orth":"to",
"ner":"O"
},
{
"id":15,
"orth":"be",
"ner":"O"
},
{
"id":16,
"orth":"cooked",
"ner":"O"
},
{
"id":17,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":18,
"orth":"\n",
"ner":"O"
},
{
"id":19,
"orth":"I",
"ner":"O"
},
{
"id":20,
"orth":"'m",
"ner":"O"
},
{
"id":21,
"orth":"interested",
"ner":"O"
},
{
"id":22,
"orth":"in",
"ner":"O"
},
{
"id":23,
"orth":"baking",
"ner":"O"
},
{
"id":24,
"orth":"thighs",
"ner":"O"
},
{
"id":25,
"orth":",",
"ner":"O"
},
{
"id":26,
"orth":"legs",
"ner":"O"
},
{
"id":27,
"orth":",",
"ner":"O"
},
{
"id":28,
"orth":"breasts",
"ner":"O"
},
{
"id":29,
"orth":"and",
"ner":"O"
},
{
"id":30,
"orth":"wings",
"ner":"O"
},
{
"id":31,
"orth":".",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":32,
"orth":" ",
"ner":"O"
},
{
"id":33,
"orth":"How",
"ner":"O"
},
{
"id":34,
"orth":"long",
"ner":"O"
},
{
"id":35,
"orth":"do",
"ner":"O"
},
{
"id":36,
"orth":"each",
"ner":"O"
},
{
"id":37,
"orth":"of",
"ner":"O"
},
{
"id":38,
"orth":"these",
"ner":"O"
},
{
"id":39,
"orth":"items",
"ner":"O"
},
{
"id":40,
"orth":"need",
"ner":"O"
},
{
"id":41,
"orth":"to",
"ner":"O"
},
{
"id":42,
"orth":"bake",
"ner":"O"
},
{
"id":43,
"orth":"and",
"ner":"O"
},
{
"id":44,
"orth":"at",
"ner":"O"
},
{
"id":45,
"orth":"what",
"ner":"O"
},
{
"id":46,
"orth":"temperature",
"ner":"O"
},
{
"id":47,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":48,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":1.0
},
{
"label":"not_baking",
"value":0.0
}
]
},
{
"raw":"Do I need to sift flour that is labeled sifted?\nIs there really an advantage to sifting flour that I bought that was labeled 'sifted'?\n",
"sentences":[
{
"tokens":[
{
"id":0,
"orth":"Do",
"ner":"O"
},
{
"id":1,
"orth":"I",
"ner":"O"
},
{
"id":2,
"orth":"need",
"ner":"O"
},
{
"id":3,
"orth":"to",
"ner":"O"
},
{
"id":4,
"orth":"sift",
"ner":"O"
},
{
"id":5,
"orth":"flour",
"ner":"O"
},
{
"id":6,
"orth":"that",
"ner":"O"
},
{
"id":7,
"orth":"is",
"ner":"O"
},
{
"id":8,
"orth":"labeled",
"ner":"O"
},
{
"id":9,
"orth":"sifted",
"ner":"O"
},
{
"id":10,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":11,
"orth":"\n",
"ner":"O"
},
{
"id":12,
"orth":"Is",
"ner":"O"
},
{
"id":13,
"orth":"there",
"ner":"O"
},
{
"id":14,
"orth":"really",
"ner":"O"
},
{
"id":15,
"orth":"an",
"ner":"O"
},
{
"id":16,
"orth":"advantage",
"ner":"O"
},
{
"id":17,
"orth":"to",
"ner":"O"
},
{
"id":18,
"orth":"sifting",
"ner":"O"
},
{
"id":19,
"orth":"flour",
"ner":"O"
},
{
"id":20,
"orth":"that",
"ner":"O"
},
{
"id":21,
"orth":"I",
"ner":"O"
},
{
"id":22,
"orth":"bought",
"ner":"O"
},
{
"id":23,
"orth":"that",
"ner":"O"
},
{
"id":24,
"orth":"was",
"ner":"O"
},
{
"id":25,
"orth":"labeled",
"ner":"O"
},
{
"id":26,
"orth":"'",
"ner":"O"
},
{
"id":27,
"orth":"sifted",
"ner":"O"
},
{
"id":28,
"orth":"'",
"ner":"O"
},
{
"id":29,
"orth":"?",
"ner":"O"
}
],
"brackets":[
]
},
{
"tokens":[
{
"id":30,
"orth":"\n",
"ner":"O"
}
],
"brackets":[
]
}
],
"cats":[
{
"label":"baking",
"value":1.0
},
{
"label":"not_baking",
"value":0.0
}
]
}
]
}
]