From db64df36bf2b1b2ca6946aacf0ee7463ac80c4cb Mon Sep 17 00:00:00 2001 From: Bryan McCann Date: Mon, 27 Aug 2018 23:33:33 -0400 Subject: [PATCH] SOTA WikiSQL details --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 0fdf0cc9..d88c35ea 100644 --- a/README.md +++ b/README.md @@ -101,7 +101,7 @@ tar -xvzf mqan_decanlp_qa_first.tar.gz nvidia-docker run -it --rm -v `pwd`:/decaNLP/ decanlp bash -c "python /decaNLP/predict.py --evaluate validation --path /decaNLP/mqan_decanlp_qa_first --checkpoint_name model.pth --gpu 0" ``` -This model is the best MQAN trained on WikiSQL alone, which establised [a new state-of-the-art performance by several points on that task](https://github.com/salesforce/WikiSQL): 73.2/75.4/81.4 (ordered test logical form accuracy, unordered test logical form accuracy, test execution accuracy. +This model is the best MQAN trained on WikiSQL alone, which establised [a new state-of-the-art performance by several points on that task](https://github.com/salesforce/WikiSQL): 73.2 / 75.4 / 81.4 (ordered test logical form accuracy, unordered test logical form accuracy, test execution accuracy). ```bash wget https://s3.amazonaws.com/research.metamind.io/decaNLP/pretrained/mqan_wikisql.tar.gz