Commit Graph

80 Commits

Author SHA1 Message Date
Sina 29cd73e3a9 Remove loss dropper from setup.py 2021-02-15 11:48:57 -08:00
Giovanni Campagna b1ba931e71 v0.6.0a2 2021-02-15 09:56:59 -08:00
mehrad 5a33b5acd3 Bring back fast numericalization
- bring back multiprocessing via pathos which uses dill instead of pickle to serialize objects; it's faster and can work with lambda functions too
- some refactoring to omit unnecessary processings needed only for NED
2021-02-11 17:36:53 -08:00
mehrad ce26443b4c Use python3.9 compatible version for marisa_trie 2021-02-11 17:36:53 -08:00
mehrad 331975865b Cleanup package dependencies 2021-02-08 01:10:57 -08:00
mehrad 5c327d7983 Pin bootleg commit hash 2021-02-04 15:36:56 -08:00
mehrad d728465f31 Upgrade ujson version to 4.0.2 2021-02-04 11:34:23 -08:00
mehrad 8aec3e4582 Add tests for bootleg + update relevant files 2021-02-01 13:00:52 -08:00
mehrad d5d304aafb Merge branch 'master' into wip/mehrad/bootleg_clean_transformers4.0_master 2021-01-20 11:39:34 -08:00
Jim Deng ea0c9dedb5 add required package 2021-01-15 02:13:53 +00:00
mehrad a6adf4f2ae setup.py: fix typo 2021-01-10 15:00:56 -08:00
mehrad 9b643047f5 Merge branch 'master' into wip/mehrad/bootleg_clean_transformers4.0_master 2021-01-10 12:53:53 -08:00
Sina bf3c496aac Add required packages for calibration 2021-01-07 20:38:18 -08:00
mehrad 701f4d003c Merge branch 'master' into wip/mehrad/master 2021-01-05 00:19:41 -08:00
Sina 15dfff170e Update `tensorboardX` version
Fixes a bug with `purge_step`
2021-01-04 20:10:07 -08:00
mehrad 46b4ddf471 Merge branch 'master' into wip/mehrad/master 2020-12-30 11:14:32 -08:00
mehrad fb5535e217 Upgrade transformers to 4.1.1 2020-12-29 20:31:36 -08:00
Sina 547749e4f9 Add support for Loss Truncation
Loss Truncation is introduced in https://arxiv.org/abs/2004.14589.
It can potentially improve the quality of our natural language generation
tasks like paraphrasing and `almond_dialogue_nlg`.
2020-12-24 22:30:35 -08:00
mehrad 0b28e52d7d Merge branch 'wip/mehrad/v0.5.0' into wip/mehrad/master 2020-12-23 12:30:23 -08:00
mehrad 7b865d937c Merge branch 'wip/mehrad/sts' into mehrad/v0.5.0 2020-12-22 10:30:45 -08:00
mehrad 49d0afcff4 Upgrade sentence-transformers and transformers 2020-12-22 10:29:00 -08:00
Sina b1473d769c Change pytorch version to 1.7.1
This version of Pytorch fixed a bug that caused severe memory issues
when `transformers` was used with Pytorch's mixed precision
2020-12-20 00:08:03 -08:00
Sina 89b680e4c7 Change transformers version to 4.1.1
This version has the implementation for
diverse beam search (https://arxiv.org/abs/1610.02424).
2020-12-19 22:59:21 -08:00
Giovanni Campagna 5fd224f16d v0.6.0a1 2020-12-19 19:26:57 -08:00
Giovanni Campagna 259387848e Restore sentencepiece dependency
We actually need it for XLM-R
2020-12-18 09:23:04 -08:00
Giovanni Campagna 82360e283b Merge branch 'master' into wip/thingtalk2 2020-12-15 23:19:06 -08:00
Giovanni Campagna 0969c6ea74 v0.5.0 2020-12-15 23:05:58 -08:00
Giovanni Campagna db8e9fb1ee Merge remote-tracking branch 'origin/master' into wip/thingtalk2 2020-12-14 21:46:51 -08:00
mehrad 01397f7ed5 Bump transformers version to v4.0.0 2020-12-10 11:50:53 -08:00
mehrad 09bffc74ed Merge branch 'wip/transformers_bump_4.0.0_rebased' into wip/mehrad/bootleg_clean_transformers4.0 2020-12-09 18:16:45 -08:00
mehrad 437985a2b2 Update sentence-transformers to 0.3.9 2020-12-06 22:24:05 -08:00
mehrad 19128c1a52 Add STS based filtering 2020-12-06 22:16:07 -08:00
Giovanni Campagna cd6cf37a9e Remove revtok 2020-12-05 17:37:39 -08:00
mehrad bb57f0fe7f Bump transformers version to v4.0.0 2020-12-04 19:34:34 -08:00
mehrad c0f2a1aeac setup.py: unpin sentencepiece version 2020-12-04 16:24:45 -08:00
mehrad 8b644cca02 bump transformers version to 3.5.1 2020-12-03 12:50:34 -08:00
mehrad 401af2cf06 Let level 2 of bootleg integration begin 2020-11-30 20:24:42 -08:00
mehrad 70ba9ccd1f Add bootleg 2020-11-03 14:29:23 -08:00
s-jse 37f80df956
Update minimum pytorch version to 1.6 (#44)
We have experienced some issues with the transformers library
when pytorch <1.6 is installed.
2020-11-03 14:24:39 -08:00
mehrad 2c23030723 Update setup.py 2020-10-26 23:26:34 -07:00
mehrad 9230361558 Add NER code 2020-10-11 10:16:29 -07:00
Giovanni Campagna 95690abbab v0.4.0 2020-09-14 17:27:54 -07:00
mehrad 1f6846f35a setup.py: Remove plotting libraries 2020-09-10 17:55:42 -07:00
Giovanni Campagna e775457bc0 v0.4.0b1 2020-08-31 21:09:47 -07:00
mehrad 5139c71655 Update python-dateutil version 2020-08-10 15:51:41 -07:00
Giovanni Campagna 74915155fa v0.4.0a1 2020-08-10 10:47:42 -07:00
mehrad 91a7ea0e2e Pipfile: set numpy version 2020-07-16 13:41:25 -07:00
mehrad 140a5e0acd Pipfile: add matplotlib and seaborn 2020-07-16 13:41:25 -07:00
mehrad 40dfeadd2b upgrade transformers to 2.11 2020-07-16 13:38:48 -07:00
Giovanni Campagna 99968a73ac v0.3.0 2020-06-08 20:50:28 -07:00