Sina
29cd73e3a9
Remove loss dropper from setup.py
2021-02-15 11:48:57 -08:00
Giovanni Campagna
b1ba931e71
v0.6.0a2
2021-02-15 09:56:59 -08:00
mehrad
5a33b5acd3
Bring back fast numericalization
...
- bring back multiprocessing via pathos which uses dill instead of pickle to serialize objects; it's faster and can work with lambda functions too
- some refactoring to omit unnecessary processings needed only for NED
2021-02-11 17:36:53 -08:00
mehrad
ce26443b4c
Use python3.9 compatible version for marisa_trie
2021-02-11 17:36:53 -08:00
mehrad
331975865b
Cleanup package dependencies
2021-02-08 01:10:57 -08:00
mehrad
5c327d7983
Pin bootleg commit hash
2021-02-04 15:36:56 -08:00
mehrad
d728465f31
Upgrade ujson version to 4.0.2
2021-02-04 11:34:23 -08:00
mehrad
8aec3e4582
Add tests for bootleg + update relevant files
2021-02-01 13:00:52 -08:00
mehrad
d5d304aafb
Merge branch 'master' into wip/mehrad/bootleg_clean_transformers4.0_master
2021-01-20 11:39:34 -08:00
Jim Deng
ea0c9dedb5
add required package
2021-01-15 02:13:53 +00:00
mehrad
a6adf4f2ae
setup.py: fix typo
2021-01-10 15:00:56 -08:00
mehrad
9b643047f5
Merge branch 'master' into wip/mehrad/bootleg_clean_transformers4.0_master
2021-01-10 12:53:53 -08:00
Sina
bf3c496aac
Add required packages for calibration
2021-01-07 20:38:18 -08:00
mehrad
701f4d003c
Merge branch 'master' into wip/mehrad/master
2021-01-05 00:19:41 -08:00
Sina
15dfff170e
Update `tensorboardX` version
...
Fixes a bug with `purge_step`
2021-01-04 20:10:07 -08:00
mehrad
46b4ddf471
Merge branch 'master' into wip/mehrad/master
2020-12-30 11:14:32 -08:00
mehrad
fb5535e217
Upgrade transformers to 4.1.1
2020-12-29 20:31:36 -08:00
Sina
547749e4f9
Add support for Loss Truncation
...
Loss Truncation is introduced in https://arxiv.org/abs/2004.14589 .
It can potentially improve the quality of our natural language generation
tasks like paraphrasing and `almond_dialogue_nlg`.
2020-12-24 22:30:35 -08:00
mehrad
0b28e52d7d
Merge branch 'wip/mehrad/v0.5.0' into wip/mehrad/master
2020-12-23 12:30:23 -08:00
mehrad
7b865d937c
Merge branch 'wip/mehrad/sts' into mehrad/v0.5.0
2020-12-22 10:30:45 -08:00
mehrad
49d0afcff4
Upgrade sentence-transformers and transformers
2020-12-22 10:29:00 -08:00
Sina
b1473d769c
Change pytorch version to 1.7.1
...
This version of Pytorch fixed a bug that caused severe memory issues
when `transformers` was used with Pytorch's mixed precision
2020-12-20 00:08:03 -08:00
Sina
89b680e4c7
Change transformers version to 4.1.1
...
This version has the implementation for
diverse beam search (https://arxiv.org/abs/1610.02424 ).
2020-12-19 22:59:21 -08:00
Giovanni Campagna
5fd224f16d
v0.6.0a1
2020-12-19 19:26:57 -08:00
Giovanni Campagna
259387848e
Restore sentencepiece dependency
...
We actually need it for XLM-R
2020-12-18 09:23:04 -08:00
Giovanni Campagna
82360e283b
Merge branch 'master' into wip/thingtalk2
2020-12-15 23:19:06 -08:00
Giovanni Campagna
0969c6ea74
v0.5.0
2020-12-15 23:05:58 -08:00
Giovanni Campagna
db8e9fb1ee
Merge remote-tracking branch 'origin/master' into wip/thingtalk2
2020-12-14 21:46:51 -08:00
mehrad
01397f7ed5
Bump transformers version to v4.0.0
2020-12-10 11:50:53 -08:00
mehrad
09bffc74ed
Merge branch 'wip/transformers_bump_4.0.0_rebased' into wip/mehrad/bootleg_clean_transformers4.0
2020-12-09 18:16:45 -08:00
mehrad
437985a2b2
Update sentence-transformers to 0.3.9
2020-12-06 22:24:05 -08:00
mehrad
19128c1a52
Add STS based filtering
2020-12-06 22:16:07 -08:00
Giovanni Campagna
cd6cf37a9e
Remove revtok
2020-12-05 17:37:39 -08:00
mehrad
bb57f0fe7f
Bump transformers version to v4.0.0
2020-12-04 19:34:34 -08:00
mehrad
c0f2a1aeac
setup.py: unpin sentencepiece version
2020-12-04 16:24:45 -08:00
mehrad
8b644cca02
bump transformers version to 3.5.1
2020-12-03 12:50:34 -08:00
mehrad
401af2cf06
Let level 2 of bootleg integration begin
2020-11-30 20:24:42 -08:00
mehrad
70ba9ccd1f
Add bootleg
2020-11-03 14:29:23 -08:00
s-jse
37f80df956
Update minimum pytorch version to 1.6 ( #44 )
...
We have experienced some issues with the transformers library
when pytorch <1.6 is installed.
2020-11-03 14:24:39 -08:00
mehrad
2c23030723
Update setup.py
2020-10-26 23:26:34 -07:00
mehrad
9230361558
Add NER code
2020-10-11 10:16:29 -07:00
Giovanni Campagna
95690abbab
v0.4.0
2020-09-14 17:27:54 -07:00
mehrad
1f6846f35a
setup.py: Remove plotting libraries
2020-09-10 17:55:42 -07:00
Giovanni Campagna
e775457bc0
v0.4.0b1
2020-08-31 21:09:47 -07:00
mehrad
5139c71655
Update python-dateutil version
2020-08-10 15:51:41 -07:00
Giovanni Campagna
74915155fa
v0.4.0a1
2020-08-10 10:47:42 -07:00
mehrad
91a7ea0e2e
Pipfile: set numpy version
2020-07-16 13:41:25 -07:00
mehrad
140a5e0acd
Pipfile: add matplotlib and seaborn
2020-07-16 13:41:25 -07:00
mehrad
40dfeadd2b
upgrade transformers to 2.11
2020-07-16 13:38:48 -07:00
Giovanni Campagna
99968a73ac
v0.3.0
2020-06-08 20:50:28 -07:00