NeuronBlocks/block_zoo
Flyer Cheng 58ad563a23 Add encoding cache and lazy-train mechanism (#50)
* Add new config about knowledge distillation for query binary classifier

* remove inferenced result in knowledge distillation for query binary classifier

* Add AUC.py in tools folder

* Add test_data_path into conf_kdqbc_bilstmattn_cnn.json

* Modify AUC.py

* Rename AUC.py into calculate_AUC.py

* Modify test&calculate AUC commands for Knowledge Distillation for Query Binary Classifier

* Add cpu_thread_num parameter in conf.training_params

* Rename cpu_thread_num into cpu_num_workers

* update comments in ModelConf.py

* Add cup_num_workers in model_zoo/advanced/conf.json

* Add the description of cpu_num_workers in Tutorial.md

* Update inference speed of compressed model

* Add ProcessorsScheduler Class

* Add license in ProcessorScheduler.py

* use lazy loading instead of one-off loading

* Remove Debug Info in problem.py

* use open instead of codecs.open

* update the inference of build dictionary for classification

* add md5 function in common_utils.py

* add merge_encode_* function

* update typo

* update typo

* reorg the logical flow in train.py

* remove dummy comments in problem.py

* add encoding cache mechanism

* add lazy-load mechanism for training phase

* enumerate problem types in problem.py

* remove data_encoding.py

* add lazy load train logic

* Modify comment and remove debug code

* Judge if test_path exists

* fix parameter missing when use char embedding

* merge master

* add file_column_num in problem.py

* merge add_encoding_cache branch

* add SST-2 in .gitignore

* merge master

* use steps_per_validation instead of valid_times_per_epoch

* Fix Learning Rate decay logic bug

* add log of calculating md5 of training data

* fix multi-gpu char_emb OOM problem & add char leval fix_lengths

* Modify batch_num_to_show_results in multi-gpu

* Modify batch_num_to_show_results

* delete deepcopy in get_batches

* add new parameters chunk_size and max_building_lines in conf and update tutorials
2019-08-02 20:59:00 +08:00
..
attentions Fix concat in interaction layer. (#57) 2019-06-14 14:15:11 +08:00
embedding Add encoding cache and lazy-train mechanism (#50) 2019-08-02 20:59:00 +08:00
encoder_decoder Code commit 2019-04-20 19:17:30 +08:00
math Code commit 2019-04-20 19:17:30 +08:00
normalizations Code commit 2019-04-20 19:17:30 +08:00
op Dev/shining (#75) 2019-07-19 06:26:29 +08:00
transformer Code commit 2019-04-20 19:17:30 +08:00
BaseLayer.py add CRF related block and logic (#67) 2019-06-19 14:44:07 +08:00
BiGRU.py Code commit 2019-04-20 19:17:30 +08:00
BiGRULast.py Code commit 2019-04-20 19:17:30 +08:00
BiLSTM.py Code commit 2019-04-20 19:17:30 +08:00
BiLSTMAtt.py Code commit 2019-04-20 19:17:30 +08:00
BiLSTMLast.py Code commit 2019-04-20 19:17:30 +08:00
BiQRNN.py Code commit 2019-04-20 19:17:30 +08:00
CRF.py add CRF related block and logic (#67) 2019-06-19 14:44:07 +08:00
Conv.py Dev/shining (#75) 2019-07-19 06:26:29 +08:00
Conv2D.py Fix import bug 2019-05-23 20:43:06 +08:00
ConvPooling.py Code commit 2019-04-20 19:17:30 +08:00
Dropout.py Code commit 2019-04-20 19:17:30 +08:00
Embedding.py Add encoding cache and lazy-train mechanism (#50) 2019-08-02 20:59:00 +08:00
EncoderDecoder.py Code commit 2019-04-20 19:17:30 +08:00
HighwayLinear.py Code commit 2019-04-20 19:17:30 +08:00
Linear.py Dev/shining (#75) 2019-07-19 06:26:29 +08:00
Pooling.py Code commit 2019-04-20 19:17:30 +08:00
Pooling1D.py Dev/shining (#75) 2019-07-19 06:26:29 +08:00
Pooling2D.py Add encoding cache and lazy-train mechanism (#50) 2019-08-02 20:59:00 +08:00
Transformer.py Code commit 2019-04-20 19:17:30 +08:00
__init__.py delete Gating and HistogramMapping (#76) 2019-07-22 17:49:50 +08:00