ELMoForManyLangs icon indicating copy to clipboard operation
ELMoForManyLangs copied to clipboard

out of memory problem

Open cjf9028 opened this issue 5 years ago • 0 comments

i try to train new elmo model

use thins code

CUDA_VISIBLE_DEVICES=1 python -m elmoformanylangs.biLM train
--train_path data/korean.txt
--config_path configs/cnn_50_100_512_4096_sample.json
--model output/ko
--optimizer adam
--lr 0.001
--lr_decay 0.8
--max_epoch 10
--max_sent_len 20
--max_vocab_size 150000
--min_count 3

after maybe 30min this code suddenly killed

my graphic driver are 2 1080ti
first driver running other code is i type ' CUDA_VISIBLE_DEVICES=1'

how to solve out of memory problem?

and i has 128 ram

cjf9028 avatar Aug 29 '19 06:08 cjf9028