tensorflow-nlp-tutorial

tensorflow-nlp-tutorial copied to clipboard

text_preprocessing_tools_for_korean_text.py

[]

https://github.com/ukairia777/tensorflow-nlp-tutorial/blob/main/02.%20Text%20Preprocessing/2-10.%20text_preprocessing_tools_for_korean_text.py 내 파일 내용이 주제와 다른 거 같습니다. 또한, colab 경로도 다른 거 같습니다.

swhan0329

[18-3. kor_bert_nsmc_tpu] TPU 모델 저장

[{"_id":"634be1c28041c95dfb0b0215","body":"\ud604\uc7ac\uae4c\uc9c0 \uc81c\uac00 \uc2dc\ub3c4\ud574\ubd24\ub358 \uc2a4\ub2c8\ud3ab\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4. (\ub458 \ub2e4 \uc548\ub428)\r\n\r\n1.\r\nSAVE\r\n`saved_model_path = '.\/drive\/MyDrive\/savedModel\/model'`\r\n`save_options = tf.saved_model.SaveOptions(experimental_io_device='\/job:localhost')`\r\n`model.save(saved_model_path, options=save_options)`\r\n\r\nLOAD\r\n`load_options = tf.saved_model.LoadOptions(experimental_io_device='\/job:localhost')`\r\n`loaded = tf.keras.models.load_model(saved_model_path, options=load_options)`\r\n\r\n\ubb38\uc81c\uc810\r\n\ubd88\ub7ec\uc628 \ubaa8\ub378\uc744 \uc9c0\uc815\ud55c loaded\uac00 \uc800\uc7a5\ud588\ub358 model\uacfc \ud615\uc2dd\uc774 \ub2e4\ub984.\r\n\r\n\r\n\r\n2.\r\nLOAD\r\n`loaded = TFBertModel.from_pretrained(loaded, from_pt=True)`\r\n\ubb38\uc81c\uc810\r\nOSError: <tensorflow.python.saved_model.load.Loader._recreate_base_user_object.<locals>._UserObject object at 0x7f42ecc5c850> is not a local folder and is not a valid model identifier listed on 'https:\/\/huggingface.co\/models'\r\nIf this is a private repository, make sure to pass a token having permission to this repo with `use_auth_token` or log in with `huggingface-cli login` and pass `use_auth_token=True`.\r\n","issue_id":1660541364247,"origin_id":1106029412,"user_origin_id":56923105,"create_time":1650605883,"update_time":1650605883,"id":1665917378528,"updated_at":"2022-10-16T10:49:38.527000Z","created_at":"2022-10-16T10:49:38.527000Z"},{"_id":"6644d8532308c3a90317bafd","body":"TPU \ubaa8\ub378\uc740 \uc800\uc7a5\uc5d0 \uc5ec\ub7ec \uc560\ub85c \uc0ac\ud56d\uc774 \ub9ce\uc544\uc11c \uc800\uc7a5\ud558\uc2dc\ub824\uba74 GPU \uc0ac\uc6a9\uc744 \uad8c\uc7a5\ud574\ub4dc\ub9ac\uaca0\uc2b5\ub2c8\ub2e4.","issue_id":1660541364247,"origin_id":1506334472,"user_origin_id":73151616,"create_time":1681360831,"update_time":1681360831,"id":1715787859188,"updated_at":"2024-05-15T15:44:19.187000Z","created_at":"2024-05-15T15:44:19.187000Z"}]

안녕하세요! 작가님 덕분에 너무 유용하게 자료들 참고하며 학수하고 있습니다. 질문이 하나 있는데요. 18-3. kor_bert_nsmc_tpu class TFBertForSequenceClassification(tf.keras.Model) 로 정의하여 학습시킨 model = TFBertForSequenceClassification("klue/bert-base") model.fit(train_X, train_y, epochs=2, batch_size=64, validation_split=0.2) results = model.evaluate(test_X,...

YoungNF

CVE-2007-4559 Patch

[]

# Patching CVE-2007-4559 Hi, we are security researchers from the Advanced Research Center at [Trellix](https://www.trellix.com). We have began a campaign to patch a widespread bug named CVE-2007-4559. CVE-2007-4559 is a...

TrellixVulnTeam