causal-text-embeddings icon indicating copy to clipboard operation
causal-text-embeddings copied to clipboard

compute_ate.py has problems

Open yang840808206 opened this issue 5 years ago • 3 comments

Dear : I am doing a peerread experiment now.But BERT only outputs a test_result.tsv,and use this file for compute_ate, I think the code is buggy and cannot run successfully. For example,ate.psi_very_naive don't have a return value. could you update the correct code? thanks

yang840808206 avatar Dec 12 '19 03:12 yang840808206

Can you elaborate on exactly what you're doing and what problem you're seeing?

vveitch avatar Dec 12 '19 19:12 vveitch

I don't know how the .tsv file needed for compute_ate.py or compute_att.py is obtained, and I want to know how the effect is calculated from the tsv file, but without the .tsv file, I can't understand.

And your psi_very_naive.py function in ate.py has no return value.

yang840808206 avatar Dec 13 '19 06:12 yang840808206

First, sorry for the very late reply---I'd completely forgotten there was an open issue here.

Second, the required tsv is output by the training code (it's the predictions of the trained model). I'm still confused what the confusion is. But,

Third, we made a substantially streamlined version of the code in tf2, which will perhaps resolve your problem: https://github.com/vveitch/causal-text-embeddings-tf2

vveitch avatar Apr 05 '20 04:04 vveitch