euphony icon indicating copy to clipboard operation
euphony copied to clipboard

Help

Open zwj2017-NK opened this issue 7 years ago • 12 comments

How to use Euphony efficiently?How the program read android files?I ran code with command ,which as follows: java -jar euphony.jar -e output-dir/ -r reports.vt -CPEO but I failed. Exception in thread "main" java.lang.NullPointerException at clojure.lang.Numbers.ops(Numbers.java:1013) at clojure.lang.Numbers.gte(Numbers.java:233) at euphony.commands.parser$parse.invokeStatic(parser.clj:110) at euphony.commands.parser$parse.doInvoke(parser.clj:103) at clojure.lang.RestFn.invoke(RestFn.java:442) at euphony.tasks$with_parse_mapping_BANG_.invokeStatic(tasks.clj:56) at euphony.tasks$with_parse_mapping_BANG_.invoke(tasks.clj:53) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at euphony.tasks$make_BANG_.invokeStatic(tasks.clj:235) at euphony.tasks$make_BANG_.invoke(tasks.clj:233) at euphony.core$_main.invokeStatic(core.clj:57) at euphony.core$_main.doInvoke(core.clj:51) at clojure.lang.RestFn.applyTo(RestFn.java:137) at euphony.core.main(Unknown Source)

zwj2017-NK avatar Feb 27 '18 01:02 zwj2017-NK

Hello,

Could you post some lines from your reports.vt file ?

From the output, it seems the file cannot be parsed properly.

fmind avatar Feb 27 '18 08:02 fmind

2018-02-27 16-33-35

zwj2017-NK avatar Feb 27 '18 08:02 zwj2017-NK

The reports.vt file derives from the source code.

zwj2017-NK avatar Feb 27 '18 08:02 zwj2017-NK

Thank to your issue, I found a bug that occurs when dataset is very small, like in the example case.

I've pushed a new version in target/uberjar. It works on my environment. Could you please try it ?

fmind avatar Feb 27 '18 12:02 fmind

Thanks a lot. I have a suggestion that if the program can get the data of virustotal report from serveral files, instead of only one.For example, the program can get the input from special directory which includes all virustotal report.

zwj2017-NK avatar May 05 '18 13:05 zwj2017-NK

This is an interesting use case, but I think GNU/Linux commands can handle it already.

For instance, you can use cat to concatenate several files prior to Euphony execution:

cat reports/*.json > reports.vt
java -jar euphony.jar -e output-dir/ -r reports.vt -CPEO

Or if you want to concatenate them during Euphony execution:

java -jar euphony.jar -e output-dir/ -r <(cat reports/*.json) -CPEO

fmind avatar May 07 '18 09:05 fmind

Thank you for your lastest answer. I tried to run this program with a virustotal file which includes over 280,000 records 6 days ago,but it is still running.The setting of our server is as follows: Memory --- 94 GB , CPU --- 16 cores. I want to know how long the program will take. Many thanks.

zwj2017-NK avatar May 11 '18 13:05 zwj2017-NK

The maximum number of records I had to process was 1 million. It took 8 hours to process the reports with my local machine (8 cores, 32 GB or ram with the default settings).

The longest step is the parsing stage. You can tune the time it takes by changing the max-turn parameter (-m). Try with 2 or 3.

fmind avatar May 11 '18 14:05 fmind

java -jar euphony.jar -e -m 2 ./output-dir/ -r reports_new.vt -CPEO, The long-time problem remains, and without an experimental results.

zwj2017-NK avatar Jun 03 '18 08:06 zwj2017-NK

You can send me an email including our reports, I will see if it takes as much time on my computer.

fmind avatar Jun 04 '18 08:06 fmind

I am facing this problem for long time. I tried but failed. please can anyone help????

C:\euphony-master>java -jar euphony.jar -e ./ -r mal_vt_reports.vt -CPEO Exception in thread "main" java.lang.AssertionError: Assert failed: (not-empty labels) at euphony.tasks$with_parse_mapping_BANG_.invokeStatic(tasks.clj:54) at euphony.tasks$with_parse_mapping_BANG_.invoke(tasks.clj:54) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at euphony.tasks$make_BANG_.invokeStatic(tasks.clj:236) at euphony.tasks$make_BANG_.invoke(tasks.clj:234) at euphony.core$_main.invokeStatic(core.clj:59) at euphony.core$_main.doInvoke(core.clj:53) at clojure.lang.RestFn.applyTo(RestFn.java:137) at euphony.core.main(Unknown Source)

sbkorke avatar Jan 31 '23 16:01 sbkorke

I am facing this problem for long time. I tried but failed. please can anyone help????

C:\euphony-master>java -jar euphony.jar -e ./ -r mal_vt_reports.vt -CPEO Exception in thread "main" java.lang.AssertionError: Assert failed: (not-empty labels) at euphony.tasks$with_parse_mapping_BANG_.invokeStatic(tasks.clj:54) at euphony.tasks$with_parse_mapping_BANG_.invoke(tasks.clj:54) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at clojure.core$comp$fn__4727.invoke(core.clj:2460) at euphony.tasks$make_BANG_.invokeStatic(tasks.clj:236) at euphony.tasks$make_BANG_.invoke(tasks.clj:234) at euphony.core$_main.invokeStatic(core.clj:59) at euphony.core$_main.doInvoke(core.clj:53) at clojure.lang.RestFn.applyTo(RestFn.java:137) at euphony.core.main(Unknown Source)

Have you ever solved that? I have encountered the same issue. I use vt-py to get json files(get_json()), and I found that it's doesn't match the program input.

hlyu-hit avatar Feb 17 '23 15:02 hlyu-hit