Log spam - java.nio.file.NoSuchFileException: /usr/share/elasticsearch/data/batch_metrics_enabled.conf

[opoplawski]

I'm getting this logged to the journal every 5 seconds:

Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: Oct 29, 2020 6:33:36 AM org.jooq.tools.JooqLogger info
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: Oct 29, 2020 6:33:36 AM org.jooq.tools.JooqLogger info
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: Oct 29, 2020 6:33:36 AM org.jooq.tools.JooqLogger info
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Oct 29 07:33:36  performance-analyzer-agent-cli[13522]: 06:33:36.681 [pa-reader] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.reader.ReaderMetricsProcessor - Error reading file '/usr/share/elasticsearch/data/batch_metrics_enabled.conf': java.nio.file.NoSuchFileException: /usr/share/elasticsearch/data/batch_metrics_enabled.conf
Oct 29 07:33:39  performance-analyzer-agent-cli[13522]: 06:33:39.125 [pa-reader] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.reader.ReaderMetricsProcessor - Error reading file '/usr/share/elasticsearch/data/batch_metrics_enabled.conf': java.nio.file.NoSuchFileException: /usr/share/elasticsearch/data/batch_metrics_enabled.conf

[opoplawski]

Installed from opendistro rpms - opendistro-performance-analyzer-1.11.0.0-1.noarch, no particular configuration of performance analyzer has been done.

[ricardolstephen]

Hi, You can disable this log message by creating the /usr/share/elasticsearch/data/batch_metrics_enabled.conf file with value false:

echo false | sudo tee /usr/share/elasticsearch/data/batch_metrics_enabled.conf

[opoplawski]

Thanks, that helped with that message. Getting lots of these two batches still though:

Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: Nov 06, 2020 7:55:56 AM org.jooq.tools.JooqLogger info
Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: Nov 06, 2020 7:55:56 AM org.jooq.tools.JooqLogger info
Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: Nov 06, 2020 7:55:56 AM org.jooq.tools.JooqLogger info
Nov 06 07:55:56 host performance-analyzer-agent-cli[30782]: INFO: Single batch             : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse
Nov 06 07:55:59 host performance-analyzer-agent-cli[30782]: 07:55:59.082 [SF1wX1Q8QWm3JH9VAGYz-w-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.framework.api.persist.SQLParsingUtil - Eden fails to match any row in field MemType.
Nov 06 07:55:59 host performance-analyzer-agent-cli[30782]: 07:55:59.083 [SF1wX1Q8QWm3JH9VAGYz-w-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.framework.api.persist.SQLParsingUtil - Survivor fails to match any row in field MemType.
Nov 06 07:55:59 host performance-analyzer-agent-cli[30782]: 07:55:59.083 [SF1wX1Q8QWm3JH9VAGYz-w-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.store.collector.NodeConfigCollector - Metric value is NaN for resource:resource_enum: YOUNG_GEN
Nov 06 07:55:59 host performance-analyzer-agent-cli[30782]: metric_enum: HEAP_MAX

[ktkrg]

Thanks @opoplawski for reporting this issue. If you have a PR ready, we're happy to review and accept it.

[hd900415]

me too like this

[apsivam]

@ktkrg I don't have a PR but I guess I found the root cause.

The problem will most likely occur when we use non default data directory (i.e. other than ES_HOME/data).

The performance analyzer plugin correctly retrieves the data directory configured in elasticsearch.yml here but the performance-analyzert-rca plugin assumes the data directory is alway ES_HOME/data here.

Please check if my assumption is correct and if it is, fix.

P.S. a similar fix also required for RCA_ENABLED_CONF_LOCATION here

[gferrette]

Hello!

I've just upgrade my ODFE cluster to last version (1.13.1) and i'm getting these errors on message logs too:

performance-analyzer-agent-cli: 17:31:09.646 [Eu5TbzP6RsWJSyhFbZGP2Q-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.framework.api.persist.SQLParsingUtil - Eden fails to match any row in field MemType. performance-analyzer-agent-cli: 17:31:09.646 [Eu5TbzP6RsWJSyhFbZGP2Q-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.framework.api.persist.SQLParsingUtil - Survivor fails to match any row in field MemType. performance-analyzer-agent-cli: 17:31:09.647 [Eu5TbzP6RsWJSyhFbZGP2Q-task-0-] ERROR com.amazon.opendistro.elasticsearch.performanceanalyzer.rca.store.collector.NodeConfigCollector - Metric value is NaN for resource:resource_enum: YOUNG_GEN

performance-analyzer-agent-cli: Mar 22, 2021 5:30:46 PM org.jooq.tools.JooqLogger info performance-analyzer-agent-cli: INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse performance-analyzer-agent-cli: Mar 22, 2021 5:30:46 PM org.jooq.tools.JooqLogger info performance-analyzer-agent-cli: INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse performance-analyzer-agent-cli: Mar 22, 2021 5:30:46 PM org.jooq.tools.JooqLogger info performance-analyzer-agent-cli: INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse performance-analyzer-agent-cli: Mar 22, 2021 5:30:46 PM org.jooq.tools.JooqLogger info performance-analyzer-agent-cli: INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse performance-analyzer-agent-cli: Mar 22, 2021 5:30:46 PM org.jooq.tools.JooqLogger info performance-analyzer-agent-cli: INFO: Single batch : No bind variables have been provided with a single statement batch execution. This may be due to accidental API misuse

Anyone knows a workround for this?

Thanks in advance!

Gabriel.

[nelly113113]

same issue

[Darkentik]

same issue here It would be good to have a config file for the plugin to manage the path for data. Issue mentioned here too: https://github.com/opendistro-for-elasticsearch/performance-analyzer/issues/206

[ofirnagadi]

Same for me