theyaa
theyaa
Any updates on this issue please? Does Dr. Elephant work with Hadoop 3?
hi @ShubhamGupta29 With Hadoop3 and Yarn3, Yarn now uses ATSv2 to capture all Tez jobs since tez reports to ATSv2 now and v1.5. We are using HDP3.1 and I have...
Hi @ShubhamGupta29, in HDP3 Hadoop3, all hive queries run using the Tez engine. And Tez is built to send query updates/progress to Yarn ATSv2. Using Yarn timeline server v1 rest...
@ShubhamGupta29 thank you very much. Please let me know when you have a working version so I can download and try it out.
Hi @shkhrgpt the value is: org.apache.tez.dag.history.logging.proto.ProtoHistoryLoggingService
Hi @shkhrgpt This will cause issues with Yarn and hive logging since Yarn with Hadoop3 and HDP3 logs to Yarn ATSv2 and the latter uses Protobuf and writes to Hbase....
Hi @shkhrgpt Tez+Hive in Hive3 do log all query/dag events to a hive database called sys. Under the sys db, there are 2 tables query_data and dag_data. Those are the...
It is essential to add authentication to Dr Elephant to prevent just anyone to look at the queries submitted to hive on a hadoop cluster. A simple one like PAM...
Thank you for the quick reply. What I am trying to get to is, what if I use a local OWL file, how do I define the value for the...
HIVE: 1.2.1 Tez: 0.8.1.alpha Solr: 5.1 I can't find the stack trace, do not know where it is. I went to ambari-yarn, and looked into the resource manager and I...