solr-map-reduce-example icon indicating copy to clipboard operation
solr-map-reduce-example copied to clipboard

Error- HdfsLockFactory, Requested replication 3 exceeds maximum 1

Open dsmiley opened this issue 10 years ago • 0 comments

I've been trying to try this out but keep running into issues. I've gotten it to this point where one of the Solr nodes tries to start up using HDFS but fails to write the lock file (SOLR-6305 seems related):

ERROR org.apache.solr.store.hdfs.HdfsLockFactory  – Error creating lock file
org.apache.hadoop.ipc.RemoteException(java.io.IOException): file /solr1/collection1/core_node1/data/index/HdfsDirectory@5e0613e0 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@273b003e-write.lock on client 127.0.0.1.
Requested replication 3 exceeds maximum 1

FYI I started by cloning the repo and immediately running the run-example.sh. First it failed because 4.8.0 couldn't be found at the URL indicated so I bumped the rev to 4.8.1 and got past that. Then, I ran into some odd exception pertaining to XPath, which was related to a Java 8 incompatibility with the version of Saxon Solr is using. I bumped Saxon to Saxon-HE-9.6.0-1.jar which resolves that issue. Then I ran into something else that I forget and I dropped my Java version to 1.7 to be safe. This time, the map reduce merging happened but the GoLive stage failed because it couldn't find collection1. The error I saw was confusingly "org.apache.solr.common.cloud.ZooKeeperException: Could not find configName for collection collection1 found:null". I decided to edit the bash script to exit out early before starting the solr nodes so that I could start them by hand. When I started the first node, I ultimately got the Hdfs error pertaining the replication setting that I reported above. (note: I didn't have to start them by hand; I just needed to look at Solr's log files)

dsmiley avatar Oct 05 '14 04:10 dsmiley