Kafka init script uses single redirect for $LOG_DIR/server.out

[satish-chef]

We have been using the kafka.init for our kafka nodes since last 3 years. We migrated to st1 EBS 6 months ago and since last couple of weeks, many kafka consumer applications were crashing. After investigation, we found that the log rotation of the file $LOG_DIR/server.out causes a very huge spike of all st1 EBS metrics - readops, writeops, queuelength etc.
As per the link https://stackoverflow.com/a/32000663/9275164, since you are using single redirect in the kafka init script for the log file $LOG_DIR/server.out, the copytruncate is not truncating the file and also converting it into a binary file.
As i said earlier, this server.out log file size increased as the months passed and caused the kafka consumer applications to crash. I wanted to submit a PR for the change but its not allowing me to do so. Please change this line in kafka init script: /sbin/runuser -s /bin/sh $KAFKA_USER -c "nohup $KAFKA_HOME/bin/kafka-server-start.sh $KAFKA_HOME/config/server.properties >> $LOG_DIR/server.out 2> $LOG_DIR/server.err &"

Error i get when i try to push code in your repo: ~/test/kafka-rpm/SOURCES(kafka_bugfix) $ git push Username for 'https://github.com': [email protected] Password for 'https://[email protected]@github.com': remote: Permission to edwardcapriolo/kafka-rpm.git denied to satish-chef. fatal: unable to access 'https://github.com/edwardcapriolo/kafka-rpm.git/': The requested URL returned error: 403

I guess you have disabled git push for your repository.