does not work on ubuntu 16.04

[behramkhan]

I installed amazon-kinesis-agent on an ec2 instance with "Ubuntu Server 16.04 LTS (HVM), SSD Volume Type - ami-0773391ae604c49a4".

The installation works fine and does not complain. But it does not do any processing!!.

There is no log file generated at /var/log/aws-kinesis-agent and its not processing any data. The permissions are all ok as installing rpm with amazon Linux works just fine. So its not permissions/policies issue

{
  "cloudwatch.emitMetrics": true,
  "kinesis.endpoint": "kinesisanalytics.eu-west-1.amazonaws.com",
  "firehose.endpoint": "firehose.eu-west-1.amazonaws.com",
  "flows": [
    {
       "filePattern": "/tmp/WEB1*",
       "deliveryStream": "web-log-ingestion-stream",
       "dataProcessingOptions": [
         {
           "initialPostion": "START_OF_FILE",
           "maxBufferAgeMillis":"2000",
           "optionName": "LOGTOJSON",
           "logFormat": "COMBINEDAPACHELOG"
         }]
    }
  ]
}

sudo service aws-kinesis-agent status

● aws-kinesis-agent.service - LSB: Daemon for Amazon Kinesis Agent.
   Loaded: loaded (/etc/init.d/aws-kinesis-agent; bad; vendor preset: enabled)
   Active: active (exited) since Mon 2018-10-22 15:59:50 UTC; 2s ago
     Docs: man:systemd-sysv-generator(8)
  Process: 5961 ExecStart=/etc/init.d/aws-kinesis-agent start (code=exited, status=0/SUCCESS)

 systemd[1]: Starting LSB: Daemon for Amazon Kinesis Agent....
 aws-kinesis-agent[5961]:  * Starting aws-kinesis-agent
 aws-kinesis-agent[5961]:    ...done.
 systemd[1]: Started LSB: Daemon for Amazon Kinesis Agent..

It just does not process any data and puts nothing in the logs either

[aebch]

Hi behramkhan,

just happened the same to me today. I traced the shell script code to discover the final java CLI, and executed it by hand to discover what is happening, and there is an exception with a: java.lang.NoClassDefFoundError: com/fasterxml/jackson/annotation/JsonMerge

So I checked and there was a change 7 days ago to update jackson libraries: https://github.com/awslabs/amazon-kinesis-agent/commit/cfe4483eba4593a6440f88a93ebbdc194bd518c8

So I edited "setup" script and put previous version of jackson libraries to: jackson-databind-2.6.3.jar jackson-dataformat-cbor-2.6.3.jar

And after that everything works ok again.

So, I think that the previous change must be revised in order to know what is happening.

Thanks.

[SQLadmin]

I tried to edit this setup file with the above mentioned versions, but still, I'm having the issue. I'm running Ubuntu 18.04.

[gabraganca]

If it is of any assistance, I've created a script that helps on the installation on Ubuntu 16.04.

[tonywebscale]

We are having the issue on 16.04 as well.

[tonywebscale]

This works if we do the workaround that @aebch suggested.

[SehoNoh]

@aebch You saved my life. Thank you!