first pass at getting logits to the client code

[ftyers]

First pass at maintaining the output of the acoustic model and returning it to the client. Example output is here. Comments welcome.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[reuben]

Also, please sign the CLA!

[ftyers]

Comments from Matrix:

[ftyers]

@reuben so in this case I should collect them in processBatch, store them in StreamingState? The problem there is that the Metadata is returned in:

Metadata*
ModelState::decode_metadata(const DecoderState& state,
                            size_t num_results)

which has access to only ModelState and DecoderState.

So then I would edit:

Metadata*
StreamingState::intermediateDecodeWithMetadata(unsigned int num_results) const

And have it fill in the logits there?

[ftyers]

Ok, I moved it to StreamingState. There is something I don't like, which is having to reallocate the memory for the metadata because we can't just update the struct apparently:

native_client/stt.cc: In member function 'Metadata* StreamingState::finishStreamWithMetadata(unsigned int)':
native_client/stt.cc:175:18: error: assignment of read-only member 'Metadata::emissions'
  175 |     m->emissions = emissions;
      |     ~~~~~~~~~~~~~^~~~~~~~~~~

Comments welcome!

[ftyers]

Someone else will work on this who can sign the CLA.