Could you implement one of the lightweight codec in your program? Like G.711. Here is good overview about it.
This seems like it would be interesting, so I'll take a good look at as soon as I get a chance.