Streaming as close to realtime as possible?

[alexanderturner]

I've been wresting ffmpeg to play a stream as close to real time as possible however i'm noticing streams seem to have about 3-5 seconds of buffer in them. Is there any means of accelerating this beyond piping ffmpeg into hacktv, with low buffer and high performance profiles set on the decoder?