We must take into account the number of bytes already consumed from the wrap buffer.
Otherwise, we might end up not merging as much as we must, which may cause errors
in the child nodes.
This bug was quite hard to hit, but it did bite the aac decoder reliably when used in audiod
with UDP + FEC.