Replying to myself, since I found the problem over the weekend, and I'm not (too) afraid of admintting that I am an *****... setting inputReady = true and outputReady = true must be done in the StreamDelegate callback. Everything is working well now.