Replaykit frame rate down to 0.2 with Photos slideshow

I test my broadcast extension with iOS original Photos app slideshow.

At starting time, processSampleBuffer is called 30 times on each second. Frame rate is 30.

But after one picture is shown, processSampleBuffer is not called for 5 sec.


On the broadcast output screen, I see half part of missing screen for 5 sec, and half transparent pictures is shown for 5 sec.


I guess Replaykit daemon detects screen touch and screen updates then call processSampleBuffer. Update detection is not working on slideshow case. Anybody knows workaround?


Thanks,

Up vote post of torui Down vote post of torui
3.2k views
Posted by
torui
Reply
Add a Comment

Replies

I also tested on iOS native clock/stopwatch app, by start and stop. I dump frame bitmap on processSampleBuffer for checking display contents.

I start stopwatch at 00.00 and stoped at 08.14. Our extension got series of callback of 00.14 00.17 ... 08.02, 08.05, 08.07, 08.10.

But no callback until next "start" of stopwatch.

It is quite sure a replaykit deamon did not capture last screen update of 08.14.


Is there some way to get last last screen update?

Miracast Windows or Android call sampling callback every 100ms while screen is no change.

But Replaykit does not call sampling callback while screen is no chnage.


I tested iPadPro(A10X), iOS11.4.


Thanks,

Posted by
torui
Up vote reply of torui Down vote reply of torui
Add a Comment

Similar issues as yours. I have also tested 3rd stopwatch app. Sometimes more than 10 frames have the same image content. More seriously, I got some images are overlapped. It seems like that the data is not ready when comes out.

Posted by
wali1860
Up vote reply of wali1860 Down vote reply of wali1860
Add a Comment