How to determine when remote display drops frames?

Question

When I cast via the Remote Display API, sometimes I notice the receiver application drop frames. Is there a way to programmatically determine when frame drop occurs?

Answer 1

Reading through the documentation, it shows that rendering to the remote display session feature is already available for iOS framework. However, you may try if it is possible in Android since it was mentioned that Google Cast Remote Display API (being in beta version), features may change even before official release.

Other implementation that you can do and is already currently available (unfortunately, I haven't actually used it) is through classes that are used to manage various media interfaces as given in android.media. For Android, you can try using MediaCodec.OnFrameRenderedListener. It is a listener to be called when an output frame has rendered on the output surface.

On the other hand, you may also use the Google Cast Remote Display plugin for Unity to be able to use additional classes that are only for Remote Display Unity Plugin.

For more detailed information, please try going through the given documentations and you may also check these helpful references:

• Google Cast Release Notes to be always updated on new releases that can help you with your concern.
• GoogleCastRemoteDisplay in GitHub
• issue in tracker regarding Chromecast dropping frames while buffering for higher quality streams.