Post

Replies

Boosts

Views

Activity

Reply to How to add a video material to a ModelEntity in RealityKit
The code snippet at 4:52 of What's new in RealityKit - https://developer.apple.com/videos/play/wwdc2020/10612/ says to do this... // Use AVFoundation to load a video let asset = AVURLAsset(url: Bundle.main.url(forResource: "glow", withExtension: "mp4")!) let playerItem = AVPlayerItem(asset: asset) // Create a Material and assign it to your model entity... let player = AVPlayer() bugEntity.materials = [VideoMaterial(player: player)] // Tell the player to load and play player.replaceCurrentItem(with: playerItem) player.play() Can you let me know if this works?
Jun ’20
Reply to Video formats and alpha handling.
In the WWDC 2020 session What's new in RealityKit - https://developer.apple.com/videos/play/wwdc2020/10612/ the bug/insect that is shown uses video materials for its wings that are clearly transparent? How was this done? Is the big/insect in the video using video alpha? Or was another way used for that effect?
Jun ’20
Reply to Custom shaders and particle systems in RealityKit
It seems that in RealityKit, video materials are like custom shaders which is kind of ingenious. It looks like there is a different video for each UV Map of a model and then these video segments are packed and put together on a video material atlas that plays as a video. Take a look at In the WWDC 2020 session What's new in RealityKit - https://www.example.com/. This seems like it would allow artists and creatives to create video materials instead of writing shader GPU code. This is really out of the box thinking!
Jun ’20