~This is more or less expected as this point~

Video support is still pretty experimental, as stated in the app interface and also here:

20

Video Support

Ability to import and color directly on video files. Exporting video would also be nice but is not an immediate requirement. Video trimming, cutting, cropping and rotating would be awesome to have directly in the app down the line.

rogerio 1 year ago Suggestion

The reasons for this mostly come to down to fact that browsers are still incredibly limited in their capacity to both decode and encode video files and server-side processing is not something I am going to offer for Color.io.

Glitching / jittering can happen for two main reasons:

1. Browser have to native way to know what the original FPS of a video file is. I currently have to estimate the FPS based on deltas in frame presentation times which is a hack. It kind of works but can be skewed by CPU processing load and tends to be off by 1-2 frames on different hardware, not just because browsers drop frames to ensure smooth playback. Again, no way to control that right now.
2. Browsers have no native way to step through a video frame by frame without implementing decoders and demuxers in WebAssembly (which I don't have the capacity to develop right now). Accurate frame seeking would be required for the app to stream individual frames onto the GPU for color and texture processing, before reading them back on the CPU side for piping them into the WebCodecs Encoder (which also relies on accurate FPS - see (1)). Since frame seeking is not supported, I have to manually seek to frames using a similar hack that I use for determining the FPS. Again, there's no way to tell when the browser decides to drop frames.

All of this is why video processing is an unofficial and experimental feature and will remain in that state for the foreseeable future (which doesn't make me happy either 😢)

Potential Fix in Beta version

I just published an update to the beta version with some significant changes to the video encoding mechanism. This update improves things a lot.

I need your guy's feedback to merge this update into the main app! Thanks for your help!

Open Beta Version