SkyAR

Why we included this project

SkyAR takes ordinary handheld or dash-cam video and swaps the sky for a background image or effect of your choosing, adjusting lighting and motion so the composite reads as one coherent shot rather than a pasted overlay. It carries the complete PyTorch implementation from the Castle in the Sky paper, with the sky matting, motion estimation, and blending code all in the repo, so you can retrain on your own data or adapt the internals rather than work around a black box. A Google Colab notebook makes it easy to test your own clips before dealing with any local setup. The authors are upfront about limitations such as nighttime footage, which is worth knowing before you plan a real use.