The Orbit is an interactive retail experience created by HUSH for HBO Max, deployed in AT&T flagship stores. It used machine learning to let visitors explore over 85,000 clips from HBO's content library through body movements and voice commands
The project won the 2022 Webby Award for Best Responsive/Adaptive Design for Mobile (People's Voice).
Built automated systems that surfaced diverse, relevant scenes from HBO's near-petabyte archive to the interactive front end. Designed a custom multi-task architecture with a shared backbone that jointly optimised for lighting, color, framing, and composition that delivered better performance than multiple individual models while reducing inference costs. Improved in-house datasets for these tasks, built a custom NSFW classifier tailored to the archive, and optimised the pipeline with ONNXRuntime for large-scale processing on AWS.
Also did technical discovery alongside the rest of the team to identify strategies for effective keypoint and face recognition pipelines.
Learn more about the technical details in this blog post.