Skip to content
Day 69: new resources are added every day. See what's new

AI use case

Show where the finger tapped in a plain phone screen recording

Phone screen recordings don't show touches, so this developer works them out from the video itself. Simple pixel math in the browser finds when the screen reacts and whether it was a swipe or a tap, and only a pair of small before-and-after stills goes to Gemini to ask what was tapped. The best model found all five taps in a test clip for about two cents per ten taps.

  • Gemini
  • Mobile
  • Design
  • Free tool

Source: DEV ·