@foone
Ooh! Accessibility APIs might help you here; most modern OS situations (not Linux-Wayland) offer a screenreader API and/or braille terminal access. brltty especially might be the interface you want, then you don't need the HDMI capture hardware?
Then you can write your "wait on my behalf while I do something better" scripts to speak braille-tty or screen reader or whatever.