Continuing, ive come to a result which seems more doable with my skillset.
Stumble upon this Starts @ 254s
It boils down to this:
Face with interactable areas

Hovering mouse over the area highlights the are you can adjust

Guy even went so far to add colorpicker for that area

This is all done with blendshapes, so you dont lose the rigged character animations.