I have noticed pretty much every retina model mac has general UI lag.
Not sure if this program is just too much for the retina display but have you tried turning off/
reducing transparency. Try that and see if you get any better performance.
To make screen recording - open Quicktime and select from file menu “create
new screen recording” Then you have the option to capture all or just and
area.