Nice ideas. Are you aware of Olin Shivers’ “SRE regular-expression notation” from 1998? http://www.ccs.neu.edu/home/shivers/papers/sre.txt
Shivers proposes (in the context of Scheme) an S-expression notation for regular expressions. The increased layout flexibility of S-expressions goes some way toward the benefits of the graphical syntax you propose here.