Supramolecular complexation between photoresponsive azobenzene chromophores and a photopassive polymer host offers synthetic and design advantages compared with conventional covalent azo-containing polymers. In this context, it is important to understand the impact of the strength of the supramolecular interaction on the optical response. Herein, we study the effect of hydrogen-bonding strength between a photopassive polymer host [poly(4-vinylpyridine), or P4VP] and three azobenzene analogues capable of forming weaker (hydroxyl), stronger (carboxylic acid), or no H-bonding with P4VP. The hydroxyl-functionalized azo forms complete H-bonding complexation up to equimolar ratio with VP, whereas the COOH-functionalized azo reaches only up to 30% H-bond complexation due to competing acid dimerization that leads to partial phase separation and azo crystallization. We show that the stronger azo-polymer H-bonding nevertheless provides higher photoin-duced orientation and better performance during optical surface patterning, in terms of grating depth and diffraction efficiency, when phase separation is either avoided altogether or is limited by using relatively low azo contents. These results demonstrate the importance of the H-bonding strength on the photoresponse of azopolymer complexes, as well as the need to consider the interplay between different intermolecular interactions that can affect complexation.