Fay identity: from Mathematical Physics through Geometry to Number Theory

We give a survey of various avatars of the trisecant Fay identity which appear in the context of Integrable systems (as forms of the Associative Yang-Baxter Equation) and as conditions on generating functions for period polynomials of (quasi-)modular forms and group cocycle conditions for some multiparametric modular groups.