We make a proposal for the computation of correlators of 't Hooft loop operators, which were originally introduced as magnetic order parameters of phases in gauge theories. We show that the correlators of 't Hooft loop operators in N=4 Super Yang Mills theory are in complete agreement with the S-duality conjecture, thus exhibiting the action of Electric-Magnetic Duality at the level of correlation functions.