The aryl hydrocarbon receptor (AhR) plays an important role in several biological processes such as reproduction, immunity and homoeostasis. However, little is known on the chemical-structural and physicochemical features that influence the activity of AhR antagonistic modulators. In the present report, in vitro AhR antagonistic activity evaluations, based on a chemical-activated luciferase gene expression (AhR-CALUX) bioassay, and an extensive literature review were performed with the aim of constructing a structurally diverse database of contaminants and potentially toxic chemicals. Subsequently, QSAR models based on Linear Discriminant Analysis and Logistic Regression, as well as two toxicophoric hypotheses were proposed to model the AhR antagonistic activity of the built dataset. The QSAR models were rigorously validated yielding satisfactory performance for all classification parameters. Likewise, the toxicophoric hypotheses were validated using a diverse set of 350 decoys, demonstrating adequate robustness and predictive power. Chemical interpretations of both the QSAR and toxicophoric models suggested that hydrophobic constraints, the presence of aromatic rings and electron-acceptor moieties are critical for the AhR antagonism. Therefore, it is hoped that the deductions obtained in the present study will contribute to elucidate further on the structural and physicochemical factors influencing the AhR antagonistic activity of chemical compounds.