The cysteine-rich peptide FEM and the pollen-expressed protein HOM form a genetically linked toxin-antidote system that establishes stylar reproductive barriers in Arabidopsis thaliana, where FEM inhibits heterospecific and some conspecific pollen tube elongation while HOM counteracts this inhibition through direct molecular interaction, and frequent tandem duplications of the FEM-HOM locus during Brassicaceae evolution create dosage imbalances that drive reproductive incompatibility among lineages.

Prezygotic reproductive barriers in angiosperms are crucial for female-mediated selection of compatible male gametes. In this study, we identified a biological activity within the stylar tissues of Arabidopsis thaliana pistils that inhibits the elongation of heterospecific pollen tubes. Using genome-wide association studies, we identified a cysteine-rich peptide predominantly expressed in the style as the responsible barrier. This secreted peptide, named Femme fatale (FEM), inhibited pollen tube elongation of heterospecific species and some conspecific strains, both in vivo and in vitro. Importantly, FEM’s function was independent of the known reproductive barrier component SPRI1 that functions in the stigmatic papilla cell surface. This means two factors act spatially in sequence to create a multilayered reproductive barrier system against pollen in pistils. We also identified a secreted protein expressed in pollen, Homme capable (HOM), which is encoded by a gene next to FEM. HOM interacts with FEM to counteract its barrier effect and allow pollen tube elongation. The FEM–HOM locus has undergone frequent tandem duplications during Brassicaceae evolution. Dosage differences between the two factors can lead to reproductive incompatibility among lineages. Together, our findings suggest that FEM and HOM form a toxin-antidote system that helps establish reproductive barriers.