The NADase SARM1 (sterile alpha and TIR motif containing 1) is a key executioner of axon degeneration and a therapeutic target for several neurodegenerative conditions. We show that a potent SARM1 inhibitor undergoes base exchange with the nicotinamide moiety of nicotinamide adenine dinucleotide (NAD+) to produce the bona fide inhibitor 1AD. We report structures of SARM1 in complex with 1AD, NAD+ mimetics and the allosteric activator nicotinamide mononucleotide (NMN). NMN binding triggers reorientation of the armadillo repeat (ARM) domains, which disrupts ARM:TIR interactions and leads to formation of a two-stranded TIR domain assembly. The active site spans two molecules in these assemblies, explaining the requirement of TIR domain self-association for NADase activity and axon degeneration. Our results reveal the mechanisms of SARM1 activation and substrate binding, providing rational avenues for the design of new therapeutics targeting SARM1.