Parasitic roundworms (nematodes) are significant pathogens of humans and animals and cause substantive socioeconomic losses due to the diseases that they cause. The control of nematodes in livestock animals relies heavily on the use of anthelmintic drugs. However, their extensive use has led to a widespread problem of drug resistance in these worms. Thus, the discovery and development of novel chemical entities for the treatment of parasitic worms of humans and animals is needed. Herein, we describe our medicinal chemistry optimization efforts of a phenotypic hit against Haemonchus contortus based on a pyrrolidine-oxadiazole scaffold. This led to the identification of compounds with potent inhibitory activities (IC50 = 0.78–22.4 μM) on the motility and development of parasitic stages of H. contortus, and which were found to be highly selective in a mammalian cell counter-screen. These compounds could be used as suitable chemical tools for drug target identification or as lead compounds for further optimization.