The known oxygenated polyhalogenated diphenyl ether, 2-(2′,4′-dibromophenoxy)-3,5-dibromophenol (1), with previously reported activity in multiple cytotoxicity assays was isolated from the sponge Lamellodysidea sp. and proved to be an amenable scaffold for semisynthetic library generation. The phenol group of 1 was targeted to generate 12 ether analogues in low-to-excellent yields, and the new library was fully characterized by NMR, UV, and MS analyses. The chemical structures for 2, 8, and 9 were additionally determined via single-crystal X-ray diffraction analysis. All natural and semisynthetic compounds were evaluated for their ability to inhibit the growth of DU145, LNCaP, MCF-7, and MDA-MB-231 cancer cell lines. Compound 3 was shown to have near-equivalent activity compared to scaffold 1 in two in vitro assays, and the activity of the compounds with an additional benzyl ring appeared to be reliant on the presence and position of additional halogens.