Background & aims Erectile dysfunction is common among older men and has been associated with low serum 25-hydroxy vitamin D concentration. However, this association may be due to uncontrolled confounding, and there is a paucity of evidence from interventional studies. We aimed to examine the effect of vitamin D supplementation on the prevalence of erectile dysfunction, in an exploratory analysis using data from a large randomized controlled trial. Methods The D-Health Trial recruited Australians aged 60–84 years between January 2014 and May 2015 and randomly assigned them to supplementation with 60,000 IU of vitamin D or placebo per month for up to 5 years. Blood samples were collected annually from randomly selected participants (total N = 3943). We assessed erectile dysfunction at the end of the third year of follow-up. We used log-binomial regression to examine the effect of vitamin D on the prevalence of erectile dysfunction overall, and within sub-groups. Results Of the 11,530 men enrolled, 8920 (77.4 %) completed the erectile dysfunction question and were included in the analysis. After three years of supplementation, the mean serum 25-hydroxy vitamin D concentration was 76 nmol/L (standard deviation (SD) 24.94) in the placebo group and 106 nmol/L (SD 26.76) in the vitamin D group (p < 0.0001). The prevalence of erectile dysfunction was 58.8 % and 59.0 % in the vitamin D and placebo groups, respectively (prevalence ratio 1.00, 95 % CI 0.97, 1.03); there was no evidence of an effect of vitamin D in any subgroup analyses. Conclusion Supplementing older men with vitamin D is unlikely to prevent or improve erectile dysfunction. Clinical trials registry (ACTRN12613000743763).