Fathers with mild to moderate intellectual disabilities (ID) are under-represented in research. This article explores the lived childhood experiences of fathers with ID using interpretive phenomenology to understand the meanings ascribed to these experiences and how this has shaped their understanding of self. Rich data was collected through in-depth interviewing of fathers in Poland. The analysis yielded thirteen constituent themes and four superordinate themes: traumatic experiences; resilience; the positive impact of significant others; and becoming a better parent. Many fathers focused on traumatic experiences associated with problematic parental practices (abuse, neglect, parental substance misuse) and discrimination in schools. Participants made meaning of adverse experiences especially resilience, strengths and a determination to be a better parent, which helped them cope with adverse situations. This study provides insights into the impact of lived childhood experiences of these fathers, which in many ways shapes their own parental practices.