Introduction: Contrary to stereotypes, Aboriginal and Torres Strait Islander Australians are more likely to abstain from drinking than other Australians. We explored characteristics and experiences of Aboriginal and Torres Strait Islander Australians who do not drink alcohol. Method: We conducted a cross-sectional, representative survey of 775 Aboriginal and Torres Strait Islander Australians (16+ years) in remote and urban South Australia. We explore correlates of not drinking alcohol using multi-level logistic regression. We describe reasons for non-drinking and harms participants experienced in past 12 months from others' drinking. Results: Non-drinking participants were more likely to be older (OR 1.35 [95% CI 1.21, 1.50] per decade) and unemployed (OR 2.72 [95% CI 1.77, 4.20]). Participants who spoke Aboriginal Australian languages at home were three times more likely to be lifetime abstainers from drinking (OR 3.07 [95% CI 1.52, 6.21]). Common reasons for not drinking alcohol were health and family. Most did not report harms from others' alcohol consumption (79.6%, 76.9%, urban and remote respectively). Stress from others' alcohol consumption was the most reported harm by non-drinkers (14.5% and 23.1%, urban and remote, respectively). Discussion and Conclusions: Culture such as speaking Aboriginal Australian languages might have protective effects that promote abstaining but was rarely explicitly cited as a reason for not drinking. A greater understanding of local values held by people who do not drink alcohol could help inform health messaging and other interventions to reduce alcohol-related harms. Understanding local reasons for abstaining can help tailor health messaging to suit local contexts.