The colonic mucus layer, comprised of highly O-glycosylated mucins, is vital to mediating host-gut microbiota interactions, yet the impact of dietary changes on colonic mucin O-glycosylation and its associations with the gut microbiota remains unexplored. Here, we used an array of omics techniques including glycomics to examine the effect of dietary fiber consumption on the gut microbiota, colonic mucin O-glycosylation and host physiology of high-fat diet-fed C57BL/6J mice. The high-fat diet group had significantly impaired glucose tolerance and altered liver proteome, gut microbiota composition, and short-chain fatty acid production compared to normal chow diet group. While dietary fiber inclusion did not reverse all high fat-induced modifications, it resulted in specific changes, including an increase in the relative abundance of bacterial families with known fiber digesters and a higher propionate concentration. Conversely, colonic mucin O-glycosylation remained similar between the normal chow and high-fat diet groups, while dietary fiber intervention resulted in major alterations in O-glycosylation. Correlation network analysis revealed previously undescribed associations between specific bacteria and mucin glycan structures. For example, the relative abundance of the bacterium Parabacteroides distasonis positively correlated with glycan structures containing one terminal fucose and correlated negatively with glycans containing two terminal fucose residues or with both an N-acetylneuraminic acid and a sulfate residue. This is the first comprehensive report of the impact of dietary fiber on the colonic mucin O-glycosylation and associations of these mucosal glycans with specific gut bacteria.