Carbonic anhydrase (CA) enzymes, specifically membrane-bound isozymes CA IX and CA XII, underpin a pH-regulating system that enables hypoxic tumor cell survival and proliferation. CA IX and XII are implicated as potential targets for the development of new hypoxic cancer therapies. To date, only a few small molecules have been characterized in CA-relevant cell and animal model systems. In this paper, we describe the development of a new class of carbohydrate-based small molecule CA inhibitors, many of which inhibit CA IX and XII within a narrow range of low nanomolar Ki values (5.3-11.2 nM). We evaluate for the first time carbohydrate-based CA inhibitors in cell-based models that emulate the protective role of CA IX in an acidic tumor microenvironment. Our findings identified two inhibitors (compounds 5 and 17) that block CA IX-induced survival and have potential for development as in vivo cancer cell selective inhibitors.