Effective cancer therapy is one of the biggest global challenges. Conventional cancer therapies have been at the forefront of combating cancers, but more evidence showed considerable side effects, limiting their use. There are various new therapies in development, but combined approaches for treating cancer are much expected. Natural herbs had been traditionally in use for cancer therapy in most parts of the world. In this review, we have examined ten commonly used Chinese herbs that have, for centuries, shown effectiveness in treating cancers. They demonstrated the abilities to promote the apoptosis of cancer cells, inhibit their metastasis, activate the patient’s anticancer immunity, and synergistically increase the efficacy of conventional chemotherapy and radiation therapy when used in combination. Clinical experiences had proved that these herbs and their bioactive compounds were effective against a plethora of cancers through a variety of mechanisms, effectively improving patients’ quality of life without significant side effects. These advantages indicate that there are huge potentials in the development of Chinese herbs into cancer medicine as part of a promising, holistic cancer treatment modality.