Single cell sequencing techniques enable researchers view complex bio-tissues from a more precise perspective to identify cell types. However, more and more recent works have been done to find more detailed subtypes within already known cell types. Here, we present MeHi-SCC, a method which utilized meta-learning protocol and brought in multi scRNA-seq datasets' information in order to assist graph-based hierarchical sub-clustering process. In result, MeHi-SCC outperformed current-prevailing scRNA clustering methods and successfully identified cell subtypes in two large scale cell atlas. Our codes and datasets are available online at https://github.com/biomed-AI/MeHi-SCC