It has been over a decade since the first observation that small non-coding RNAs can functionally modulate epigenetic states in human cells to achieve functional transcriptional gene silencing (TGS). TGS is mechanistically distinct from the RNA interference (RNAi) gene-silencing pathway. TGS can result in long-term stable epigenetic modifications to gene expression that can be passed on to daughter cells during cell division, whereas RNAi does not. Early studies of TGS have been largely overlooked, overshadowed by subsequent discoveries of small RNA-directed post-TGS and RNAi. A reappraisal of early work has been brought about by recent findings in human cells where endogenous long non-coding RNAs function to regulate the epigenome. There are distinct and common overlaps between the proteins involved in small and long non-coding RNA transcriptional regulatory mechanisms, suggesting that the early studies using small non-coding RNAs to modulate transcription were making use of a previously unrecognized endogenous mechanism of RNA-directed gene regulation. Here we review how non-coding RNA plays a role in regulation of transcription and epigenetic gene silencing in human cells by revisiting these earlier studies and the mechanistic insights gained to date. We also provide a list of mammalian genes that have been shown to be transcriptionally regulated by non-coding RNAs. Lastly, we explore how TGS may serve as the basis for development of future therapeutic agents.