Alzheimer's disease (AD) is the most common cause of dementia among older people, and the prevalence of this disease is estimated to rise quickly in the upcoming years. Unfortunately, almost all of the drug candidates tested for AD until now have failed to exhibit any efficacy. Henceforth, there is an increased necessity to avert and/or slow down the advancement of AD. It is known that one of the major pathological characteristics of AD is the presence of senile plaques (SPs) in the brain. These SPs are composed of aggregated amyloid beta (Aβ), derived from the amyloid precursor protein (APP). Pharmaceutical companies have conducted a number of studies in order to identify safe and effective anti-Aβ drugs to combat AD. It is known that α-, β-, and y-secretases are the three proteases that are involved in APP processing. Furthermore, there is a growing interest in these proteases, as they have a contribution to the modulation and production of Aβ. It has been observed that small compounds can be used to target these important proteases. Indeed, these compounds must satisfy the common strict requirements of a drug candidate targeted for brain penetration and selectivity toward different proteases. In this article, we have focused on the auspicious molecules which are under development for targeting APP-processing enzymes. We have also presented several anti-AD molecules targeting Aβ accumulation and phosphorylation signaling in APP processing. This review highlights the structure-activity relationship and other physicochemical features of several pharmacological candidates in order to successfully develop new anti-AD drugs.