Sand and gravel are the world’s most exploited resources, even surpassing fossil fuels; they are mostly used for producing concrete. On the one hand, due to restrictions on the use of river sand in some regions of the world to conserve riverbeds, the demand for alternative fine aggregates in the construction sector has risen dramatically. The disposal of industrial by-products, on the other hand, is a serious challenge due to stringent environmental requirements. The use of industrial by-products as an alternative fine aggregate in concrete is a long-term, reasonable approach to excessive river mining and industrial by-product disposal. Although previous research on alternative fine aggregates is available, a complete assessment that considers many industrial by-products is lacking. As a result, this paper discusses the possible reuse of five industrial by-products as fine aggregate. The impact of various fine aggregate qualities on concrete attributes – such as flowability, compressive strength, water absorption, chloride permeability, ultrasonic pulse velocity, and drying shrinkage – is critically analysed and contrasted. According to the extensive research, copper slag and recycled glass with replacement amounts ranging from 0% to 100% have the least influence on both the mechanical and durability qualities of concrete. Overall, the qualities of concrete are heavily influenced by the characteristics of various fine particles. Furthermore, a framework for future research and challenges is presented to achieve reliable, eco-friendly, and cost-effective concrete.