This study develops a set of evaluation criteria and a framework for evaluating English learning websites for advanced-level learners, to assist English teachers, course designers and interface designers develop effective sites for advanced users of English and help them screen appropriate and reliable sites to use to improve students’ English ability. To fulfil this objective, a three-phase research procedure has been employed: (a) establishing a preliminary set of criteria from a review of the literature; (b) evaluating and refining the preliminary criteria by distributing a questionnaire to advanced learners and assessing its findings; and (c) validating and finalising the criteria according to the fit between advanced user needs and preliminary criteria identified in the previous phases. The established criteria are classified into two parts: pay-website fit, which includes the three criteria of user fit, material fit and environment fit, and dimensions of language learning, which includes the five criteria of language learning potential, meaning focus, positive impact, authenticity and practicality. Based on qualitative and quantitative analyses of advanced users’ opinions of three ESL/EFL pay-websites, the effectiveness of criteria developed for evaluating such sites are confirmed. With this framework and criteria, the goal is to enable teachers, website designers and course designers to develop quality English language learning websites and to be able to judge reliably the appropriateness of English learning websites for advanced users. This in turn will help learners to increase their English ability more effectively and conveniently when using these websites.