Objective – (1) Present a method of journal appraisal that combines reference list, article download, and survey data. (2) Gauge journal usage patterns across selected universities.

Design – Analysis of reference lists, article downloads, and survey data.

Setting – 28 Canadian universities.

Subjects – 47,012 distinct academic journal titles.

Methods – Download data for the 2011-2015 period was sourced from standard Journal Report 1 (JR1) usage reports as supplied by the vendors. Download figures were summed for journals that were available through multiple platforms. Reference list data (i.e., the number of times documents published in each journal were cited by authors affiliated with a participating institution) was sourced from Clarivate Analytics’ Web of Science, limiting for the years 2011-2015. An unknown number of researchers at 23 of the 28 participating universities were invited by email to complete a survey. The survey asked respondents to list the scholarly journals they considered essential for their research and teaching (up to 10 journals for each purpose).

The three datasets (download, reference list, and survey data) were then merged. Duplicates and non-academic journals were removed. Journals were then grouped into broad discipline areas. A list of “core journals” (p. 228) was created for each institution. These journals produce 80% of downloads, 80% of citations, or 80% of survey mentions at each institution. A journal only had to reach the threshold in one category (i.e., in either downloads, citations, or mentions) to make it onto the core journals list. A “low” (p. 228) survey response rate meant “one mention [was] generally enough" (p. 228) for a journal to be classified as core.

Main results – Fewer than 500 titles (n=484, ~1%) made it to the core journals list at all 28 universities. Two thirds (66%, n unknown) of journals did not make it onto the core list of any university. Of the journals deemed to be core, most (60%, n unknown) were shared across all institutions. On average, platforms from not-for-profit organizations and scientific societies contain a higher proportion of core journals than for-profit platforms. Notably, 63.6% of Springer journals, 58.9% of Taylor & Francis journals, and 45.8% of Elsevier’s journals do not appear on the core journal list of any university.

Conclusion – Libraries should consider ways to share resources and work more cooperatively in their negotiations with publishers. Further, libraries may be able to cancel entire journal bundles without this having a “sizable” (p. 233) impact on resource access.