Improving the reliability of short-term citation impact indicators by taking into account the correlation between short- and long-term citation impact |
| |
| Institution: | 1. School of Information, Shanxi University of Finance & Economics, 030006, Taiyuan, China;2. CNKI, Inc., 100192, Beijing, China;1. College of Liberal Arts and Sciences, National University of Defense Technology, Changsha, China;2. Department of Mathematics, University of California, Los Angeles, USA;1. Faculty of Information Science, KIM IL SUNG University, Pyongyang, Democratic People’s Republic of Korea (DPRK);2. School of Management, Harbin Institute of Technology, Harbin, China;1. Department of Information Management, Nanjing University of Science and Technology, Nanjing, China;2. Department of Network and New Media, Nanjing Normal University, Nanjing, China |
| |
| Abstract: | The normalized citation indicator may not be sufficiently reliable when a short citation time window is used, because the citation counts for recently published papers are not as reliable as those for papers published many years ago. In a limited time period, recent publications usually have insufficient time to accumulate citations and the citation counts of these publications are not sufficiently reliable to be used in the citation impact indicators. However, normalization methods themselves cannot solve this problem. To solve this problem, we introduce a weighting factor to the commonly used normalization indicator Category Normalized Citation Impact (CNCI) at the paper level. The weighting factor, which is calculated as the correlation coefficient between citation counts of papers in the given short citation window and those in the fixed long citation window, reflects the degree of reliability of the CNCI value of one paper. To verify the effect of the proposed weighted CNCI indicator, we compared the CNCI score and CNCI ranking of 500 universities before and after introducing the weighting factor. The results showed that although there was a strong positive correlation before and after the introduction of the weighting factor, some universities’ performance and rankings changed dramatically. |
| |
| Keywords: | Citation time window Field normalization Scientometrics Crown indicator New crown indicator Research evaluation |
| 本文献已被 ScienceDirect 等数据库收录！ |
|
