Evaluation of Move Method Refactorings Recommendation Algorithms: Are We Doing It Right?

Evgenii Novozhilov, Ivan Veselov, Mikhail Pravilov, and Timofey Bryksin

May, 2019. Published in the proceedings of IWoR'19 (Workshop).

Abstract. Previous studies introduced various techniques for detecting Move Method refactoring opportunities. However, different authors have different evaluations, which leads to the fact that results reported by different papers do not correlate with each other and it is almost impossible to understand which algorithm works better in practice. In this paper, we provide an overview of existing evaluation approaches for Move Method refactoring recommendation algorithms, as well as discuss their advantages and disadvantages. We propose a tool that can be used for generating large synthetic datasets suitable for both algorithms evaluation and building complex machine learning models for Move Method refactoring recommendation.