While carrying out logistic regression, the model with most significant variable removed from it(based on p-values)gives the highest accuracy but the improvement in residuance deviance is not better than the null model. Thus which criteria is to be followed the model with best accuracy or model which gives lowest residual deviance, i.e shoudl we remove variables if the accuracy improves or remove the variables if the residual devicnes becomes low? Any reference will be usefull.

Tags: logistic, regression