Deep learning has been used in many applications where patterns from past-trained data can be extracted to predict future outcomes. Deep learning is characterized by training and testing data with the identical input feature space and same data distribution. However, whereas the data distribution is same between the training and testing data, the results might be different. This study introduces input image preprocessing, an enhanced neural network optimization method, and prediction probability ensemble to minimize the number of trainable parameters but maintain the outcome accuracy. In the suggested methodology, input images are separated into pixel interval and the fully connected layer jointly used with saved weights. Outcome results of separated input images are ensembled to the corresponding class probabilities of the original image. The results of the proposed method were compared with those of other previous methods in the image classification task and achieved successful performance accuracies in several datasets.