Deepfake detectors have demonstrated vulnerability when faced with adversarial attacks. In real-world scenarios, attackers can generate adversarial examples that mislead detectors through query-based black-box attack methods. Recently, several defense methods against query-based adversarial attacks have achieved promising performance. However, their effectiveness significantly declines when applied to deepfake detection tasks. In this work, we propose a novel defense method specifically designed to counter adversarial attacks in deepfake detection scenarios. Unlike existing approaches, our method focuses on the high-frequency components of images to uncover subtle traces left by adversarial perturbations. Specifically, we analyze the high-frequency residual between similar images within the queries to detect adversarial examples. We evaluate our method against three advanced black-box attack strategies. Extensive experiments demonstrate that our approach achieves highly effective attack detection while significantly reducing FPR.