Temporal question answering (QA) is a special category of complex question answering task that requires reasoning over facts asserting time intervals of events.Previous works have predominately relied on Knowledge Base Question Answering (KBQA) for temporal QA.One of the major challenges faced by these systems is their inability to retrieve all relevant facts due to factors such as incomplete KB and entity/relation linking errors (Patidar et al., 2022).A failure to fetch even a single fact will block KBQA from computing the answer.Such cases of KB incompleteness are even more profound in the temporal context.To address this issue, we explore an interesting direction where a targeted temporal fact extraction technique is used to assist KBQA whenever it fails to retrieve temporal facts from the KB.We model the extraction problem as an open-domain question answering task using offthe-shelf language models.This way, we target to extract from textual resources those facts that failed to get retrieved from the KB.Experimental results on two temporal QA benchmarks show promising ~30% & ~10% relative improvements in answer accuracies without any additional training cost.