This is a critique of how designers deal with contending histories and multiple presents in design to speculate about socio-technical futures. The paper unpacks how embedded definitions and assumptions of temporality in current design tools contribute to coloniality in designed futures. As design practice becomes implicated in how oppression extends from physical systems to global digital platforms, our critique rejects the notion that it is only AI that needs fixing and it dissects the Futures Cone used in speculative design to make these issues visible. As an alternative, we offer a hauntological vocabulary to aid designers in reorienting their speculative tools and accommodating pluriversality in anticipatory futures. To illustrate the benefits of the proposed metaphors, we highlight examples of coloniality in digital spaces and emphasize the failure of speculative design to decolonize future imaginaries. Using points of reference from hauntology, those that engage with uncertain states of lingering or spectrality, and notions of nostalgia, absence, and anticipation, this paper contributes to rethinking the role that design tools play in colonizing future imaginaries, especially those pertaining to potentially disruptive technologies.