The thing about meddling with time is that one moment something is real, the next, it's been erased. Probability becomes just a possibility. Established truth becomes a theoretical falsehood. Like dominoes, as one timeline falls, the others come cascading down around it. You can engineer new timelines, new possibilities, but before long, the distinction between what is, what was, what might be and what never can be becomes blurred.
Out of this grow myths, lies and legends. The Doctor was one such legend, but no one knows whether he truly ever existed. Well, not now they don't. The Mighty One, ruling the multiverses from the eternal city of Chronopolis, has made sure of that.
A time ram is accidentally initiated by the Valeyard to the Fourth Doctor, when attempting to keep his younger self from reaching Logopolis with the Master. This is implied to be something contrived by the Web of Time.