"Steven [Moffat] and I have both said we thoroughly enjoyed working together, and then there was me being in Wales so the media put two and two together," she explained.
Asked if she'd be excited to play the first female Doctor, Pulver added: "Yes and no. Not if it meant the end of the Doctor Who franchise, because the fans aren't keen on it."
The 31-year-old star also admitted that she has "no idea" if Moffat and Sherlock co-creator Mark Gatiss plans to bring back her character Adler.
"If they want to leave her as a one-episode wonder, then I completely back them," she insisted. "[But] if they do bring her back, I'm sure it will be in the most unexpected, dynamic way they could possibly do."
Pulver previously told Digital Spy that she was keen to reunite with Moffat and Gatiss on Sherlock.
"It would be a privilege to work with Steven, Mark and the entire team [again] on this project and on other projects," she said.