Honestly, I don't see what seperates the two genres. What's the difference between a wormhole and a portal? Potions and performance-enhancing chemicals? Magic wands and firearms? If I take a science fiction story and replace every instance of the word "technology" with "magic", does it become fantasy?