A portal fantasy is when your main character is transported to a new, magical world. The transport being magical is less important than the world they land in being magical. I would consider Outlander a historical romance, though the protagonist is transported to the past by magic. But there is nothing magic where she lands.
Write Well. Publish Better.