Allow us to click anywhere on the map with the teleport spell, but the actual placement should 'snap' to the closest structure. Perhaps highlight the structure in green as we move the cursor across the map to indicate where we'll actually teleport to.
It should avoid the current pixel hunts for possible teleport destinations.