A permanent structure is required to take back a part of an easement that was granted. That is why. As I have said many times now, this is not an AP case. OP has no claim to the dominant estate easement.
How about you do some research on the non-use of an easement and if that gives rise to a...