Generally an easement will serve one estate and burden another. In your case it sounds like the easement benefits your property and burdens the other since it crosses it. The owner of the property which is benefited by the easement has the right to make improvements to the easement. You should see if any formal documents reference the easement. For example look at the deed records which relate to the property served by the easement and the propety burdened by the easement.

Let me know if you need any help!