If you use a dropshot or mojo weight, you could attach a short piece of line to the weight before you insert it. Just leave 1/2" or so sticking out of the hole. That way you can easily remove it if you need to. It won't affect the action and isn't big enough to bother the fish :-)