Are the grandparents or the child listed on the protection order? If not, then you can go pick up your child. If they are, then no.
I think you need to talk to a lawyer and you may have to modify the parenting time agreement about pick up and drop off while there's a protection order in place...