If so, my understanding is that the grandparents would have to prove you an unfit parent to get custody.
Why do the grandparents think they have a right to custody? Is the child living with them at the moment? If so, how did that happen? Do they have a court order? Need a lot more info.