Also were you paying child support? If you were not and also not seeing the child, they would have argued abandment.
You will have to ot only file for visitation but challenge the adoption. If you live locally, then go to the clerks office and ask to view the adoption. Even if sealed, you should have the ability to view it as you were an involved party.