How do I cancel my tax credits?

I was awarded tax credit after having a baby, but I am on a work permit and have just found out that I will have problems applying for permanent residence if I claim tax credits. So I need to cancel them asap. Does anyone have any advice?