I think that if you feel able to continue and cope 'normally' without your medication then you should do so. But. How long ago was it that you stopped it?
It may be that the medication still has some resemblance of a level in your system and that it may be a different story once it's drained out.
I'm all for people avoiding meds unless they're completely necessary. I don't think it's stupid to 'forget' them either or want to be able to do this for yourself :)

xx