First off, you're not crazy. You might be surprised how common it is to switch therapists during this whole mental health recovery thing. I myself have had to go to several different therapists until I found one that seemed to work for me.
I actually see both a psychiatrist and a psychologist, but the psychologist far more regularly. The psychiatrist, as ems said, is pretty much there for prescribing meds.
And I don't think you should take being referred to a psychologist personally, as maybe it's just because the therapist doesn't feel he/she is adequately trained to give you the help you need. Which doesn't mean you're a problem case by any means - it just means that all doctors have their specialties and perhaps the one you weren't seeing has a different one than what you need.
My last therapist really wanted to help me, but she didn't feel she could give me the support I needed in terms of my self-injury, so she also recommended I look for another psychologist. It wasn't because she thought I was crazy or beyond help, but because she knew there were other people out there who
could help me, and she didn't want to waste my time knowing she couldn't. It may very well be a similar situation for you.
Please don't despair and just try to go to this new psychologist with an open mind. And please let us know how it goes!
*Thinking of you*