You shouldn't feel guilty at all hon. You can't help being how you are. It's good that you have decent amounts of time where you are okay.
Have you any idea what sets off these panic attacks?
You aren't crazy you just have some issues and they can be overcome or managed :)
Feel free to message me if you like.

xx