No, if you switch secondary proffession, all the attribute points in any of the former secondary profession go back to your pool and you can distribute them anywhere else from your primary or secondary profession. No refund points are taken off when this happens. It has nothing to do with losing points, you still have the same 200 points.
I was wondering if I switch my secondary, say from a mesmer to a monk, and then I decide to switch back to mesmer later, then will I still have all of the skills before i switched the first time available, or will I have to relearn/buy them??? Also, I am assuming you can switch as many times as you want, because I am not quite there in the game yet. Thanks
All of the skills that you have learned on that character will remain even after switching professions. No worries about losing skills due to switching back and forth.