attribute points and weapon mastery requirements

When you use a refund point to take back attribute points you invested, do you get your full attribute points back?
i did this to change from hammer to sword and i think i loss a attribute point for each level i refunded back....(THAT REALLY SUX )

Secondly, I have a sword that requires 11 swordmanship and i only have 7 yet am still able to use it. So whats the deal with that?

you get all the points for the level you refund

you need the required level to get the stats (dmg) of the weapon
yes you can use it but at a penalty til you reach the requirement

edit
you get back all the attribute points but you lose a refund point (easily gotten back) for each level you refund