which skills are affected by physical damage and which skills are affected by Magic damage?
All nature and spirit attacks are affected by magic damage so that's basically all of them. Regular attacks with 1h weapons are physical whereas regular attacks with a staff are magic. One skill seems to be physical aswell which is shield bash as it doesnt appear as nature/spirit damage.
So go full on magic I would say