Arms is a great spec for Leveling, Dungeons and PVP, even though you’re Arms spec you can still be a Tank so make sure you keep a one hand weapon and a shield handy for Dungeons. However I will still recommend you use Protection Spec for Leveling, because Protection will still deal A LOT more damage than Arms during leveling. This is because Arms spec will rely very heavily on gear, while Protection spec rely on Talents and Abilities for damage.
Playing protection spec is extremely effective for leveling as Revenge will deal a large amount of damage when combined with Improved Revenge for double damage against two mobs, Protection spec will offer you more single target damage, more AOE damage, more Survivability and will also make you a better tank for Dungeons. The only reason I can think of for you to play Arms spec is just to try a different play style which is ok :).
Unfortunately Fury is a bad spec for early leveling because Raging Blow available at level 31 requires you to be in Berserker Stance and you need to switch stance frequently to Charge and to make things worse Intercept is not available until level 50, Stance Mastery is not available until level 58. So until level 58 you can’t really use your signature ability Raging Blow properly because you have to Charge switch stance and loose all your rage which is very inefficient.