Being armed at least gives him a chance to strike back and possibly get away. He was able to find ways to hurt even the armored bulls and the metal dogs. Levi always fights like he's going to die.

"I, uh...I-i dunno. I've never tried to open one of those things or get it off...m-maybe something to pry it off with?"