A bitcoin signer shouldn't have a full Linux stack, high speed lines and a user table.

More complexity => more holes.

Raspberry Pi is just a linux computer, like laptop. With a gigantic world of dependencies. 

At the end of the day, all hardware is specialized. It's just a mater of scope. All parts of most HWW are available off the shelf.