It has nothing to do with a contract. The IRS is very easy to get off your back. There are multiple ways to do it. The best is probably suing them in state court as Pro Se arguing the definitions in 26 USC and 26 CFR