There is an option in ublock already for that: https://github.com/gorhill/uBlock/wiki/Per-site-switches#no-remote-fonts