You could pause the LSP server. Iirc, this mainly affects edits to Cargo files.