It says here the baseband has full access to memory and can compromise it unless IOMMU used, which all the devices GrapheneOS supports have, so it's not an issue