Stop monitoring subtitles that are removed

I run Bazarr remotely from Plex and use a cloud provider to sync data. Since the cloud provider has a file limit, I move all srt's down from the provider into the same file structure on the Plex server so that only media content is at the cloud provider and I merge the remote path (with media) and local path (with subs) locally so plex sees the union of both.

Whenever I move the srt's and Bazarr can't find them, it tries to download them again. Ideally, I'd want to unmonitor those episodes so the subtitles aren't re-downloaded in the same way that Sonarr/Radarr can unmonitor episodes and movies that it sees as deleted.