To remove a Google Font from a project, just delete it in Project settings → fonts → Google fonts.
Note: Elements in the project that still have the font attached when it’s deleted will still display it as being selected, but it will render as Times New Romans.