I'm not familiar with Godot, but I had similar issues with FBX exports to Unity. We were doubling file sizes by exporting all of the Blender rig's bones, instead of just deformation ones. I use a super helpful addon called Game Rig Tools that can convert to an engine-ready rig and bake anim to it.