I removed the whole 5th gear shaft from the SHO powered Pikes Peak hill climb cars that John Wells built some years ago, but these cars used 30" tall tires and didn't need 5th. We just took whole SHO drivetrains and transplanted them into the back of tube frame hill climb chassis. You just need to weld up the 5th slot in the shift gate.
A side benefit is not having the 5th synchro reduces the mechanical drag on the shift fork mechanism when going into reverse, as the 5th/reverse relay lever moves the 5th synchro left to engage 5th gear, and moves it right to engage reverse. This made it a whole lot easier for the hill climb drivers to engage reverse when they needed it quickly.
Removing 4th would require limiting the travel of the 3/4 synchro assembly, otherwise it will over-travel and spit out its guts. I suppose you could block the gate for 4th as well to prevent this.