The main function of these rubber caps is for protecting RCA socket against dust, moisture and oxidation . RCA sockets often get dusty and oxidize over the years. This affects connectivity and results in audio quality lost.
There might be minimal effects on noise reduction and reduction of radio frequencies since these are really cheap products. We believe higher end metal caps do improve sound performance, but not these rubber ones.