I'm not sure what you're asking regarding the seat back latches. With the seats in the normal position, the seat backs stay put - I have to use the latch releases to fold them forward, just like normal.
When I removed the pads in mine, all it did was allow the seat backs to recline back a little bit.
Here is the best I can offer for comparison. The first pic is Day One of my restoration - the seats have all hardware in-place:
And here's the same seat frames with new Sport Seat upholstery installed without the seat pads. Notice the difference in the angle of the seat back.
I do notice that when I put the seat back to the normal driving position, the latch sometimes doesn't 'click' into place (it just rests on top of the bracket), then when I hop in, it 'pops' into place latching itself. First couple of times it was scary (thinking, "What did I just break?!)... now, it doesn't bother me.
I'm sure that over time, the seat cover fabric might wear against itself, but if that ever becomes a major problem, I'll address it then. After everything I had to do to get this car where it is now, pretty much everything seems trivial to me.