You can store your records in a rigid (plastic or metal) open-front magazine holder, such as one of these:
The magazine holders themselves all but disappear when they're placed side-by-side, as seen in this setup:
Image sources: Amazon listing for Acrimet Magazine File Holder, Rubbermaid 96502ROS Deluxe Magazine Rack
