- Even fairly recent systems with hybrid UEFI/BIOS still provide an IDE-compatible mode for onboard SATA controllers that should work with Windows 95.
- Windows 95 supports 16-bit MS-DOS drivers and BIOS disk access, so any storage controller with BIOS boot support and/or 16-bit MS-DOS drivers (disk, optical, ASPI) should work.
- Modern video cards still provide SVGA-compatible modes that should work.
- PS/2 keyboard and mouse ports should work.
- Serial and parallel ports should work.
- USB devices with legacy emulation provided by the system's BIOS (floppy, mass storage [hard drive, flash drive], keyboard, mouse, [optical?]) should work, assuming they're plugged in at boot.
Likely problems:
- non-emulated USB devices
- network adapters
- audio
- large amounts of RAM
For network and audio, your best bet would probably be to find a (still relatively recent) machine with pre-Express PCI slots for an older NIC and sound card (some not terribly old workstations and servers have these); while PCIe-to-PCI, and even PCIe-to-ISA, expansion boxes exist, the ones I've seen are both expensive (>$1,000) and hard to find on the used market.