Asus Intros GeForce RTX 4060 Ti Video Card with Integrated M.2 SSD Slot
anandtech.com
anandtech.com
[1] https://www.aliexpress.us/item/3256805824691996.html?spm=a2g...
Even on server class hardware, the split options for a single slot are usually (but not always) 16x, 2* 8x, and 4* 4x - an 8x + 2* 4x option is somewhat unusual.
It’s particularly a problem with huge top of the line GPU’s like the 7900 XTX and 4090. They are so long and so heavy that they sag. To work around it, we have kickstands and brackets that are added on the far end (opposite the external slot) to prop them up. Vertical mounts exist, but they’re a very wide ribbon the same width as the slot that will get in the way of lots of stuff.
Why aren’t we innovating here? Big GPU’s are so big they will often block all the slots on the board anyway. Manufacturers are shifting pcie lanes to m.2 on platforms without many lanes. The slots need to go or remain only for legacy use.
It’ll help with things like this too. The 4060 is using a full slot that it doesn’t need so those wasted lanes are now available for an m.2 card. IMHO all this should be modular like a less polished usb-c/thunderbolt interface. Minisas comes to mind but I know the server market is doing things with pushing pcie over a breakout cable.
ATX feels so antiquated as a form factor right now.
But the issue with GPU sag is AFAIK a different one. Jayz2cents had a pretty good video a while ago demonstrating how to fix sag on the case itself without one of the little stands. From personal experience I can say the Gainward Phantom 4090 doesn’t sag in a Fractal Torrent for example.
Maybe if you’ve got a really great/thick backplate but not all cards do. It’s too much stress regardless.
Infiniband never took off though, though it's still around as a high speed networking interconnect (and gets active development for some industries like HPC).
Everyone in the late-90's recognized that parallel was maxed out and GHz SerDes with embedded clock recovery, adaptive equalization, lane skew compensation, error detection, etc. was the future. Future I/O (IBM, HP, Compaq, 3Com, Cisco, ...) and NGIO (Sun, Dell, Intel, ...) were competing efforts that eventually merged and then rebranded by Intel as InfiniBand. But IB had the usual design-by-committee disease as it tried to shoehorn in networking, io, and system interconnect roles. Intel then bailed from the effort and serialized PCI instead. Intel tried to get back into that game in the 2010's with OmniPath without success.
Thanks. Had a feeling I may have been wrong with "PCIe" term specifically, but couldn't be bothered looking up the exact details. :)
When motherboards are designed, the interference and signal integrity between traces/lanes needs to be calculated and balanced for to avoid those issues, but I'm not sure could be done effectively with flexible electrical cables at PCIe frequencies.
But lets say the interferences and signal integrity were stable. I suspect that for to reduce the number of wires within the cables needed by the PCIe lanes -for to avoid the width of classical IDE hard drives cables or something rigid?- it would be needed to increase the speed of the data transmission for a serialized cable equivalent to the source PCIe parallelized lanes, with frequencies wildly higher.
So, as alternative we would be talking about an hybrid of optical data cables + clocking electrical wires then? but the latency/synchro introduced by the optical transceivers (that would need to work at higher frequencies than PCIe bus), each manufacturer using more optimal or less optimal optical transceivers from different brands, etc, I suspect that would introduce a new kind of issue invading the users forums (or maybe not, nevertheless I smell it) due such cables.
The matter is, maybe the above could reduce a bit the size of the motherboard, but not the volume occupied by the targeted devices (lets say GPU), it would be just for to repositioning those devices to a new place. so, although I do believe that the technology in general has been stagnant for a few years, in this case, IMHO, the GPUs are the problem, the GPU's manufacturers are not innovating at all, and due that the bricks.
I do think the PCI-E to M.2 migration is getting a bit silly. My current mainboard has six M.2 slots, with four different levels of feature support (one intended for the preinstalled Wi-fi, one that can be SATA or PCI-E 3.0 x2, three PCI-e 4.0,4 one 5.0x4) Yet, if I said "I want a SCSI or SAS card", no dice, because there's only two x1 slots, and most cards seem to be x4.
The four-slot GPU problem might be more manageable if GPUs with AIO liquid coolerss included became more of a norm. That would at least let you move the majority of the bulk of the cooler away from the slot area. But usually this is reserved for ultra-expensive enthusiast cards.
This product is exposing the SSD directly to the host CPU because that's the only way to make the SSD useful. There's approximately zero software infrastructure for directly accessing an SSD from a GPU; nobody's running a NVMe driver and filesystem code entirely on the GPU, and even if you did that would be a non-starter in the consumer space because it would effectively require reserving the entire SSD for use by a single application.
It is possible on Linux to have GPU code issue storage requests over io_uring (if the kernel is polling that queue; the GPU cannot directly issue a syscall to make the kernel start checking for new IO requests). But that request still is handled on the CPU as it passes through the OS filesystem/storage stack before the NVMe SSD is instructed to DMA the requested data directly to/from the GPU's VRAM.
Microsoft's DirectStorage is (among other things) their effort to enable similar functionality for at least some use cases.
STAR WARS Jedi: Survivor starts at 155 GB but you need over 100GB on top of that for patches etc, don’t be surprised if your game folder hits 240 GB.
Baldur's Gate 3: lists 150 GB as minimum disk space required.
Cyberpunk 2077 starts at 70 GB but the expansion is supposedly another 32GB and counting.
Alan Wake 2: 90GB disk space
Going forward it’s only getting worse.
Gamers?
Am I misunderstanding something?
Not many motherboards in the latest gen can do a proper x8+x4+x4 split. They may claim to support it but you run into weird issues has to spend weeks waiting for a bios fix. Or sometimes the support might be there but it is so poorly explained in the manual that I had to actually test it on hand to make sure that I was reading it correctly.
To be fair, HEDT motherboards are not immune to this type of stupidity. However they do manage to get over these issues with the sheer number of lanes.
It isn't a super high performance GPU to begin with, so the narrower bus is unlikely to make much of a difference.
I know it's not possible for NICs to directly write data into GPU Memory unless one uses Quadro or data center cards, but loading stuff from nvme drives into the GPU without involving host memory should be possible on all recent GPUs.
Yes. Video memory runs on a substantially wider bus than system memory; the connectors that'd be required to make it replaceable would be extraordinarily expensive -- to the extent that it'd probably be cheaper to build the cards with their maximum complement of memory to begin with.
And here I thought I am going to have 1TB of GPU memory for AI lmao.
Regular PCIE kind of makes sense. Although, it’s a strange spacing optimization.