Summary: The chip's impressive speed gains are because it uses on-chip SRAM instead of off-chip DRAM.
The chip is able to fit much more into SRAM because the chip uses network compression, pruning, quantization, Huffman encoding, etc.
The chip is able to fit much more into SRAM because the chip uses network compression, pruning, quantization, Huffman encoding, etc.
The term static differentiates SRAM from DRAM (dynamic random-access memory) which must be periodically refreshed. SRAM is faster and more expensive than DRAM; it is typically used for CPU cache while DRAM is used for a computer's main memory.
WP