VRAM is the graphics card's memory. A model running on GPU must fit its weights there, plus the attention cache and working memory; if it does not fit, it is partly offloaded to the CPU or fails to start. The model's size and quantization determine the requirement.
Example
An 8-billion-parameter model at 4 bits needs on the order of a few gigabytes of VRAM, plus the context.