Quantization

Rounding of DCT coefficients — the actual loss in JPG.

Each frequency coefficient is divided by a quantization table and rounded to an integer. High frequencies are quantized aggressively; low frequencies stay nearly intact. This is where the irretrievable loss happens.