LLM's as they stand are lossy logic compression. They compress what could be a complex chain of logical / algorithmic steps into "simpler" matrix multiplication spam. They give an output thats close to the correct answer, but not quite the same, ie lossy.

Of course things change and this doesn't quite hold true with more complex LLM's that don't just directly matrix multiplication spam.