Staircase Analogy

Came across this blog today and this paragraph amused me a little.

A potentially reasonable reaction to these limitations would be to say “LLMs have improved a huge amount over the past year and thus future improvements over the next year will likely make them much better at writing good documentation and maintainable code.” But if you accept my staircase hypothesis, that reaction is a lot less certain. Being able to climb up a tall staircase doesn’t mean you can swim.

This is true! I see AI pilled engineers using LLMs to generate arbitrary documents and share with others without verifying the veracity or worse yet, whether the information is for the intended audience.

A little judgement goes a long way.