It's the perennial question of software engineering as well. As the models get better at coding, you know, if we hit 100 on SWE-bench, what does that mean?
I think there will always be alpha in people who are able to clearly explain what they're trying to build. Most of engineering is figuring out the requirements and stating what you're trying to do. And I believe this will be the case with AI as well.
Michelle Pokrass of the OpenAI API Platform team, on the Latent Space podcast (@47:01)
Note: I quite like the quotes on Simon Willison's blog. In the past, I've been taking personal notes of interesting things I hear or read. Going forward I intend to publish those here as well.