Accurate, Focused Research on Law, Technology and Knowledge Discovery Since 2002

It isn’t data that will unlock AI, it is human expertise

One Useful Thing: “The largest Large Language Models, like GPT-4, already have trained on tons of data. They “know” many things, which is why they beat Stanford Medical School students when evaluating new medical cases and Harvard students at essay writing, despite their tendency to hallucinate wrong answers. It may well be that more data is indeed widely useful — companies are training their own LLMs, and going through substantial effort to fine-tune existing models on their data based on this assumption — but we don’t actually know that, yet. In the meantime, there is something that is clearly important, and that is the prompts of experts. Now, I need to be very clear here: I don’t mean expert prompts, produced through elaborate “prompt engineering.” I have written before that prompt engineering is overrated. For most uses, you can build a good prompt mostly by asking the AI to do something in back-and-forth dialogue, combined with trial and error, and a few small tricks (I will get to those shortly). No, I mean the prompts of experts – prompts that encode our hard-earned expertise in ways that AI can help other people apply. Prompts that we can use to do our work easier, or, if you are inclined, to gift others with your own abilities. Let me explain with an example from education…”

Sorry, comments are closed for this post.