eval.md — 10 questions to test your chatbot
Write 10 real questions about your docs and the expected answer in one line each. Run them after every change. A good bot gets 8+ right and says "I don't know" for #10.
| # | Question | Expected answer (short) | Pass? | |---|----------|-------------------------|-------| | 1 | How do I install it? | npm install … | | | 2 | Where do I set the API key? | .env.local → … | | | 3 | … | … | | | 10 | Something your docs do NOT cover | "I don't know" + suggestion | |
Source, 11 lines
# eval.md — 10 questions to test your chatbot Write 10 real questions about your docs and the expected answer in one line each. Run them after every change. A good bot gets 8+ right and says "I don't know" for #10. | # | Question | Expected answer (short) | Pass? | |---|----------|-------------------------|-------| | 1 | How do I install it? | `npm install …` | | | 2 | Where do I set the API key? | `.env.local` → … | | | 3 | … | … | | | 10 | Something your docs do NOT cover | "I don't know" + suggestion | |