AI Evals Explained: Evaluating LLM Outputs and the challenges involved
If you’ve been following news on technical developments in AI, you’d have probably seen the term ‘evals’ suddenly showing up everywhere. In this post, we’ll ...
Articles
AI agent as a teaching assistant – an experiment
I have always been experimenting with how LLMs can help me learn fundamental programming concepts. As agents become more powerful, the fundamentals only incr...
Exploratory testing a context stuffed LLM
One of the most promising use cases for LLMs is to augment a model’s knowledge with custom data that can be used as the context for conversation. E.g., provi...
The siren song of LLMs
The Greek hero Odysseus (the Romans called him Ulysses) was sailing back home from the Trojan war with his crew. En route, they had to sail through the Islan...
How do you tame an external API that constantly breaks your tests?
This article is the written version of the talk Vincent Hennig and I presented at the WeAreDevelopers conference on 28 July, 2023 in Berlin.