Good question. You can do text classification with causal LMs. This is just like having ChatGPT do text classification via prompt engineering. The 5 examples could be included in the prompt via few-shot learning.