Jev vs GLM 5.3 at chess!
Results:
◾ GLM 5.3 won by checkmate in 29 moves
◾ Jev: ~0.3s and <$0.0001 per move
◾ GLM 5.3: ~5.8s and ~$0.008 per move
◾ The whole game cost 24 cents
My main takeaway is that it's often useful to use each one to their strengths:
◾ Fast, well-defined classification → specialized models like Jev
◾ Classifications that need reasoning or lookahead → LLMs like GLM 5.3
◾ Real classification pipelines → hybrid. Jev handles the easy calls, an open model handles the hard ones.
The future is multi-model!