How to read a model card skeptically, line by line
Model cards are marketing and documentation at once. A practical checklist for separating the claims you can rely on from the ones you need to test yourself.
Open and on-device models
Kenji Arai
Kenji tests small and open-weight models on hardware people actually own: laptops, phones, one tired workstation. He covers quantization, memory math and how to read a model card without believing all of it.
Stories by Kenji
Field test: three small models, two laptops and 200 invoices
We ran 3B, 7B and 14B open-weight models on two ordinary laptops to extract invoice fields. Speed, accuracy, memory and battery, measured rather than guessed.