“The Raspberry Pi AI HAT+ 2 was bought for a home test lab. All performance numbers are more or less the same as in hundreds of YouTube reviews. In my opinion, models with 3-6 billion parameters work quite fast, and for my current tasks like prompt testing and simple sorting tasks, it is enough.
After a small adjustment of the mounts included in the box for installing the board - they are plastic and can be easily cut to the needed length - I was able to fit it tightly into the Argon NEO 5 Case. The board is held by the pins on one side and by two shortened mounts on the other side (the spring-loaded heatsink screws slightly press against the cover when closing it).
The temperature shows 55-70°C. I have not tested it at full power yet. With heavy use, I may need to remove the case cover.
So far I am fully satisfied.
Installation and setup took about 20-30 minutes. For my tasks, the result is 5 out of 5.”