Have an idea for the dev’s of this project. There is an esp32-s3 board that will plug into a 40 pin RPI header. The esp32-s3 should be able to to drive the existing displays. This would be a good way to get rid of the RPI/linux overhead. I rewrote the firmware for the Smart Thermostat that is on github and added a ton of extra stuff. I do have a matter module written but have not tested any of that.
StackyFi
This would just need some changes to drive a different display.