M5 Max Macbook Pro Next Week?
Honestly been waiting for next week for a while. Even if the wait time is 2 months or longer on actually getting the order, having an M5 Max for the hardware matmul is going to be amazing and worth the wait.
One nice thing about getting a new machine now is that the past few updates that I've pushed on Wilmer have helped a lot to streamline my setup; I can get a new machine with full workflows put together in about 30 minutes, compared to hours before. My whole software setup is completely different now, too- combining llama.cpp's model swapping, and being able to do as many workflows as I want on one Wilmer user, I've basically reduced my setup from 30-40 Wilmer instances total and 2-4 llama.cpp instances per machine to 1 lcpp per machine, and only maybe 6 Wilmer instances total. That's a huge help.
While I expect the memory throughput limitations (400GB/s vs 800GB/s) to keep the M5 Max from really competing with the M3 Ultra I already have, I still expect it'll be a beast; especially for on the road.
Come on, Apple... don't let me down.