Cost Analysis of my $6.4k Local LLM Server

A Reddit user breaks down the TCO of a 4x AMD MI100 32GB GPU server built for ~$6,400, arguing that treating hardware as fully depreciated overstates local inference costs. Accounting for slow hardware depreciation and residual value materially improves the cost-per-token comparison against API pricing. The build uses an EPYC 7K62 48-core CPU on an ASRock EPYCD8-2T board with 64GB ECC RAM and a 1600W platinum PSU.