Hidden Costs of Running Open-Source LLMs in Production
Infrastructure and staffing costs dwarf the free model weights themselves.
Kwame Devi
Correspondent
Kwame Devi
Kwame Devi is a correspondent at The Burn Layer covering total cost of inference. Based in Stockholm, Kwame has written for The Burn Layer since 2015.
1 story · Stockholm