When I designed some LED power supplies I couldn't really do them properly for under £10 for just the parts, probably end sale price of over £30. One of the high temperature essential capacitors was £1.50 even in bulk, though a lower quality would fail in a year replacement was 11pence !!!. Could have cut corners used cheaper lower quality, low temperature rated parts but then power supply lifetime will suffer and be significantly less than the LED !!!
I think maybe you need to change your component suppliers or your designs! You simply shouldn't need expensive capacitors like that in such a simple design, or you are being ripped off.