I think the bigges thing about budget is to know exactly what you need. Many "must haves" on any baby list you look at are a waste for many families. For instance, most people don't have use for a crib, pack n play, rock n play & bassinet. Maybe if you're on a tight budget, you don't NEED a swing AND a bouncer....things like that. Also, avoid items that are kind of silly - wipe warmer, diaper genie, etc. You can get away with none at all, or a cheaper option.
@talkthewholetime why is a wipe warmer useless? Dunno what baby will prefer but I imagine if I were in diapers and getting changed so frequently at night, I'd prob prefer something warm instead of cold wipes - that's how I'm deciding on all our baby purchases - what would I love if I were in baby's shoes...that's why I got a rubber ducky bath water thermometer (not bc of the temperature indicator, heck I can just test with my hands, but because my younger self would be loving rubber duckies)