In the menu, press the icon on the top-left corner of the screen, and then you will have the option to switch out your weapons, so your old weapons never vanish when you purchase new ones from the vendor.