It's a pain in the .... It also affects alchemy BODs (stacks of potions), inscription (stacks of scrolls), and cooking (stacks of some foods).
There's no way to do it, except to either put only enough raw materials in your pack at a time for the BOD's amount (for the fletching stuff and some of the cooking stuff).
With some of the other stuff, you could just "make number", but with the arrows, bolts, shafts, fish steaks, etc. that are "Make many as possible in one attempt", that doesn't work, so it's either do it all at once and then separate off the piles as needed, or do multiple crafting attempts with only the desired number's parts in your pack.