I'd say put the ball at the spot it was fumbled. I'd also change the rule and say that if the offensive team recovers a fumble downfield (i.e. past the LOS), the ball goes back to where it was fumbled. If they recover it behind the LOS or the defense recovers it, it's where the ball is when recovered.