What Makes Driver-based Forecasting Challenging?