You can set Firefox browser's preference to save a file automatically, and not let the download window popup. Then you will be able to just grab the file, and it'll start getting downloaded.
So, something like this:
FirefoxProfile fxProfile = new FirefoxProfile();
fxProfile.setPreference("browser.download.folderList",2);
fxProfile.setPreference("browser.download.manager.showWhenStarting",false);
fxProfile.setPreference("browser.download.dir","c:\\mydownloads");
fxProfile.setPreference("browser.helperApps.neverAsk.saveToDisk","text/csv");
WebDriver driver = new FirefoxDriver(fxProfile);
driver.navigate().to("http://www.foo.com/bah.csv");
and given that you now have the download directory, it will not ask you to save the file, and no download manager would appear, as automation from this point would be straightforward.
I hope this helps!