[help] tar_download() seems to ignore timeout settings

[fensch]

Help

• I understand and agree to https://books.ropensci.org/targets/help.html.

Description

I want to use tar_download() to download a large file in the beginning of a data analysis pipeline. My internet connection is to slow to download that file in under 60s. That's why, I added the resources parameter. But that does not change the outcome. The error message still is the following.

> tar_make()
tar_source(): these files do not exist: R
+ download_target_url dispatched             
✔ download_target_url completed [1ms, 0 B]
+ download_target dispatched
✖ download_target errored                                      
✖ errored pipeline [1m 0.8s, 1 completed, 0 skipped]           
Warning messages:
1: downloaded length 478799932 != reported length 4762707968 
2: URL 'https://releases.ubuntu.com/jammy/ubuntu-22.04.5-desktop-amd64.iso': Timeout of 60 seconds was reached 
3: 1 targets produced warnings. Run targets::tar_meta(fields = warnings, complete_only = TRUE) for the messages. 
Error:
! Error in tar_make():
  download from 'https://releases.ubuntu.com/jammy/ubuntu-22.04.5-desktop-amd64.iso' failed
  See https://books.ropensci.org/targets/debugging.html

I reduced the code to the following _targets.R and replaced the exact file by the Ubuntu iso.

library(targets)
library(tarchetypes)

tar_source()

list(
  tarchetypes::tar_download(
    name = download_target,
    urls = c("https://releases.ubuntu.com/jammy/ubuntu-22.04.5-desktop-amd64.iso"),
    paths = here::here("ubuntu.iso"),
    resources = tar_resources(
      network = tar_resources_network(seconds_timeout = 1 * 60 * 60) 
    )
  )
)

The wanted behavior would be, that download_target runs for more than 60s if needed (1h=60*60s at maximum).

Thank you for your help. I hope I'm not missing something obvious.

[wlandau]

The timeout argument of tar_resources_network() is about synchronizing files across network file systems on clusters. Unfortunately it does not help with tar_download(), and utils::download.file() does not seem to have a timeout argument.

As explained in https://stackoverflow.com/questions/27583767/warning-downloaded-length-reported-length-in-installing-packages-from-cran, you might try something like options(timeout = max(1000, getOption("timeout"))) in the .Rprofile file of your project.

[fensch]

This works out well. Thank you!