Parameter filters() in get_eurostat() has issues with geo = XYZ

[rideofyourlife]

Hi.

I have a code:

df <- get_eurostat("bop_iip6_q",
                   filters = list(geo = "PL"))

which results in:

Error in get_eurostat_json(id, filters, type, lang, stringsAsFactors, ...):

Rather undesirable, isn't it? I can't think of anything I did wrong here.

[pitkant]

@rideofyourlife thank you for reporting! Indeed the error message in version 4.0 is not very informative. I tried running the query in v4.1 and got the following message:

Error in get_eurostat_json(id, filters, type, lang, stringsAsFactors,  : 
  HTTP status: 413 (Request entity too large)
  Error id: 413 
  Error label from API: EXTRACTION_TOO_BIG: The requested extraction is too big, estimated 10110240000 rows, max authorised is 5000000, please change your filters to reduce the extraction size
> 

so the solution would be to add more filters to your query.

See issue #309 for more details.

[rideofyourlife]

The below still produces the same error.

df <- get_eurostat("bop_iip6_q",
                   filters = list(geo = "PL",
                                  currency = "MIO_EUR",
                                  freq = "A"))

[pitkant]

Even with a few filters the dataset is very big, as demonstrated in the examples I provided in issue #309 - even by taking a single quarter of a year the estimated number of returned rows was over 57 million. The 10110240000 mentioned in the estimation is over 2000 times bigger than the max authorized value of 5000000.

I think you might have to go into looking at filtering by specific sectors of the economy.