2017-09-25 05:55:00 
2017-09-25 05:55:00 R version 3.4.1 (2017-06-30) -- "Single Candle"
2017-09-25 05:55:00 Copyright (C) 2017 The R Foundation for Statistical Computing
2017-09-25 05:55:00 Platform: x86_64-w64-mingw32/x64 (64-bit)
2017-09-25 05:55:00 
2017-09-25 05:55:00 R is free software and comes with ABSOLUTELY NO WARRANTY.
2017-09-25 05:55:00 You are welcome to redistribute it under certain conditions.
2017-09-25 05:55:00 Type 'license()' or 'licence()' for distribution details.
2017-09-25 05:55:00 
2017-09-25 05:55:00   Natural language support but running in an English locale
2017-09-25 05:55:00 
2017-09-25 05:55:00 R is a collaborative project with many contributors.
2017-09-25 05:55:00 Type 'contributors()' for more information and
2017-09-25 05:55:00 'citation()' on how to cite R or R packages in publications.
2017-09-25 05:55:00 
2017-09-25 05:55:00 Type 'demo()' for some demos, 'help()' for on-line help, or
2017-09-25 05:55:00 'help.start()' for an HTML browser interface to help.
2017-09-25 05:55:00 Type 'q()' to quit R.
2017-09-25 05:55:00 
2017-09-25 05:55:00 > setwd( Sys.getenv( "RWD" ) )
2017-09-25 05:55:00 > 
2017-09-25 05:55:00 > machine_specific_replacements <- 
2017-09-25 05:55:00 + 	list( 
2017-09-25 05:55:00 + 		
2017-09-25 05:55:00 + 		# replace the folder path on macnix
2017-09-25 05:55:00 + 		c( 'path.expand( \"~\" ) , \"SAEB\"' , paste0( '"' , getwd() , '"' ) ) ,
2017-09-25 05:55:00 + 		
2017-09-25 05:55:00 + 		# change other things in the script to be run
2017-09-25 05:55:00 + 		c( "hello" , "howdy" )
2017-09-25 05:55:00 + 		
2017-09-25 05:55:00 + 	)
2017-09-25 05:55:00 > 
2017-09-25 05:55:00 > source( lodown::syntaxtractor( "saeb" , replacements = machine_specific_replacements , setup_test = "setup" ) , echo = TRUE )
2017-09-25 05:55:01 
2017-09-25 05:55:01 > library(lodown)
2017-09-25 05:55:01 
2017-09-25 05:55:01 > lodown("saeb", output_dir = file.path("e:/eanthony/r-wd/saeb-1506344055"))
2017-09-25 05:55:01 building catalog for saeb

2017-09-25 05:55:01 
2017-09-25 05:55:06 locally downloading saeb

2017-09-25 05:55:06 
2017-09-25 05:55:08 'http://download.inep.gov.br/microdados/micro_saeb1995.zip'

2017-09-25 05:55:08 cached in

2017-09-25 05:55:08 'E:/eanthony/r-tmp/saeb/17024b1c99c7f38392447eeb8b5a8808.Rcache'

2017-09-25 05:55:08 copying to

2017-09-25 05:55:08 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 05:55:08 
2017-09-25 05:55:33 saeb catalog entry 1 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 05:55:33 
2017-09-25 06:00:46 'http://download.inep.gov.br/microdados/micro_saeb1997.zip'

2017-09-25 06:00:46 cached in

2017-09-25 06:00:46 'E:/eanthony/r-tmp/saeb/019cabc4f3a13f4b4ebc16ec0ee7b932.Rcache'

2017-09-25 06:00:46 copying to

2017-09-25 06:00:46 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 06:00:46 
2017-09-25 06:02:10 saeb catalog entry 2 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 06:02:10 
2017-09-25 06:09:00 'http://download.inep.gov.br/microdados/micro_saeb1999.zip'

2017-09-25 06:09:00 cached in

2017-09-25 06:09:00 'E:/eanthony/r-tmp/saeb/8d566a2cb564253d085606a8f13c0fb2.Rcache'

2017-09-25 06:09:00 copying to

2017-09-25 06:09:00 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 06:09:00 
2017-09-25 06:09:40 Warning: 23610 parsing failures.
2017-09-25 06:09:40 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:09:40 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:09:40 See problems(...) for more details.
2017-09-25 06:09:40 
2017-09-25 06:09:54 Warning: 23380 parsing failures.
2017-09-25 06:09:54 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:09:54 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:09:54 See problems(...) for more details.
2017-09-25 06:09:54 
2017-09-25 06:09:58 Warning: 23512 parsing failures.
2017-09-25 06:09:58 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:09:58 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:09:58 See problems(...) for more details.
2017-09-25 06:09:58 
2017-09-25 06:10:12 Warning: 23584 parsing failures.
2017-09-25 06:10:12 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:10:12 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:10:12 See problems(...) for more details.
2017-09-25 06:10:12 
2017-09-25 06:10:26 Warning: 23576 parsing failures.
2017-09-25 06:10:26 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:10:26 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:10:26 See problems(...) for more details.
2017-09-25 06:10:26 
2017-09-25 06:10:39 Warning: 23780 parsing failures.
2017-09-25 06:10:39 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:10:39 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:10:39 See problems(...) for more details.
2017-09-25 06:10:39 
2017-09-25 06:10:53 Warning: 23430 parsing failures.
2017-09-25 06:10:53 row # A tibble: 5 x 5 col     row     col    expected      actual expected   <int>   <chr>       <chr>       <chr> actual 1     1 GAB_BL1    13 chars           0 file 2     1    <NA> 102 columns 100 columns row 3     2 GAB_BL1    13 chars           0 col 4     2    <NA> 102 columns 100 columns expected 5     3 GAB_BL1    13 chars           0 actual # ... with 1 more variables: file <chr>
2017-09-25 06:10:53 ... ................. ... ....................................... ........ ....................................... ...... ....................................... .... ....................................... ... ....................................... ... ....................................... ........ ....................................... ...... .......................................
2017-09-25 06:10:53 See problems(...) for more details.
2017-09-25 06:10:53 
2017-09-25 06:11:04 Warning: 63992 parsing failures.
2017-09-25 06:11:04 row # A tibble: 5 x 5 col     row   col expected actual expected   <int> <chr>    <chr>  <chr> actual 1     1  P120  8 chars      7 file 2     2  P120  8 chars      7 row 3     3  P120  8 chars      7 col 4     4  P120  8 chars      7 expected 5     5  P120  8 chars      7 actual # ... with 1 more variables: file <chr>
2017-09-25 06:11:04 ... ................. ... ............................. ........ ............................. ...... ............................. .... ............................. ... ............................. ... ............................. ........ ............................. ...... .......................................
2017-09-25 06:11:04 See problems(...) for more details.
2017-09-25 06:11:04 
2017-09-25 06:11:24 Warning: 2 parsing failures.
2017-09-25 06:11:24 row # A tibble: 2 x 5 col     row    col expected actual expected   <int>  <chr>    <chr>  <chr> actual 1  2224 N_CHAM a double     ** file 2  2224 N_PRES a double     ** row # ... with 1 more variables: file <chr>
2017-09-25 06:11:24 
2017-09-25 06:11:33 saeb catalog entry 3 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 06:11:33 
2017-09-25 06:48:43 'http://download.inep.gov.br/microdados/micro_saeb2001.zip'

2017-09-25 06:48:43 cached in

2017-09-25 06:48:43 'E:/eanthony/r-tmp/saeb/e8873847ba3abb5f063a9eba3be109de.Rcache'

2017-09-25 06:48:43 copying to

2017-09-25 06:48:43 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 06:48:43 
2017-09-25 06:54:06 saeb catalog entry 4 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 06:54:06 
2017-09-25 06:57:53 'http://download.inep.gov.br/microdados/microdados_saeb_2003.zip'

2017-09-25 06:57:53 cached in

2017-09-25 06:57:53 'E:/eanthony/r-tmp/saeb/587b5ac9e97060171de304271c89cb50.Rcache'

2017-09-25 06:57:53 copying to

2017-09-25 06:57:53 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 06:57:53 
2017-09-25 07:00:08 saeb catalog entry 5 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 07:00:08 
2017-09-25 07:12:30 'http://download.inep.gov.br/microdados/microdados_saeb_2005.zip'

2017-09-25 07:12:30 cached in

2017-09-25 07:12:30 'E:/eanthony/r-tmp/saeb/718e975af4f6aa1ec1878a0413f8dbdf.Rcache'

2017-09-25 07:12:30 copying to

2017-09-25 07:12:30 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 07:12:30 
2017-09-25 07:15:31 saeb catalog entry 6 of 9 stored in 'e:/eanthony/r-wd/saeb-1506344055/MonetDB'

2017-09-25 07:15:31 
2017-09-25 07:34:57 'http://download.inep.gov.br/microdados/microdados_saeb_2011.zip'

2017-09-25 07:34:57 cached in

2017-09-25 07:34:57 'E:/eanthony/r-tmp/saeb/82d782d4a7d5dd656b8e259a1a4ecdb0.Rcache'

2017-09-25 07:34:57 copying to

2017-09-25 07:34:57 'E:\eanthony\r-tmp\saeb\RtmpIj9hq7\file612c1d005e35'

2017-09-25 07:34:57 
2017-09-25 07:44:42 

2017-09-25 07:44:42 
2017-09-25 07:44:42 lodown is now exiting unexpectedly.
2017-09-25 07:44:42 websites that host publicly-downloadable microdata change often and sometimes those changes cause this software to break.
2017-09-25 07:44:42 if the error call stack below appears to be a hiccup in your internet connection, then please verify your connectivity and retry the download.
2017-09-25 07:44:42 otherwise, please open a new issue at `https://github.com/ajdamico/asdfree/issues` with the contents of this error call stack and also the output of your `sessionInfo()`.

2017-09-25 07:44:42 
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[1]]
2017-09-25 07:44:42 source(lodown::syntaxtractor("saeb", replacements = machine_specific_replacements, 
2017-09-25 07:44:42     setup_test = "setup"), echo = TRUE)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[2]]
2017-09-25 07:44:42 withVisible(eval(ei, envir))
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[3]]
2017-09-25 07:44:42 eval(ei, envir)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[4]]
2017-09-25 07:44:42 eval(ei, envir)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[5]]
2017-09-25 07:44:42 lodown("saeb", output_dir = file.path("e:/eanthony/r-wd/saeb-1506344055"))
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[6]]
2017-09-25 07:44:42 withCallingHandlers(catalog <- load_fun(data_name = data_name, 
2017-09-25 07:44:42     catalog, ...), error = function(e) {
2017-09-25 07:44:42     if (grepl("cannot allocate vector of size", e)) 
2017-09-25 07:44:42         message(memory_note)
2017-09-25 07:44:42     else if (grepl("parameter must be specified", e)) 
2017-09-25 07:44:42         message(parameter_note)
2017-09-25 07:44:42     else if (grepl("to install", e)) 
2017-09-25 07:44:42         message(installation_note)
2017-09-25 07:44:42     else {
2017-09-25 07:44:42         message(unknown_error_note)
2017-09-25 07:44:42         print(sys.calls())
2017-09-25 07:44:42     }
2017-09-25 07:44:42 })
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[7]]
2017-09-25 07:44:42 load_fun(data_name = data_name, catalog, ...)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[8]]
2017-09-25 07:44:42 tryCatch({
2017-09-25 07:44:42     while (TRUE) {
2017-09-25 07:44:42         part <- read.csv(input, header = FALSE, nrows = chunk_size, 
2017-09-25 07:44:42             sep = if (catalog[i, "year"] >= 2013) 
2017-09-25 07:44:42                 ","
2017-09-25 07:44:42             else ";", dec = if (catalog[i, "year"] >= 2013) 
2017-09-25 07:44:42                 "."
2017-09-25 07:44:42             else ",", na.strings = if (catalog[i, "year"] >= 
2017-09-25 07:44:42                 2013) 
2017-09-25 07:44:42                 ""
2017-09-25 07:44:42             else ".", colClasses = cc)
2017-09-25 07:44:42         part[sapply(part, class) == "logical"] <- sapply(part[sapply(part, 
2017-09-25 07:44:42             class) == "logical"], as.character)
2017-09-25 07:44:42         DBI::dbWriteTable(db, tnwy, part, append = TRUE, row.names = FALSE)
2017-09-25 07:44:42     }
2017-09-25 07:44:42 }, error = function(e) {
2017-09-25 07:44:42     if (grepl("no lines available", conditionMessage(e))) 
2017-09-25 07:44:42         TRUE
2017-09-25 07:44:42     else stop(conditionMessage(e))
2017-09-25 07:44:42 })
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[9]]
2017-09-25 07:44:42 tryCatchList(expr, classes, parentenv, handlers)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[10]]
2017-09-25 07:44:42 tryCatchOne(expr, names, parentenv, handlers[[1L]])
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[11]]
2017-09-25 07:44:42 value[[3L]](cond)
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[12]]
2017-09-25 07:44:42 stop(conditionMessage(e))
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[13]]
2017-09-25 07:44:42 .handleSimpleError(function (e) 
2017-09-25 07:44:42 {
2017-09-25 07:44:42     if (grepl("cannot allocate vector of size", e)) 
2017-09-25 07:44:42         message(memory_note)
2017-09-25 07:44:42     else if (grepl("parameter must be specified", e)) 
2017-09-25 07:44:42         message(parameter_note)
2017-09-25 07:44:42     else if (grepl("to install", e)) 
2017-09-25 07:44:42         message(installation_note)
2017-09-25 07:44:42     else {
2017-09-25 07:44:42         message(unknown_error_note)
2017-09-25 07:44:42         print(sys.calls())
2017-09-25 07:44:42     }
2017-09-25 07:44:42 }, "Failed to insert data: MALException:embedded:Append column name mismatch id_saeb <> V1 ", 
2017-09-25 07:44:42     quote(value[[3L]](cond)))
2017-09-25 07:44:42 
2017-09-25 07:44:42 [[14]]
2017-09-25 07:44:42 h(simpleError(msg, call))
2017-09-25 07:44:42 
2017-09-25 07:44:42 Error in value[[3L]](cond) : 
2017-09-25 07:44:42   Failed to insert data: MALException:embedded:Append column name mismatch id_saeb <> V1 
2017-09-25 07:44:42 Calls: source ... tryCatch -> tryCatchList -> tryCatchOne -> <Anonymous>
2017-09-25 07:44:42 In addition: There were 50 or more warnings (use warnings() to see the first 50)
2017-09-25 07:44:42 Execution halted