2017-09-25 05:54:39 2017-09-25 05:54:39 R version 3.4.1 (2017-06-30) -- "Single Candle" 2017-09-25 05:54:39 Copyright (C) 2017 The R Foundation for Statistical Computing 2017-09-25 05:54:39 Platform: x86_64-w64-mingw32/x64 (64-bit) 2017-09-25 05:54:39 2017-09-25 05:54:39 R is free software and comes with ABSOLUTELY NO WARRANTY. 2017-09-25 05:54:39 You are welcome to redistribute it under certain conditions. 2017-09-25 05:54:39 Type 'license()' or 'licence()' for distribution details. 2017-09-25 05:54:39 2017-09-25 05:54:39 Natural language support but running in an English locale 2017-09-25 05:54:39 2017-09-25 05:54:39 R is a collaborative project with many contributors. 2017-09-25 05:54:39 Type 'contributors()' for more information and 2017-09-25 05:54:39 'citation()' on how to cite R or R packages in publications. 2017-09-25 05:54:39 2017-09-25 05:54:39 Type 'demo()' for some demos, 'help()' for on-line help, or 2017-09-25 05:54:39 'help.start()' for an HTML browser interface to help. 2017-09-25 05:54:39 Type 'q()' to quit R. 2017-09-25 05:54:39 2017-09-25 05:54:39 > setwd( Sys.getenv( "RWD" ) ) 2017-09-25 05:54:39 > 2017-09-25 05:54:39 > machine_specific_replacements <- 2017-09-25 05:54:39 + list( 2017-09-25 05:54:39 + 2017-09-25 05:54:39 + # replace the folder path on macnix 2017-09-25 05:54:39 + c( 'path.expand( \"~\" ) , \"CENSO_ESCOLAR\"' , paste0( '"' , getwd() , '"' ) ) , 2017-09-25 05:54:39 + 2017-09-25 05:54:39 + # change other things in the script to be run 2017-09-25 05:54:39 + c( "hello" , "howdy" ) 2017-09-25 05:54:39 + 2017-09-25 05:54:39 + ) 2017-09-25 05:54:39 > 2017-09-25 05:54:39 > source( lodown::syntaxtractor( "censo_escolar" , replacements = machine_specific_replacements , setup_test = "setup" ) , echo = TRUE ) 2017-09-25 05:54:41 2017-09-25 05:54:41 > library(lodown) 2017-09-25 05:54:41 2017-09-25 05:54:41 > lodown("censo_escolar", output_dir = file.path("e:/eanthony/r-wd/censo_escolar-1506344055")) 2017-09-25 05:54:41 building catalog for censo_escolar 2017-09-25 05:54:41 2017-09-25 05:55:17 locally downloading censo_escolar 2017-09-25 05:55:17 2017-09-25 05:55:20 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar1995.zip' 2017-09-25 05:55:20 cached in 2017-09-25 05:55:20 'E:/eanthony/r-tmp/censo_escolar/594f9506d1c461691a062b7e69a15bd9.Rcache' 2017-09-25 05:55:20 copying to 2017-09-25 05:55:20 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 05:55:20 2017-09-25 06:00:22 dados_censoesc stored at censo_1995 2017-09-25 06:00:22 2017-09-25 06:00:25 dados_curso stored at curso_1995 2017-09-25 06:00:25 2017-09-25 06:00:26 dados_desp stored at desporto_1995 2017-09-25 06:00:26 2017-09-25 06:00:26 censo_escolar catalog entry 1 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:00:26 2017-09-25 06:00:47 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar1996.zip' 2017-09-25 06:00:47 cached in 2017-09-25 06:00:47 'E:/eanthony/r-tmp/censo_escolar/195d68f902bf19399051c5133ccb2bab.Rcache' 2017-09-25 06:00:47 copying to 2017-09-25 06:00:47 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:00:47 2017-09-25 06:06:20 dados_censo96 stored at censo_1996 2017-09-25 06:06:20 2017-09-25 06:06:23 dados_em11 stored at em11_1996 2017-09-25 06:06:23 2017-09-25 06:06:27 dados_em8 stored at em8_1996 2017-09-25 06:06:27 2017-09-25 06:06:29 dados_es6 stored at es6_1996 2017-09-25 06:06:29 2017-09-25 06:06:29 censo_escolar catalog entry 2 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:06:29 2017-09-25 06:07:42 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar1997.zip' 2017-09-25 06:07:42 cached in 2017-09-25 06:07:42 'E:/eanthony/r-tmp/censo_escolar/92ca44dae12f0ddb0b7caae5882ef524.Rcache' 2017-09-25 06:07:42 copying to 2017-09-25 06:07:42 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:07:42 2017-09-25 06:09:33 Warning: 273951 parsing failures. 2017-09-25 06:09:33 row # A tibble: 5 x 5 col row col expected actual expected actual 1 1 VES913 7 chars 4 file 2 2 VES913 7 chars 4 row 3 3 VES913 7 chars 4 col 4 4 VES913 7 chars 4 expected 5 5 VES913 7 chars 4 actual # ... with 1 more variables: file 2017-09-25 06:09:33 ... ................. ... .............................. ........ .............................. ...... .............................. .... .............................. ... .............................. ... .............................. ........ .............................. ...... ....................................... 2017-09-25 06:09:33 See problems(...) for more details. 2017-09-25 06:09:33 2017-09-25 06:10:56 dados_censoesc stored at censo_1997 2017-09-25 06:10:56 2017-09-25 06:10:59 dados_em12 stored at em12_1997 2017-09-25 06:10:59 2017-09-25 06:10:59 censo_escolar catalog entry 3 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:10:59 2017-09-25 06:11:35 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar1998.zip' 2017-09-25 06:11:35 cached in 2017-09-25 06:11:35 'E:/eanthony/r-tmp/censo_escolar/3122e97b7967113c9b1fa13c04543867.Rcache' 2017-09-25 06:11:35 copying to 2017-09-25 06:11:35 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:11:35 2017-09-25 06:14:55 Warning: 1382125 parsing failures. 2017-09-25 06:14:55 row # A tibble: 5 x 5 col row col expected actual expected actual 1 1 VEM968 no trailing characters . file 2 1 VES912 7 chars 4 row 3 1 1693 columns 1691 columns col 4 2 AR_CONST no trailing characters 1 expected 5 2 PAVIMENTOS a double sssnnsn actual # ... with 1 more variables: file 2017-09-25 06:14:55 ... ................. ... ...................................................... ........ ...................................................... ...... ...................................................... .... ...................................................... ... ...................................................... ... ...................................................... ........ ...................................................... ...... ...................... [... truncated] 2017-09-25 06:20:32 dados_censoesc stored at censo_1998 2017-09-25 06:20:32 2017-09-25 06:20:42 dados_educprof stored at educprof_1998 2017-09-25 06:20:42 2017-09-25 06:20:46 dados_em12 stored at em12_1998 2017-09-25 06:20:46 2017-09-25 06:20:47 censo_escolar catalog entry 4 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:20:47 2017-09-25 06:24:12 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar1999.zip' 2017-09-25 06:24:12 cached in 2017-09-25 06:24:12 'E:/eanthony/r-tmp/censo_escolar/162f8c2670aef18637d6232ffd107b86.Rcache' 2017-09-25 06:24:12 copying to 2017-09-25 06:24:12 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:24:12 2017-09-25 06:37:14 dados_censoesc stored at censo_1999 2017-09-25 06:37:14 2017-09-25 06:37:22 dados_educprof stored at educprof_1999 2017-09-25 06:37:22 2017-09-25 06:37:22 censo_escolar catalog entry 5 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:37:22 2017-09-25 06:41:24 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar2000.zip' 2017-09-25 06:41:24 cached in 2017-09-25 06:41:24 'E:/eanthony/r-tmp/censo_escolar/e6de510ff8fc34bc4259fab4e1901fd3.Rcache' 2017-09-25 06:41:24 copying to 2017-09-25 06:41:24 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:41:24 2017-09-25 06:54:25 dados_censoesc stored at censo_2000 2017-09-25 06:54:25 2017-09-25 06:55:19 dados_indicesc stored at indicesc_2000 2017-09-25 06:55:19 2017-09-25 06:55:33 dados_indicreg stored at indicreg_2000 2017-09-25 06:55:33 2017-09-25 06:55:36 dados_medprof stored at medprof_2000 2017-09-25 06:55:36 2017-09-25 06:55:36 censo_escolar catalog entry 6 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 06:55:36 2017-09-25 06:56:34 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar2001.zip' 2017-09-25 06:56:34 cached in 2017-09-25 06:56:34 'E:/eanthony/r-tmp/censo_escolar/cf69da1cb82a37c57f8411fdb5adc414.Rcache' 2017-09-25 06:56:34 copying to 2017-09-25 06:56:34 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 06:56:34 2017-09-25 07:06:30 dados_censoesc stored at censo_2001 2017-09-25 07:06:30 2017-09-25 07:06:33 dados_educprof stored at educprof_2001 2017-09-25 07:06:33 2017-09-25 07:07:51 dados_indicesc stored at indicesc_2001 2017-09-25 07:07:51 2017-09-25 07:08:29 dados_indicreg stored at indicreg_2001 2017-09-25 07:08:29 2017-09-25 07:08:36 dados_medprof stored at medprof_2001 2017-09-25 07:08:36 2017-09-25 07:08:36 censo_escolar catalog entry 7 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 07:08:36 2017-09-25 07:12:36 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar2002.zip' 2017-09-25 07:12:36 cached in 2017-09-25 07:12:36 'E:/eanthony/r-tmp/censo_escolar/ea9e387614f507bf90e8483141d85f16.Rcache' 2017-09-25 07:12:36 copying to 2017-09-25 07:12:36 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 07:12:36 2017-09-25 07:23:48 dados_censoesc stored at censo_2002 2017-09-25 07:23:48 2017-09-25 07:23:51 dados_educprof stored at educprof_2002 2017-09-25 07:23:51 2017-09-25 07:24:59 dados_indicesc stored at indicesc_2002 2017-09-25 07:24:59 2017-09-25 07:25:22 dados_indicreg stored at indicreg_2002 2017-09-25 07:25:22 2017-09-25 07:25:33 dados_medprof stored at medprof_2002 2017-09-25 07:25:33 2017-09-25 07:25:33 censo_escolar catalog entry 8 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 07:25:33 2017-09-25 07:27:42 'ftp://ftp.inep.gov.br/microdados/micro_censo_escolar2003.zip' 2017-09-25 07:27:42 cached in 2017-09-25 07:27:42 'E:/eanthony/r-tmp/censo_escolar/05a89837ae6e64467b448095ca9890f2.Rcache' 2017-09-25 07:27:42 copying to 2017-09-25 07:27:42 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 07:27:42 2017-09-25 07:42:41 dados_censoesc stored at censo_2003 2017-09-25 07:42:41 2017-09-25 07:42:44 dados_educprof stored at educprof_2003 2017-09-25 07:42:44 2017-09-25 07:43:26 dados_indicesc stored at indicesc_2003 2017-09-25 07:43:26 2017-09-25 07:43:40 dados_indicreg stored at indicreg_2003 2017-09-25 07:43:40 2017-09-25 07:43:42 dados_medprof stored at medprof_2003 2017-09-25 07:43:42 2017-09-25 07:43:43 censo_escolar catalog entry 9 of 27 stored in 'e:/eanthony/r-wd/censo_escolar-1506344055/MonetDB' 2017-09-25 07:43:43 2017-09-25 07:44:45 'ftp://ftp.inep.gov.br/microdados/Arquivos_antigos/microdados_censo_escolar2003.zip' 2017-09-25 07:44:45 cached in 2017-09-25 07:44:45 'E:/eanthony/r-tmp/censo_escolar/f62d4fb9a687dc79e3571cfea7460830.Rcache' 2017-09-25 07:44:45 copying to 2017-09-25 07:44:45 'E:\eanthony\r-tmp\censo_escolar\RtmpqatvJR\file2f043d907813' 2017-09-25 07:44:45 2017-09-25 07:49:34 dados_cadastro stored at cadastro_2003 2017-09-25 07:49:34 2017-09-25 07:52:29 2017-09-25 07:52:29 2017-09-25 07:52:29 lodown is now exiting unexpectedly. 2017-09-25 07:52:29 websites that host publicly-downloadable microdata change often and sometimes those changes cause this software to break. 2017-09-25 07:52:29 if the error call stack below appears to be a hiccup in your internet connection, then please verify your connectivity and retry the download. 2017-09-25 07:52:29 otherwise, please open a new issue at `https://github.com/ajdamico/asdfree/issues` with the contents of this error call stack and also the output of your `sessionInfo()`. 2017-09-25 07:52:29 2017-09-25 07:52:29 2017-09-25 07:52:29 [[1]] 2017-09-25 07:52:29 source(lodown::syntaxtractor("censo_escolar", replacements = machine_specific_replacements, 2017-09-25 07:52:29 setup_test = "setup"), echo = TRUE) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[2]] 2017-09-25 07:52:29 withVisible(eval(ei, envir)) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[3]] 2017-09-25 07:52:29 eval(ei, envir) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[4]] 2017-09-25 07:52:29 eval(ei, envir) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[5]] 2017-09-25 07:52:29 lodown("censo_escolar", output_dir = file.path("e:/eanthony/r-wd/censo_escolar-1506344055")) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[6]] 2017-09-25 07:52:29 withCallingHandlers(catalog <- load_fun(data_name = data_name, 2017-09-25 07:52:29 catalog, ...), error = function(e) { 2017-09-25 07:52:29 if (grepl("cannot allocate vector of size", e)) 2017-09-25 07:52:29 message(memory_note) 2017-09-25 07:52:29 else if (grepl("parameter must be specified", e)) 2017-09-25 07:52:29 message(parameter_note) 2017-09-25 07:52:29 else if (grepl("to install", e)) 2017-09-25 07:52:29 message(installation_note) 2017-09-25 07:52:29 else { 2017-09-25 07:52:29 message(unknown_error_note) 2017-09-25 07:52:29 print(sys.calls()) 2017-09-25 07:52:29 } 2017-09-25 07:52:29 }) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[7]] 2017-09-25 07:52:29 load_fun(data_name = data_name, catalog, ...) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[8]] 2017-09-25 07:52:29 DBI::dbWriteTable(db, these_tables[j, "db_tablename"], x) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[9]] 2017-09-25 07:52:29 DBI::dbWriteTable(db, these_tables[j, "db_tablename"], x) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[10]] 2017-09-25 07:52:29 .local(conn, name, value, ...) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[11]] 2017-09-25 07:52:29 stop("Table ", qname, " already exists. Set overwrite=TRUE if you want \\n to remove the existing table. Set append=TRUE if you would like to add the new data to the \\n existing table.") 2017-09-25 07:52:29 2017-09-25 07:52:29 [[12]] 2017-09-25 07:52:29 .handleSimpleError(function (e) 2017-09-25 07:52:29 { 2017-09-25 07:52:29 if (grepl("cannot allocate vector of size", e)) 2017-09-25 07:52:29 message(memory_note) 2017-09-25 07:52:29 else if (grepl("parameter must be specified", e)) 2017-09-25 07:52:29 message(parameter_note) 2017-09-25 07:52:29 else if (grepl("to install", e)) 2017-09-25 07:52:29 message(installation_note) 2017-09-25 07:52:29 else { 2017-09-25 07:52:29 message(unknown_error_note) 2017-09-25 07:52:29 print(sys.calls()) 2017-09-25 07:52:29 } 2017-09-25 07:52:29 }, "Table censo_2003 already exists. Set overwrite=TRUE if you want \\n to remove the existing table. Set append=TRUE if you would like to add the new data to the \\n existing table.", 2017-09-25 07:52:29 quote(.local(conn, name, value, ...))) 2017-09-25 07:52:29 2017-09-25 07:52:29 [[13]] 2017-09-25 07:52:29 h(simpleError(msg, call)) 2017-09-25 07:52:29 2017-09-25 07:52:29 Error in .local(conn, name, value, ...) : 2017-09-25 07:52:29 Table censo_2003 already exists. Set overwrite=TRUE if you want 2017-09-25 07:52:29 to remove the existing table. Set append=TRUE if you would like to add the new data to the 2017-09-25 07:52:29 existing table. 2017-09-25 07:52:29 Calls: source ... withCallingHandlers -> load_fun -> -> -> .local 2017-09-25 07:52:29 In addition: There were 50 or more warnings (use warnings() to see the first 50) 2017-09-25 07:52:29 Execution halted