asv continuous -E virtualenv --bench ^io master fix-#10065 · Creating environments · Discovering benchmarks · Running 156 total benchmarks (2 commits * 1 environments * 78 benchmarks) [ 0.00%] · For pandas commit 041b6b18 (round 1/2): [ 0.00%] ·· Building for virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt............................................... [ 0.00%] ·· Benchmarking virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt [ 0.32%] ··· Running (io.csv.ParseDateComparison.time_read_csv_dayfirst--)......................... [ 8.65%] ··· Running (io.hdf.HDF.time_read_hdf--)................ [ 13.78%] ··· Running (io.hdf.HDFStoreDataFrame.time_write_store_table_mixed--)...... [ 16.99%] ··· Running (io.json.ToJSON.time_to_json_wide--).......... [ 20.19%] ··· Running (io.pickle.Pickle.time_read_pickle--)........... [ 23.72%] ··· Running (io.stata.Stata.time_write_stata--)... [ 25.00%] · For pandas commit 059808a0 (round 1/2): [ 25.00%] ·· Building for virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt.. [ 25.00%] ·· Benchmarking virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt [ 25.32%] ··· Running (io.csv.ParseDateComparison.time_read_csv_dayfirst--)......................... [ 33.65%] ··· Running (io.hdf.HDF.time_read_hdf--)................ [ 38.78%] ··· Running (io.hdf.HDFStoreDataFrame.time_write_store_table_mixed--)...... [ 41.99%] ··· Running (io.json.ToJSON.time_to_json_wide--)......... [ 44.87%] ··· Running (io.parsers.DoesStringLookLikeDatetime.time_check_datetimes--)............ [ 48.72%] ··· Running (io.stata.Stata.time_write_stata--)... [ 50.00%] · For pandas commit 059808a0 (round 2/2): [ 50.00%] ·· Benchmarking virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt [ 50.32%] ··· io.csv.ParseDateComparison.time_read_csv_dayfirst ok [ 50.32%] ··· ============= ============= cache_dates ------------- ------------- False 5.44±0.1ms True 2.74±0.05ms ============= ============= [ 50.64%] ··· io.csv.ParseDateComparison.time_to_datetime_dayfirst ok [ 50.64%] ··· ============= ============= cache_dates ------------- ------------- False 5.45±0.1ms True 2.99±0.09ms ============= ============= [ 50.96%] ··· io.csv.ParseDateComparison.time_to_datetime_format_DD_MM_YYYY ok [ 50.96%] ··· ============= ============ cache_dates ------------- ------------ False 13.5±0.2ms True 2.91±0.1ms ============= ============ [ 51.28%] ··· io.csv.ReadCSVCachedParseDates.time_read_csv_cached ok [ 51.28%] ··· ========== ============= do_cache ---------- ------------- True 1.53±0.02ms False 1.43±0.01ms ========== ============= [ 51.60%] ··· io.csv.ReadCSVCategorical.time_convert_direct 23.7±0.4ms [ 51.92%] ··· io.csv.ReadCSVCategorical.time_convert_post 33.5±0.4ms [ 52.24%] ··· io.csv.ReadCSVComment.time_comment 15.0±1ms [ 52.56%] ··· io.csv.ReadCSVConcatDatetime.time_read_csv 17.1±0.2ms [ 52.88%] ··· io.csv.ReadCSVConcatDatetimeBadDateValue.time_read_csv ok [ 52.88%] ··· ================ ============= bad_date_value ---------------- ------------- nan 9.11±0.05ms 0 7.69±0.04ms '' 7.39±0.2ms ================ ============= [ 53.21%] ··· io.csv.ReadCSVDInferDatetimeFormat.time_read_csv ok [ 53.21%] ··· ======================= ============= ============= ============= -- format ----------------------- ----------------------------------------- infer_datetime_format custom iso8601 ymd ======================= ============= ============= ============= True 3.67±0.05ms 1.58±0.01ms 1.62±0.02ms False 65.2±0.7ms 1.33±0.01ms 1.31±0.01ms ======================= ============= ============= ============= [ 53.53%] ··· io.csv.ReadCSVFloatPrecision.time_read_csv ok [ 53.53%] ··· ===== ========= ============= ============= ============= -- float_precision --------------- ----------------------------------------- sep decimal None high round_trip ===== ========= ============= ============= ============= , . 1.18±0.03ms 1.13±0.03ms 1.69±0.04ms , _ 1.28±0.01ms 1.32±0.02ms 1.28±0.01ms ; . 1.18±0.02ms 1.14±0.02ms 1.66±0.02ms ; _ 1.31±0.01ms 1.28±0.01ms 1.29±0.01ms ===== ========= ============= ============= ============= [ 53.85%] ··· io.csv.ReadCSVFloatPrecision.time_read_csv_python_engine ok [ 53.85%] ··· ===== ========= ============= ============= ============= -- float_precision --------------- ----------------------------------------- sep decimal None high round_trip ===== ========= ============= ============= ============= , . 2.53±0.02ms 2.53±0.02ms 2.58±0.01ms , _ 2.13±0.01ms 2.14±0.01ms 2.14±0.01ms ; . 2.53±0.01ms 2.59±0.01ms 2.53±0.01ms ; _ 2.16±0.01ms 2.14±0ms 2.11±0.01ms ===== ========= ============= ============= ============= [ 54.17%] ··· io.csv.ReadCSVMemoryGrowth.mem_parser_chunks 0 [ 54.49%] ··· io.csv.ReadCSVParseDates.time_baseline 1.46±0.01ms [ 54.81%] ··· io.csv.ReadCSVParseDates.time_multiple_date 1.73±0.02ms [ 55.13%] ··· io.csv.ReadCSVParseSpecialDate.time_read_special_date ok [ 55.13%] ··· ======= ============= value ------- ------------- mY 5.72±0.06ms mdY 2.68±0.09ms hm 2.47±0.03ms ======= ============= [ 55.45%] ··· io.csv.ReadCSVSkipRows.time_skipprows ok [ 55.45%] ··· ========== ============= skiprows ---------- ------------- None 10.3±0.1ms 10000 6.91±0.09ms ========== ============= [ 55.77%] ··· io.csv.ReadCSVThousands.time_thousands ok [ 55.77%] ··· ===== ============= ============ -- thousands ----- -------------------------- sep None , ===== ============= ============ , 8.36±0.1ms 9.92±0.1ms | 8.35±0.09ms 10.1±0.1ms ===== ============= ============ [ 56.09%] ··· io.csv.ReadUint64Integers.time_read_uint64 2.47±0.03ms [ 56.41%] ··· io.csv.ReadUint64Integers.time_read_uint64_na_values 3.97±0.06ms [ 56.73%] ··· io.csv.ReadUint64Integers.time_read_uint64_neg_values 3.85±0.1ms [ 57.05%] ··· io.csv.ToCSV.time_frame ok [ 57.05%] ··· ======= ============= kind ------- ------------- wide 83.0±1ms long 132±0.5ms mixed 16.2±0.08ms ======= ============= [ 57.37%] ··· io.csv.ToCSVDatetime.time_frame_date_formatting 5.33±0.03ms [ 57.69%] ··· io.csv.ToCSVDatetimeBig.time_frame ok [ 57.69%] ··· ======== ============= obs -------- ------------- 1000 3.31±0.01ms 10000 29.6±0.2ms 100000 299±2ms ======== ============= [ 58.01%] ··· io.excel.Excel.time_read_excel ok [ 58.01%] ··· ============ ============ engine ------------ ------------ openpyxl 66.1±0.6ms xlsxwriter 64.8±0.2ms xlwt 26.5±0.2ms ============ ============ [ 58.33%] ··· io.excel.Excel.time_write_excel ok [ 58.33%] ··· ============ ========= engine ------------ --------- openpyxl 276±2ms xlsxwriter 171±2ms xlwt 148±2ms ============ ========= [ 58.65%] ··· io.hdf.HDF.time_read_hdf ok [ 58.65%] ··· ======== ============= format -------- ------------- table 46.1±0.3ms fixed 11.7±0.02ms ======== ============= [ 58.97%] ··· io.hdf.HDF.time_write_hdf ok [ 58.97%] ··· ======== ============ format -------- ------------ table 50.0±0.3ms fixed 15.0±0.1ms ======== ============ [ 59.29%] ··· io.hdf.HDFStoreDataFrame.time_query_store_table 4.45±0.07ms [ 59.62%] ··· io.hdf.HDFStoreDataFrame.time_query_store_table_wide 5.51±0.03ms [ 59.94%] ··· io.hdf.HDFStoreDataFrame.time_read_store 11.7±0.1ms [ 60.26%] ··· io.hdf.HDFStoreDataFrame.time_read_store_mixed 15.5±0.3ms [ 60.58%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table 3.33±0.02ms [ 60.90%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table_mixed 26.9±0.2ms [ 61.22%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table_wide 4.98±0.3ms [ 61.54%] ··· io.hdf.HDFStoreDataFrame.time_store_info 2.87±0.02ms [ 61.86%] ··· io.hdf.HDFStoreDataFrame.time_store_repr 2.36±0.03μs [ 62.18%] ··· io.hdf.HDFStoreDataFrame.time_store_str 2.40±0.05μs [ 62.50%] ··· io.hdf.HDFStoreDataFrame.time_write_store 9.60±0.2ms [ 62.82%] ··· io.hdf.HDFStoreDataFrame.time_write_store_mixed 14.1±0.2ms [ 63.14%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table 18.8±0.2ms [ 63.46%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_dc 93.7±0.9ms [ 63.78%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_mixed 26.8±0.3ms [ 64.10%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_wide 28.6±0.4ms [ 64.42%] ··· io.json.ReadJSON.time_read_json ok [ 64.42%] ··· ========= ============ ============ -- index --------- ------------------------- orient int datetime ========= ============ ============ split 64.1±0.4ms 67.1±0.4ms index 547±1ms 465±0.8ms records 138±1ms 139±1ms ========= ============ ============ [ 64.74%] ··· io.json.ReadJSONLines.peakmem_read_json_lines ok [ 64.74%] ··· ========== ====== index ---------- ------ int 207M datetime 207M ========== ====== [ 65.06%] ··· io.json.ReadJSONLines.peakmem_read_json_lines_concat ok [ 65.06%] ··· ========== ====== index ---------- ------ int 161M datetime 161M ========== ====== [ 65.38%] ··· io.json.ReadJSONLines.time_read_json_lines ok [ 65.38%] ··· ========== ========= index ---------- --------- int 165±2ms datetime 164±2ms ========== ========= [ 65.71%] ··· io.json.ReadJSONLines.time_read_json_lines_concat ok [ 65.71%] ··· ========== ========= index ---------- --------- int 175±1ms datetime 175±1ms ========== ========= [ 66.03%] ··· io.json.ToJSON.mem_to_json ok [ 66.03%] ··· ========= ==== ============= ============== =============== ================== -- frame --------- -------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ==== ============= ============== =============== ================== split 0 0 0 0 0 columns 0 0 0 0 0 index 0 0 0 0 0 values 0 0 0 0 0 records 0 0 0 0 0 ========= ==== ============= ============== =============== ================== [ 66.35%] ··· io.json.ToJSON.mem_to_json_wide ok [ 66.35%] ··· ========= ==== ============= ============== =============== ================== -- frame --------- -------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ==== ============= ============== =============== ================== split 0 0 0 0 0 columns 0 0 0 0 0 index 0 0 0 0 0 values 0 0 0 0 0 records 0 0 0 0 0 ========= ==== ============= ============== =============== ================== [ 66.67%] ··· io.json.ToJSON.time_to_json ok [ 66.67%] ··· ========= ============ ============= ============== =============== ================== -- frame --------- ---------------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ============ ============= ============== =============== ================== split 48.7±0.9ms 56.9±0.8ms 79.2±1ms 63.2±1ms 62.0±0.5ms columns 57.2±3ms 176±4ms 190±3ms 180±2ms 177±3ms index 61.5±3ms 178±4ms 202±4ms 194±4ms 188±2ms values 43.3±0.6ms 44.2±0.6ms 67.9±1ms 50.9±0.6ms 51.3±0.9ms records 53.9±3ms 54.2±3ms 77.2±1ms 64.7±1ms 65.0±1ms ========= ============ ============= ============== =============== ================== [ 66.99%] ··· io.json.ToJSON.time_to_json_wide ok [ 66.99%] ··· ========= ============ ============= ============== =============== ================== -- frame --------- ---------------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ============ ============= ============== =============== ================== split 59.6±0.9ms 59.7±0.5ms 115±1ms 84.5±0.7ms 102±0.8ms columns 75.2±3ms 83.5±3ms 132±2ms 103±0.3ms 118±2ms index 74.5±2ms 72.8±3ms 131±2ms 96.9±2ms 114±1ms values 59.3±0.6ms 60.3±1ms 115±1ms 84.9±1ms 105±2ms records 75.6±2ms 74.0±3ms 130±2ms 95.2±2ms 113±2ms ========= ============ ============= ============== =============== ================== [ 67.31%] ··· io.json.ToJSONLines.time_delta_int_tstamp_lines 107±1ms [ 67.63%] ··· io.json.ToJSONLines.time_float_int_lines 99.0±0.5ms [ 67.95%] ··· io.json.ToJSONLines.time_float_int_str_lines 100±0.5ms [ 68.27%] ··· io.json.ToJSONLines.time_floats_with_dt_index_lines 77.8±2ms [ 68.59%] ··· io.json.ToJSONLines.time_floats_with_int_idex_lines 78.7±3ms [ 68.91%] ··· io.msgpack.MSGPack.time_read_msgpack 10.4±0.3ms [ 69.23%] ··· io.msgpack.MSGPack.time_write_msgpack 13.0±0.1ms [ 69.55%] ··· io.parsers.ConcatDateCols.time_check_concat ok [ 69.55%] ··· ============ =========== ============= -- dim ------------ ------------------------- value 1 2 ============ =========== ============= 1234567890 662±4μs 1.57±0.01ms AAAA 330±0.8μs 853±7μs ============ =========== ============= [ 69.87%] ··· io.parsers.DoesStringLookLikeDatetime.time_check_datetimes ok [ 69.87%] ··· ======== ========== value -------- ---------- 2Q2005 36.0±1ms 0.0 25.9±3ms 10000 39.2±2ms ======== ========== [ 70.19%] ··· io.pickle.Pickle.time_read_pickle 8.04±0.4ms [ 70.51%] ··· io.pickle.Pickle.time_write_pickle 13.8±2ms [ 70.83%] ··· io.sas.SAS.time_read_msgpack ok [ 70.83%] ··· ========== ============ format ---------- ------------ sas7bdat 63.9±1ms xport 3.77±0.1ms ========== ============ [ 71.15%] ··· io.sql.ReadSQLTable.time_read_sql_table_all 25.5±0.4ms [ 71.47%] ··· io.sql.ReadSQLTable.time_read_sql_table_parse_dates 9.19±0.1ms [ 71.79%] ··· io.sql.ReadSQLTableDtypes.time_read_sql_table_column ok [ 71.79%] ··· ================ ============= dtype ---------------- ------------- float 7.14±0.04ms float_with_nan 7.15±0.1ms string 7.57±0.03ms bool 7.22±0.1ms int 8.04±0.02ms datetime 11.9±0.1ms ================ ============= [ 72.12%] ··· io.sql.SQL.time_read_sql_query ok [ 72.12%] ··· ============ ============= connection ------------ ------------- sqlalchemy 18.0±0.2ms sqlite 15.7±0.08ms ============ ============= [ 72.44%] ··· io.sql.SQL.time_to_sql_dataframe ok [ 72.44%] ··· ============ ============ connection ------------ ------------ sqlalchemy 71.9±0.7ms sqlite 39.6±0.7ms ============ ============ [ 72.76%] ··· io.sql.WriteSQLDtypes.time_read_sql_query_select_column ok [ 72.76%] ··· ============ ================ ============= connection dtype ------------ ---------------- ------------- sqlalchemy float 5.49±0.06ms sqlalchemy float_with_nan 5.45±0.08ms sqlalchemy string 5.76±0.07ms sqlalchemy bool 6.08±0.04ms sqlalchemy int 6.26±0.05ms sqlalchemy datetime 5.86±0.08ms sqlite float 3.42±0.06ms sqlite float_with_nan 3.37±0.03ms sqlite string 3.72±0.02ms sqlite bool 4.08±0.03ms sqlite int 4.18±0.04ms sqlite datetime 3.77±0.03ms ============ ================ ============= [ 73.08%] ··· io.sql.WriteSQLDtypes.time_to_sql_dataframe_column ok [ 73.08%] ··· ============ ================ ============= connection dtype ------------ ---------------- ------------- sqlalchemy float 28.4±0.3ms sqlalchemy float_with_nan 29.4±0.6ms sqlalchemy string 28.3±0.2ms sqlalchemy bool 29.8±0.3ms sqlalchemy int 27.8±0.09ms sqlalchemy datetime 40.8±0.3ms sqlite float 14.8±0.1ms sqlite float_with_nan 15.9±0.2ms sqlite string 14.9±0.06ms sqlite bool 19.4±0.2ms sqlite int 14.5±0.06ms sqlite datetime 23.5±0.1ms ============ ================ ============= [ 73.40%] ··· io.stata.Stata.time_read_stata ok [ 73.40%] ··· =============== ============ convert_dates --------------- ------------ tc 53.7±1ms td 52.2±1ms tm 55.9±1ms tw 58.2±0.9ms th 56.8±0.8ms tq 56.6±1ms ty 54.3±1ms =============== ============ [ 73.72%] ··· io.stata.Stata.time_write_stata ok [ 73.72%] ··· =============== ============ convert_dates --------------- ------------ tc 80.0±1ms td 82.3±2ms tm 90.6±1ms tw 97.5±0.8ms th 90.8±1ms tq 94.9±2ms ty 88.7±1ms =============== ============ [ 74.04%] ··· io.stata.StataMissing.time_read_stata ok [ 74.04%] ··· =============== =========== convert_dates --------------- ----------- tc 107±2ms td 107±0.9ms tm 111±2ms tw 111±1ms th 110±1ms tq 110±0.8ms ty 108±2ms =============== =========== [ 74.36%] ··· io.stata.StataMissing.time_write_stata ok [ 74.36%] ··· =============== =========== convert_dates --------------- ----------- tc 108±2ms td 106±3ms tm 116±3ms tw 122±1ms th 115±2ms tq 117±1ms ty 114±0.9ms =============== =========== [ 74.68%] ··· Setting up io.json:200 ok [ 74.68%] ··· io.json.ToJSONMem.peakmem_float 90.4M [ 75.00%] ··· io.json.ToJSONMem.peakmem_int 90.4M [ 75.00%] · For pandas commit 041b6b18 (round 2/2): [ 75.00%] ·· Building for virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt.. [ 75.00%] ·· Benchmarking virtualenv-py3.6-Cython-matplotlib-numexpr-numpy-openpyxl-pytest-scipy-sqlalchemy-tables-xlrd-xlsxwriter-xlwt [ 75.32%] ··· io.csv.ParseDateComparison.time_read_csv_dayfirst ok [ 75.32%] ··· ============= ============= cache_dates ------------- ------------- False 5.20±0.2ms True 2.78±0.09ms ============= ============= [ 75.64%] ··· io.csv.ParseDateComparison.time_to_datetime_dayfirst ok [ 75.64%] ··· ============= ============= cache_dates ------------- ------------- False 5.33±0.09ms True 2.92±0.03ms ============= ============= [ 75.96%] ··· io.csv.ParseDateComparison.time_to_datetime_format_DD_MM_YYYY ok [ 75.96%] ··· ============= ============= cache_dates ------------- ------------- False 13.7±0.07ms True 3.02±0.1ms ============= ============= [ 76.28%] ··· io.csv.ReadCSVCachedParseDates.time_read_csv_cached ok [ 76.28%] ··· ========== ============= do_cache ---------- ------------- True 1.51±0.01ms False 1.41±0.01ms ========== ============= [ 76.60%] ··· io.csv.ReadCSVCategorical.time_convert_direct 23.6±0.3ms [ 76.92%] ··· io.csv.ReadCSVCategorical.time_convert_post 33.2±0.1ms [ 77.24%] ··· io.csv.ReadCSVComment.time_comment 14.9±1ms [ 77.56%] ··· io.csv.ReadCSVConcatDatetime.time_read_csv 17.3±0.1ms [ 77.88%] ··· io.csv.ReadCSVConcatDatetimeBadDateValue.time_read_csv ok [ 77.88%] ··· ================ ============= bad_date_value ---------------- ------------- nan 9.13±0.1ms 0 7.74±0.07ms '' 7.19±0.1ms ================ ============= [ 78.21%] ··· io.csv.ReadCSVDInferDatetimeFormat.time_read_csv ok [ 78.21%] ··· ======================= ============= ============= ============= -- format ----------------------- ----------------------------------------- infer_datetime_format custom iso8601 ymd ======================= ============= ============= ============= True 3.65±0.04ms 1.61±0.03ms 1.64±0.02ms False 65.4±0.8ms 1.34±0.01ms 1.30±0.01ms ======================= ============= ============= ============= [ 78.53%] ··· io.csv.ReadCSVFloatPrecision.time_read_csv ok [ 78.53%] ··· ===== ========= ============= ============= ============= -- float_precision --------------- ----------------------------------------- sep decimal None high round_trip ===== ========= ============= ============= ============= , . 1.20±0.02ms 1.17±0.02ms 1.67±0.02ms , _ 1.28±0.02ms 1.29±0.01ms 1.29±0.01ms ; . 1.22±0.02ms 1.17±0.02ms 1.65±0.03ms ; _ 1.31±0.01ms 1.29±0ms 1.32±0.01ms ===== ========= ============= ============= ============= [ 78.85%] ··· io.csv.ReadCSVFloatPrecision.time_read_csv_python_engine ok [ 78.85%] ··· ===== ========= ============= ============= ============= -- float_precision --------------- ----------------------------------------- sep decimal None high round_trip ===== ========= ============= ============= ============= , . 2.56±0.01ms 2.54±0.03ms 2.56±0.01ms , _ 2.14±0.01ms 2.18±0.03ms 2.14±0.03ms ; . 2.51±0.01ms 2.55±0.02ms 2.52±0.01ms ; _ 2.18±0.02ms 2.15±0.02ms 2.14±0.03ms ===== ========= ============= ============= ============= [ 79.17%] ··· io.csv.ReadCSVMemoryGrowth.mem_parser_chunks 0 [ 79.49%] ··· io.csv.ReadCSVParseDates.time_baseline 1.46±0.03ms [ 79.81%] ··· io.csv.ReadCSVParseDates.time_multiple_date 1.73±0.01ms [ 80.13%] ··· io.csv.ReadCSVParseSpecialDate.time_read_special_date ok [ 80.13%] ··· ======= ============= value ------- ------------- mY 5.69±0.05ms mdY 2.72±0.04ms hm 2.52±0.01ms ======= ============= [ 80.45%] ··· io.csv.ReadCSVSkipRows.time_skipprows ok [ 80.45%] ··· ========== ============= skiprows ---------- ------------- None 10.0±0.1ms 10000 6.94±0.06ms ========== ============= [ 80.77%] ··· io.csv.ReadCSVThousands.time_thousands ok [ 80.77%] ··· ===== ============= ============= -- thousands ----- --------------------------- sep None , ===== ============= ============= , 8.44±0.09ms 9.79±0.1ms | 8.53±0.08ms 10.1±0.04ms ===== ============= ============= [ 81.09%] ··· io.csv.ReadUint64Integers.time_read_uint64 2.45±0.04ms [ 81.41%] ··· io.csv.ReadUint64Integers.time_read_uint64_na_values 3.92±0.06ms [ 81.73%] ··· io.csv.ReadUint64Integers.time_read_uint64_neg_values 3.82±0.04ms [ 82.05%] ··· io.csv.ToCSV.time_frame ok [ 82.05%] ··· ======= ============ kind ------- ------------ wide 82.9±0.4ms long 133±2ms mixed 16.1±0.1ms ======= ============ [ 82.37%] ··· io.csv.ToCSVDatetime.time_frame_date_formatting 5.25±0.08ms [ 82.69%] ··· io.csv.ToCSVDatetimeBig.time_frame ok [ 82.69%] ··· ======== ============= obs -------- ------------- 1000 3.31±0.03ms 10000 29.6±0.2ms 100000 298±3ms ======== ============= [ 83.01%] ··· io.excel.Excel.time_read_excel ok [ 83.01%] ··· ============ ============ engine ------------ ------------ openpyxl 65.4±0.7ms xlsxwriter 64.4±0.9ms xlwt 26.3±0.2ms ============ ============ [ 83.33%] ··· io.excel.Excel.time_write_excel ok [ 83.33%] ··· ============ =========== engine ------------ ----------- openpyxl 272±1ms xlsxwriter 171±0.5ms xlwt 148±1ms ============ =========== [ 83.65%] ··· io.hdf.HDF.time_read_hdf ok [ 83.65%] ··· ======== ============ format -------- ------------ table 46.3±0.4ms fixed 11.6±0.3ms ======== ============ [ 83.97%] ··· io.hdf.HDF.time_write_hdf ok [ 83.97%] ··· ======== ============ format -------- ------------ table 50.2±0.3ms fixed 14.9±0.2ms ======== ============ [ 84.29%] ··· io.hdf.HDFStoreDataFrame.time_query_store_table 4.76±0.04ms [ 84.62%] ··· io.hdf.HDFStoreDataFrame.time_query_store_table_wide 5.53±0.05ms [ 84.94%] ··· io.hdf.HDFStoreDataFrame.time_read_store 11.6±0.1ms [ 85.26%] ··· io.hdf.HDFStoreDataFrame.time_read_store_mixed 15.5±0.1ms [ 85.58%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table 3.30±0.04ms [ 85.90%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table_mixed 26.9±0.2ms [ 86.22%] ··· io.hdf.HDFStoreDataFrame.time_read_store_table_wide 5.17±0.3ms [ 86.54%] ··· io.hdf.HDFStoreDataFrame.time_store_info 2.84±0.02ms [ 86.86%] ··· io.hdf.HDFStoreDataFrame.time_store_repr 2.27±0.03μs [ 87.18%] ··· io.hdf.HDFStoreDataFrame.time_store_str 2.29±0.02μs [ 87.50%] ··· io.hdf.HDFStoreDataFrame.time_write_store 9.57±0.06ms [ 87.82%] ··· io.hdf.HDFStoreDataFrame.time_write_store_mixed 14.3±0.2ms [ 88.14%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table 18.8±0.2ms [ 88.46%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_dc 94.4±0.8ms [ 88.78%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_mixed 27.1±0.3ms [ 89.10%] ··· io.hdf.HDFStoreDataFrame.time_write_store_table_wide 28.5±0.4ms [ 89.42%] ··· io.json.ReadJSON.time_read_json ok [ 89.42%] ··· ========= ============ ============ -- index --------- ------------------------- orient int datetime ========= ============ ============ split 63.9±0.3ms 67.1±0.3ms index 542±2ms 461±0.9ms records 139±1ms 139±1ms ========= ============ ============ [ 89.74%] ··· io.json.ReadJSONLines.peakmem_read_json_lines ok [ 89.74%] ··· ========== ====== index ---------- ------ int 207M datetime 207M ========== ====== [ 90.06%] ··· io.json.ReadJSONLines.peakmem_read_json_lines_concat ok [ 90.06%] ··· ========== ====== index ---------- ------ int 162M datetime 162M ========== ====== [ 90.38%] ··· io.json.ReadJSONLines.time_read_json_lines ok [ 90.38%] ··· ========== =========== index ---------- ----------- int 165±1ms datetime 164±0.7ms ========== =========== [ 90.71%] ··· io.json.ReadJSONLines.time_read_json_lines_concat ok [ 90.71%] ··· ========== ========= index ---------- --------- int 175±2ms datetime 174±2ms ========== ========= [ 91.03%] ··· io.json.ToJSON.mem_to_json ok [ 91.03%] ··· ========= ==== ============= ============== =============== ================== -- frame --------- -------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ==== ============= ============== =============== ================== split 0 0 0 0 0 columns 0 0 0 0 0 index 0 0 0 0 0 values 0 0 0 0 0 records 0 0 0 0 0 ========= ==== ============= ============== =============== ================== [ 91.35%] ··· io.json.ToJSON.mem_to_json_wide ok [ 91.35%] ··· ========= ==== ============= ============== =============== ================== -- frame --------- -------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ==== ============= ============== =============== ================== split 0 0 0 0 0 columns 0 0 0 0 0 index 0 0 0 0 0 values 0 0 0 0 0 records 0 0 0 0 0 ========= ==== ============= ============== =============== ================== [ 91.67%] ··· io.json.ToJSON.time_to_json ok [ 91.67%] ··· ========= ============ ============= ============== =============== ================== -- frame --------- ---------------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ============ ============= ============== =============== ================== split 48.6±0.7ms 56.0±0.9ms 79.2±1ms 62.9±0.6ms 62.6±0.8ms columns 54.2±0.6ms 175±3ms 193±2ms 183±2ms 181±2ms index 57.9±1ms 176±3ms 202±3ms 190±2ms 189±2ms values 43.7±0.4ms 43.6±1ms 67.6±0.7ms 50.6±0.9ms 50.3±0.9ms records 51.2±0.6ms 51.4±0.7ms 77.0±0.5ms 64.0±0.7ms 64.3±1ms ========= ============ ============= ============== =============== ================== [ 91.99%] ··· io.json.ToJSON.time_to_json_wide ok [ 91.99%] ··· ========= ============ ============= ============== =============== ================== -- frame --------- ---------------------------------------------------------------------------- orient df df_date_idx df_td_int_ts df_int_floats df_int_float_str ========= ============ ============= ============== =============== ================== split 59.3±0.7ms 60.2±0.5ms 115±1ms 85.2±0.5ms 103±1ms columns 70.8±0.5ms 79.4±0.9ms 131±1ms 104±2ms 117±2ms index 72.2±1ms 72.4±0.8ms 130±1ms 97.9±3ms 116±1ms values 59.4±0.2ms 60.3±0.9ms 115±1ms 85.2±0.7ms 101±1ms records 71.3±0.9ms 72.1±0.8ms 129±0.4ms 97.1±1ms 115±2ms ========= ============ ============= ============== =============== ================== [ 92.31%] ··· io.json.ToJSONLines.time_delta_int_tstamp_lines 106±1ms [ 92.63%] ··· io.json.ToJSONLines.time_float_int_lines 98.8±0.8ms [ 92.95%] ··· io.json.ToJSONLines.time_float_int_str_lines 99.3±0.6ms [ 93.27%] ··· io.json.ToJSONLines.time_floats_with_dt_index_lines 74.6±0.8ms [ 93.59%] ··· io.json.ToJSONLines.time_floats_with_int_idex_lines 75.1±0.6ms [ 93.91%] ··· io.msgpack.MSGPack.time_read_msgpack 10.6±0.3ms [ 94.23%] ··· io.msgpack.MSGPack.time_write_msgpack 13.0±0.4ms [ 94.55%] ··· io.parsers.ConcatDateCols.time_check_concat ok [ 94.55%] ··· ============ ========== ============= -- dim ------------ ------------------------ value 1 2 ============ ========== ============= 1234567890 663±10μs 1.57±0.01ms AAAA 338±3μs 850±8μs ============ ========== ============= [ 94.87%] ··· io.parsers.DoesStringLookLikeDatetime.time_check_datetimes ok [ 94.87%] ··· ======== ============ value -------- ------------ 2Q2005 32.7±0.4ms 0.0 22.2±0.2ms 10000 35.0±0.3ms ======== ============ [ 95.19%] ··· io.pickle.Pickle.time_read_pickle 7.95±0.4ms [ 95.51%] ··· io.pickle.Pickle.time_write_pickle 13.9±2ms [ 95.83%] ··· io.sas.SAS.time_read_msgpack ok [ 95.83%] ··· ========== ============= format ---------- ------------- sas7bdat 64.4±0.5ms xport 3.68±0.02ms ========== ============= [ 96.15%] ··· io.sql.ReadSQLTable.time_read_sql_table_all 25.3±0.3ms [ 96.47%] ··· io.sql.ReadSQLTable.time_read_sql_table_parse_dates 9.11±0.07ms [ 96.79%] ··· io.sql.ReadSQLTableDtypes.time_read_sql_table_column ok [ 96.79%] ··· ================ ============= dtype ---------------- ------------- float 7.10±0.08ms float_with_nan 7.20±0.06ms string 7.63±0.1ms bool 7.26±0.1ms int 8.10±0.2ms datetime 11.8±0.08ms ================ ============= [ 97.12%] ··· io.sql.SQL.time_read_sql_query ok [ 97.12%] ··· ============ ============ connection ------------ ------------ sqlalchemy 18.4±0.3ms sqlite 15.7±0.4ms ============ ============ [ 97.44%] ··· io.sql.SQL.time_to_sql_dataframe ok [ 97.44%] ··· ============ ============ connection ------------ ------------ sqlalchemy 72.1±0.7ms sqlite 40.3±0.5ms ============ ============ [ 97.76%] ··· io.sql.WriteSQLDtypes.time_read_sql_query_select_column ok [ 97.76%] ··· ============ ================ ============= connection dtype ------------ ---------------- ------------- sqlalchemy float 5.49±0.03ms sqlalchemy float_with_nan 5.42±0.03ms sqlalchemy string 5.91±0.1ms sqlalchemy bool 6.13±0.04ms sqlalchemy int 6.31±0.07ms sqlalchemy datetime 5.89±0.05ms sqlite float 3.43±0.05ms sqlite float_with_nan 3.36±0.04ms sqlite string 3.75±0.06ms sqlite bool 4.09±0.05ms sqlite int 4.14±0.05ms sqlite datetime 3.75±0.08ms ============ ================ ============= [ 98.08%] ··· io.sql.WriteSQLDtypes.time_to_sql_dataframe_column ok [ 98.08%] ··· ============ ================ ============= connection dtype ------------ ---------------- ------------- sqlalchemy float 28.7±0.2ms sqlalchemy float_with_nan 29.3±0.3ms sqlalchemy string 28.5±0.3ms sqlalchemy bool 30.1±0.3ms sqlalchemy int 27.9±0.2ms sqlalchemy datetime 40.9±0.7ms sqlite float 14.8±0.08ms sqlite float_with_nan 15.8±0.2ms sqlite string 15.1±0.1ms sqlite bool 20.0±0.2ms sqlite int 14.9±0.2ms sqlite datetime 23.9±0.3ms ============ ================ ============= [ 98.40%] ··· io.stata.Stata.time_read_stata ok [ 98.40%] ··· =============== ============ convert_dates --------------- ------------ tc 52.6±0.6ms td 53.1±0.6ms tm 57.0±0.8ms tw 57.8±0.8ms th 57.4±0.7ms tq 57.2±0.5ms ty 54.0±0.9ms =============== ============ [ 98.72%] ··· io.stata.Stata.time_write_stata ok [ 98.72%] ··· =============== ============ convert_dates --------------- ------------ tc 81.4±1ms td 82.8±0.6ms tm 90.1±0.6ms tw 97.9±2ms th 89.4±1ms tq 94.3±0.8ms ty 88.7±2ms =============== ============ [ 99.04%] ··· io.stata.StataMissing.time_read_stata ok [ 99.04%] ··· =============== =========== convert_dates --------------- ----------- tc 106±0.9ms td 107±2ms tm 112±0.6ms tw 112±1ms th 110±1ms tq 112±1ms ty 108±1ms =============== =========== [ 99.36%] ··· io.stata.StataMissing.time_write_stata ok [ 99.36%] ··· =============== =========== convert_dates --------------- ----------- tc 108±0.7ms td 107±0.3ms tm 118±2ms tw 123±2ms th 116±0.8ms tq 118±1ms ty 116±0.8ms =============== =========== [ 99.68%] ··· Setting up io.json:200 ok [ 99.68%] ··· io.json.ToJSONMem.peakmem_float 90.3M [100.00%] ··· io.json.ToJSONMem.peakmem_int 90.3M before after ratio [041b6b18] [059808a0] + 22.2±0.2ms 25.9±3ms 1.16 io.parsers.DoesStringLookLikeDatetime.time_check_datetimes('0.0') + 35.0±0.3ms 39.2±2ms 1.12 io.parsers.DoesStringLookLikeDatetime.time_check_datetimes('10000') SOME BENCHMARKS HAVE CHANGED SIGNIFICANTLY. PERFORMANCE DECREASED.