|
19 | 19 | * [MySQL Test Tables](#mysql-test-tables)
|
20 | 20 | * [ClickHouse Test Tables](#clickhouse-test-tables)
|
21 | 21 | * [Test Cases](#test-cases)
|
22 |
| - * [airline.ontime Test Case](#airline-ontime-test-case) |
| 22 | + * [airline.ontime Test Case](#airlineontime-test-case) |
23 | 23 |
|
24 | 24 | ---
|
25 | 25 |
|
@@ -722,6 +722,13 @@ Main Steps
|
722 | 722 |
|
723 | 723 | #### airline.ontime Data Set in CSV files
|
724 | 724 | Run [download script](run_airline_ontime_data_download.sh)
|
| 725 | +You may want to adjust dirs where to keep `ZIP` and `CSV` file |
| 726 | +In `run_airline_ontime_data_download.sh` edit these lines: |
| 727 | +```bash |
| 728 | +ZIP_FILES_DIR="zip" |
| 729 | +CSV_FILES_DIR="csv" |
| 730 | +``` |
| 731 | + |
725 | 732 | ```bash
|
726 | 733 | ./run_airline_ontime_data_download.sh
|
727 | 734 | ```
|
@@ -964,12 +971,37 @@ CREATE TABLE IF NOT EXISTS `airline`.`ontime` (
|
964 | 971 |
|
965 | 972 | #### airline.ontime Data Reader
|
966 | 973 | Run [datareader script](run_airline_ontime_data_reader.sh)
|
| 974 | +You may want to adjust `PYTHON` path and source and target hosts and usernames |
| 975 | +```bash |
| 976 | +PYTHON=python3.6 |
| 977 | +PYTHON=/home/user/pypy3.5-5.9-beta-linux_x86_64-portable/bin/pypy |
| 978 | +``` |
| 979 | +```bash |
| 980 | +... |
| 981 | + --src-host=127.0.0.1 \ |
| 982 | + --src-user=root \ |
| 983 | + --dst-host=127.0.0.1 \ |
| 984 | +... |
| 985 | +``` |
967 | 986 | ```bash
|
968 | 987 | ./run_airline_ontime_data_reader.sh
|
969 | 988 | ```
|
970 | 989 |
|
971 | 990 | #### airline.ontime Data Importer
|
972 | 991 | Run [data importer script](run_airline_ontime_import.sh)
|
| 992 | +You may want to adjust `CSV` files location, number of imported files and MySQL user/password used for import |
| 993 | +```bash |
| 994 | +# looking for csv files in this dir |
| 995 | +FILES_TO_IMPORT_DIR="/mnt/nas/work/ontime" |
| 996 | + |
| 997 | +# limit import to this number of files |
| 998 | +FILES_TO_IMPORT_NUM=3 |
| 999 | +``` |
| 1000 | +```bash |
| 1001 | +... |
| 1002 | + -u root \ |
| 1003 | +... |
| 1004 | +``` |
973 | 1005 |
|
974 | 1006 | ```bash
|
975 | 1007 | ./run_airline_ontime_import.sh
|
|
0 commit comments