I've found these scripts useful in exploring the snapshot data, but having lost too many hours of my life to restoring MySQL databases with vi and a toothpick, I translated them to SQLite instead. After several hours of runtime (mostly thanks to the v3_AMT_products table), this produces a ~2.1 GB file which produces extremely rapid local queries as the whole thing can be loaded into memory on any reasonably modern machine.
Would you take a pull request to include these scripts as well? I can reorganise the repository into MySQL and SQLite directories, or just add the SQLite directory as is.
I've found these scripts useful in exploring the snapshot data, but having lost too many hours of my life to restoring MySQL databases with vi and a toothpick, I translated them to SQLite instead. After several hours of runtime (mostly thanks to the
v3_AMT_productstable), this produces a ~2.1 GB file which produces extremely rapid local queries as the whole thing can be loaded into memory on any reasonably modern machine.Would you take a pull request to include these scripts as well? I can reorganise the repository into MySQL and SQLite directories, or just add the SQLite directory as is.