graham@zebedee:/apps/test$ ./get_data_test.py -d /search/test_database
INFO:root:version: 1.2.12
INFO:root:matches: 905404  memory used = 49632  2483404
INFO:root:read: 10000  memory used = 49644  2483404
INFO:root:read: 20000  memory used = 49644  2483404
INFO:root:read: 30000  memory used = 49644  2483404
INFO:root:read: 40000  memory used = 49644  2483404
INFO:root:read: 50000  memory used = 49644  2483404
INFO:root:read: 60000  memory used = 49644  2483404
INFO:root:read: 70000  memory used = 49644  2483404
INFO:root:read: 80000  memory used = 49644  2483404
INFO:root:read: 90000  memory used = 49644  2483404
INFO:root:read: 100000  memory used = 49644  2483404
INFO:root:read: 110000  memory used = 49644  2483404
INFO:root:read: 120000  memory used = 49644  2483404
INFO:root:read: 130000  memory used = 49644  2483404
INFO:root:read: 140000  memory used = 49644  2483404
INFO:root:read: 150000  memory used = 49644  2483404
INFO:root:read: 160000  memory used = 49644  2483404
INFO:root:read: 170000  memory used = 49644  2483404
INFO:root:read: 180000  memory used = 49644  2483404
INFO:root:read: 190000  memory used = 49644  2483404
INFO:root:read: 200000  memory used = 49644  2483404
INFO:root:read: 210000  memory used = 49644  2483404
INFO:root:read: 220000  memory used = 49644  2483404
INFO:root:read: 230000  memory used = 49644  2483404
INFO:root:read: 240000  memory used = 49644  2483404
INFO:root:read: 250000  memory used = 49644  2483404
INFO:root:read: 260000  memory used = 49644  2483404
INFO:root:read: 270000  memory used = 49644  2483404
^CTraceback (most recent call last):
...
KeyboardInterrupt

graham@zebedee:/apps/test$ ./get_data_test.py  /search/test_database
INFO:root:version: 1.2.12
INFO:root:matches: 905404  memory used = 49628  2483404
INFO:root:read: 10000  memory used = 51308  2484428
INFO:root:read: 20000  memory used = 53372  2486476
INFO:root:read: 30000  memory used = 55436  2488524
INFO:root:read: 40000  memory used = 57496  2490572
INFO:root:read: 50000  memory used = 59560  2492620
INFO:root:read: 60000  memory used = 61632  2495692
INFO:root:read: 70000  memory used = 63692  2497740
INFO:root:read: 80000  memory used = 65756  2499788
INFO:root:read: 90000  memory used = 67820  2501836
INFO:root:read: 100000  memory used = 69884  2503884
INFO:root:read: 110000  memory used = 71948  2505932
INFO:root:read: 120000  memory used = 74008  2507980
INFO:root:read: 130000  memory used = 76072  2510028
INFO:root:read: 140000  memory used = 78136  2512076
INFO:root:read: 150000  memory used = 80196  2514124
INFO:root:read: 160000  memory used = 82264  2516176
INFO:root:read: 170000  memory used = 84328  2518224
INFO:root:read: 180000  memory used = 86392  2520272
INFO:root:read: 190000  memory used = 88456  2522320
INFO:root:read: 200000  memory used = 90516  2524368
INFO:root:read: 210000  memory used = 92580  2526416
INFO:root:read: 220000  memory used = 94648  2528464
INFO:root:read: 230000  memory used = 96712  2530512
INFO:root:read: 240000  memory used = 98772  2532560
INFO:root:read: 250000  memory used = 100836  2534608
INFO:root:read: 260000  memory used = 102900  2536656
INFO:root:read: 270000  memory used = 104964  2538704
^CTraceback (most recent call last):
...
KeyboardInterrupt