Pooles Cavern. Data Transfer

This program was called automatically via CRON

viz: _GET['cron'] == 'yes'

The CRON job sends its output to the Freshen log file. But if the program is called manually, its output goes only to your browser screen.

Data transfer began at 08:13:01 on 04-Jul-2024

Software version 2.3. File /home/bcra/public_html/data/freshen.php (last modified 10:31:47 on 16-Jun-2024).
PHP time limit set to 5000 seconds.

Received 8,055 bytes from http://pooles.bcra.org.uk:3927/Exports/

That web page has been mined, and found to have 45 CSV files and 45 JF files to transfer.

$file_list is Array
(
    [0] => all_readings/1000930.csv
    [1] => all_readings/1008087.csv
    [2] => all_readings/1008089.csv
    [3] => all_readings/1017216.csv
    [4] => all_readings/1021454.csv
    [5] => all_readings/790060.csv
    [6] => all_readings/807565.csv
    [7] => all_readings/807566.csv
    [8] => all_readings/819585.csv
    [9] => all_readings/832627.csv
    [10] => all_readings/840298.csv
    [11] => all_readings/840299.csv
    [12] => all_readings/840300.csv
    [13] => all_readings/840301.csv
    [14] => all_readings/840308.csv
    [15] => all_readings/844534.csv
    [16] => all_readings/844555.csv
    [17] => all_readings/859646.csv
    [18] => all_readings/859658.csv
    [19] => all_readings/859669.csv
    [20] => all_readings/865344.csv
    [21] => all_readings/872568.csv
    [22] => all_readings/872642.csv
    [23] => all_readings/879721.csv
    [24] => all_readings/883599.csv
    [25] => all_readings/883600.csv
    [26] => all_readings/883606.csv
    [27] => all_readings/887883.csv
    [28] => all_readings/888271.csv
    [29] => all_readings/888275.csv
    [30] => all_readings/901903.csv
    [31] => all_readings/903422.csv
    [32] => all_readings/904973.csv
    [33] => all_readings/904993.csv
    [34] => all_readings/926759.csv
    [35] => all_readings/929116.csv
    [36] => all_readings/929117.csv
    [37] => all_readings/929128.csv
    [38] => all_readings/929129.csv
    [39] => all_readings/940875.csv
    [40] => all_readings/940877.csv
    [41] => all_readings/942588.csv
    [42] => all_readings/951585.csv
    [43] => all_readings/954904.csv
    [44] => all_readings/999986.csv
)
$file_list_raw is Array
(
    [0] => Data/current/1000930.jf
    [1] => Data/current/1008087.jf
    [2] => Data/current/1008089.jf
    [3] => Data/current/1017216.jf
    [4] => Data/current/1021454.jf
    [5] => Data/current/790060.jf
    [6] => Data/current/807565.jf
    [7] => Data/current/807566.jf
    [8] => Data/current/819585.jf
    [9] => Data/current/832627.jf
    [10] => Data/current/840298.jf
    [11] => Data/current/840299.jf
    [12] => Data/current/840300.jf
    [13] => Data/current/840301.jf
    [14] => Data/current/840308.jf
    [15] => Data/current/844534.jf
    [16] => Data/current/844555.jf
    [17] => Data/current/859646.jf
    [18] => Data/current/859658.jf
    [19] => Data/current/859669.jf
    [20] => Data/current/865344.jf
    [21] => Data/current/872568.jf
    [22] => Data/current/872642.jf
    [23] => Data/current/879721.jf
    [24] => Data/current/883599.jf
    [25] => Data/current/883600.jf
    [26] => Data/current/883606.jf
    [27] => Data/current/887883.jf
    [28] => Data/current/888271.jf
    [29] => Data/current/888275.jf
    [30] => Data/current/901903.jf
    [31] => Data/current/903422.jf
    [32] => Data/current/904973.jf
    [33] => Data/current/904993.jf
    [34] => Data/current/926759.jf
    [35] => Data/current/929116.jf
    [36] => Data/current/929117.jf
    [37] => Data/current/929128.jf
    [38] => Data/current/929129.jf
    [39] => Data/current/940875.jf
    [40] => Data/current/940877.jf
    [41] => Data/current/942588.jf
    [42] => Data/current/951585.jf
    [43] => Data/current/954904.jf
    [44] => Data/current/999986.jf
)

Flushed OB. Downloading now. This may take some time...

At 1 seconds (key=0)
  Starting to fetch data
  Fetched 1,044,730 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/1000930.csv' in 16 s at rate of 65,296 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/1000930.csv'
  Process reports that it wrote 1,044,730 bytes. OK.
  Extracted new restart as 327943
  Appended new restart data 327943 to file 'all_readings/1000930.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 17 seconds (key=1)
array key 1 skipped. (Looking for group 0. 1 mod 4 = 1)

At 17 seconds (key=2)
array key 2 skipped. (Looking for group 0. 2 mod 4 = 2)

At 17 seconds (key=3)
array key 3 skipped. (Looking for group 0. 3 mod 4 = 3)

At 17 seconds (key=4)
  Starting to fetch data
  Fetched 193,161 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/1021454.csv' in 3 s at rate of 64,387 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/1021454.csv'
  Process reports that it wrote 193,161 bytes. OK.
  Extracted new restart as 61666
  Appended new restart data 61666 to file 'all_readings/1021454.restart.txp'
  Process reports that it wrote 6 bytes. OK.
  (Printed and reset $echo)
At 20 seconds (key=5)
array key 5 skipped. (Looking for group 0. 5 mod 4 = 1)

At 20 seconds (key=6)
array key 6 skipped. (Looking for group 0. 6 mod 4 = 2)

At 20 seconds (key=7)
array key 7 skipped. (Looking for group 0. 7 mod 4 = 3)

At 20 seconds (key=8)
  Starting to fetch data
  Fetched 1,140,628 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/819585.csv' in 17 s at rate of 67,096 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/819585.csv'
  Process reports that it wrote 1,140,628 bytes. OK.
  Extracted new restart as 364825
  Appended new restart data 364825 to file 'all_readings/819585.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 37 seconds (key=9)
array key 9 skipped. (Looking for group 0. 9 mod 4 = 1)

At 37 seconds (key=10)
array key 10 skipped. (Looking for group 0. 10 mod 4 = 2)

At 37 seconds (key=11)
array key 11 skipped. (Looking for group 0. 11 mod 4 = 3)

At 37 seconds (key=12)
  Starting to fetch data
  Fetched 13,749,317 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/840300.csv' in 204 s at rate of 67,399 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/840300.csv'
  Process reports that it wrote 13,749,317 bytes. OK.
  Extracted new restart as 4886231
  Appended new restart data 4886231 to file 'all_readings/840300.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 241 seconds (key=13)
array key 13 skipped. (Looking for group 0. 13 mod 4 = 1)

At 241 seconds (key=14)
array key 14 skipped. (Looking for group 0. 14 mod 4 = 2)

At 241 seconds (key=15)
array key 15 skipped. (Looking for group 0. 15 mod 4 = 3)

At 241 seconds (key=16)
  Starting to fetch data
  Fetched 3,117,908 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/844555.csv' in 47 s at rate of 66,338 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/844555.csv'
  Process reports that it wrote 3,117,908 bytes. OK.
  Extracted new restart as 936279
  Appended new restart data 936279 to file 'all_readings/844555.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 288 seconds (key=17)
array key 17 skipped. (Looking for group 0. 17 mod 4 = 1)

At 288 seconds (key=18)
array key 18 skipped. (Looking for group 0. 18 mod 4 = 2)

At 288 seconds (key=19)
array key 19 skipped. (Looking for group 0. 19 mod 4 = 3)

At 288 seconds (key=20)
  Starting to fetch data
  Fetched 3,393,486 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/865344.csv' in 59 s at rate of 57,517 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/865344.csv'
  Process reports that it wrote 3,393,486 bytes. OK.
  Extracted new restart as 855038
  Appended new restart data 855038 to file 'all_readings/865344.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 347 seconds (key=21)
array key 21 skipped. (Looking for group 0. 21 mod 4 = 1)

At 347 seconds (key=22)
array key 22 skipped. (Looking for group 0. 22 mod 4 = 2)

At 347 seconds (key=23)
array key 23 skipped. (Looking for group 0. 23 mod 4 = 3)

At 347 seconds (key=24)
  Starting to fetch data
  Fetched 7,849,086 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/883599.csv' in 116 s at rate of 67,665 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/883599.csv'
  Process reports that it wrote 7,849,086 bytes. OK.
  Extracted new restart as 1867908
  Appended new restart data 1867908 to file 'all_readings/883599.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 464 seconds (key=25)
array key 25 skipped. (Looking for group 0. 25 mod 4 = 1)

At 464 seconds (key=26)
array key 26 skipped. (Looking for group 0. 26 mod 4 = 2)

At 464 seconds (key=27)
array key 27 skipped. (Looking for group 0. 27 mod 4 = 3)

At 464 seconds (key=28)
  Starting to fetch data
  Fetched 2,397,302 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/888271.csv' in 35 s at rate of 68,494 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/888271.csv'
  Process reports that it wrote 2,397,302 bytes. OK.
  Extracted new restart as 1021861
  Appended new restart data 1021861 to file 'all_readings/888271.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 499 seconds (key=29)
array key 29 skipped. (Looking for group 0. 29 mod 4 = 1)

At 499 seconds (key=30)
array key 30 skipped. (Looking for group 0. 30 mod 4 = 2)

At 499 seconds (key=31)
array key 31 skipped. (Looking for group 0. 31 mod 4 = 3)

At 499 seconds (key=32)
  Starting to fetch data
  Fetched 2,978,753 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/904973.csv' in 45 s at rate of 66,195 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/904973.csv'
  Process reports that it wrote 2,978,753 bytes. OK.
  Extracted new restart as 881351
  Appended new restart data 881351 to file 'all_readings/904973.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 544 seconds (key=33)
array key 33 skipped. (Looking for group 0. 33 mod 4 = 1)

At 544 seconds (key=34)
array key 34 skipped. (Looking for group 0. 34 mod 4 = 2)

At 544 seconds (key=35)
array key 35 skipped. (Looking for group 0. 35 mod 4 = 3)

At 544 seconds (key=36)
  Starting to fetch data
  Fetched 4,564,229 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/929117.csv' in 67 s at rate of 68,123 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/929117.csv'
  Process reports that it wrote 4,564,229 bytes. OK.
  Extracted new restart as 1566773
  Appended new restart data 1566773 to file 'all_readings/929117.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 611 seconds (key=37)
array key 37 skipped. (Looking for group 0. 37 mod 4 = 1)

At 611 seconds (key=38)
array key 38 skipped. (Looking for group 0. 38 mod 4 = 2)

At 611 seconds (key=39)
array key 39 skipped. (Looking for group 0. 39 mod 4 = 3)

At 611 seconds (key=40)
  Starting to fetch data
  Fetched 1,958,004 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/940877.csv' in 30 s at rate of 65,267 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/940877.csv'
  Process reports that it wrote 1,958,004 bytes. OK.
  Extracted new restart as 587884
  Appended new restart data 587884 to file 'all_readings/940877.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 641 seconds (key=41)
array key 41 skipped. (Looking for group 0. 41 mod 4 = 1)

At 641 seconds (key=42)
array key 42 skipped. (Looking for group 0. 42 mod 4 = 2)

At 641 seconds (key=43)
array key 43 skipped. (Looking for group 0. 43 mod 4 = 3)

At 641 seconds (key=44)
  Starting to fetch data
  Fetched 316,264 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/999986.csv' in 5 s at rate of 63,253 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/999986.csv'
  Process reports that it wrote 316,264 bytes. OK.
  Extracted new restart as 97733
  Appended new restart data 97733 to file 'all_readings/999986.restart.txp'
  Process reports that it wrote 6 bytes. OK.
  (Printed and reset $echo)

FINISHED first processing pass. Now looking at *.jf files ...

Now scanning for *.jf files ...

At 646 seconds(key=0)
  Starting to fetch data
  Fetched 331,425 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/1000930.jf' in 5 s at rate of 66,285 B/s
  Saved file to 'all_readings/1000930.jf'
  Process reports that it wrote 331,425 bytes. OK.
  (Printed and reset $echo)
At 651 seconds(key=1)
array key 1 skipped. (Looking for group 0. 1 mod 4 = 1)

At 651 seconds(key=2)
array key 2 skipped. (Looking for group 0. 2 mod 4 = 2)

At 651 seconds(key=3)
array key 3 skipped. (Looking for group 0. 3 mod 4 = 3)

At 651 seconds(key=4)
  Starting to fetch data
  Fetched 62,111 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/1021454.jf' in 2 s at rate of 31,056 B/s
  Saved file to 'all_readings/1021454.jf'
  Process reports that it wrote 62,111 bytes. OK.
  (Printed and reset $echo)
At 653 seconds(key=5)
array key 5 skipped. (Looking for group 0. 5 mod 4 = 1)

At 653 seconds(key=6)
array key 6 skipped. (Looking for group 0. 6 mod 4 = 2)

At 653 seconds(key=7)
array key 7 skipped. (Looking for group 0. 7 mod 4 = 3)

At 653 seconds(key=8)
  Starting to fetch data
  Fetched 365,789 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/819585.jf' in 5 s at rate of 73,158 B/s
  Saved file to 'all_readings/819585.jf'
  Process reports that it wrote 365,789 bytes. OK.
  (Printed and reset $echo)
At 658 seconds(key=9)
array key 9 skipped. (Looking for group 0. 9 mod 4 = 1)

At 658 seconds(key=10)
array key 10 skipped. (Looking for group 0. 10 mod 4 = 2)

At 658 seconds(key=11)
array key 11 skipped. (Looking for group 0. 11 mod 4 = 3)

At 658 seconds(key=12)
  Starting to fetch data
  Fetched 4,446,730 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/840300.jf' in 66 s at rate of 67,375 B/s
  Saved file to 'all_readings/840300.jf'
  Process reports that it wrote 4,446,730 bytes. OK.
  (Printed and reset $echo)
At 724 seconds(key=13)
array key 13 skipped. (Looking for group 0. 13 mod 4 = 1)

At 724 seconds(key=14)
array key 14 skipped. (Looking for group 0. 14 mod 4 = 2)

At 724 seconds(key=15)
array key 15 skipped. (Looking for group 0. 15 mod 4 = 3)

At 724 seconds(key=16)
  Starting to fetch data
  Fetched 944,956 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/844555.jf' in 14 s at rate of 67,497 B/s
  Saved file to 'all_readings/844555.jf'
  Process reports that it wrote 944,956 bytes. OK.
  (Printed and reset $echo)
At 738 seconds(key=17)
array key 17 skipped. (Looking for group 0. 17 mod 4 = 1)

At 738 seconds(key=18)
array key 18 skipped. (Looking for group 0. 18 mod 4 = 2)

At 738 seconds(key=19)
array key 19 skipped. (Looking for group 0. 19 mod 4 = 3)

At 738 seconds(key=20)
  Starting to fetch data
  Fetched 861,163 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/865344.jf' in 13 s at rate of 66,243 B/s
  Saved file to 'all_readings/865344.jf'
  Process reports that it wrote 861,163 bytes. OK.
  (Printed and reset $echo)
At 751 seconds(key=21)
array key 21 skipped. (Looking for group 0. 21 mod 4 = 1)

At 751 seconds(key=22)
array key 22 skipped. (Looking for group 0. 22 mod 4 = 2)

At 751 seconds(key=23)
array key 23 skipped. (Looking for group 0. 23 mod 4 = 3)

At 751 seconds(key=24)
  Starting to fetch data
  Fetched 1,885,921 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/883599.jf' in 28 s at rate of 67,354 B/s
  Saved file to 'all_readings/883599.jf'
  Process reports that it wrote 1,885,921 bytes. OK.
  (Printed and reset $echo)
At 779 seconds(key=25)
array key 25 skipped. (Looking for group 0. 25 mod 4 = 1)

At 779 seconds(key=26)
array key 26 skipped. (Looking for group 0. 26 mod 4 = 2)

At 779 seconds(key=27)
array key 27 skipped. (Looking for group 0. 27 mod 4 = 3)

At 779 seconds(key=28)
  Starting to fetch data
  Fetched 899,493 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/888271.jf' in 13 s at rate of 69,192 B/s
  Saved file to 'all_readings/888271.jf'
  Process reports that it wrote 899,493 bytes. OK.
  (Printed and reset $echo)
At 792 seconds(key=29)
array key 29 skipped. (Looking for group 0. 29 mod 4 = 1)

At 792 seconds(key=30)
array key 30 skipped. (Looking for group 0. 30 mod 4 = 2)

At 792 seconds(key=31)
array key 31 skipped. (Looking for group 0. 31 mod 4 = 3)

At 792 seconds(key=32)
  Starting to fetch data
  Fetched 889,690 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/904973.jf' in 13 s at rate of 68,438 B/s
  Saved file to 'all_readings/904973.jf'
  Process reports that it wrote 889,690 bytes. OK.
  (Printed and reset $echo)
At 805 seconds(key=33)
array key 33 skipped. (Looking for group 0. 33 mod 4 = 1)

At 805 seconds(key=34)
array key 34 skipped. (Looking for group 0. 34 mod 4 = 2)

At 805 seconds(key=35)
array key 35 skipped. (Looking for group 0. 35 mod 4 = 3)

At 805 seconds(key=36)
  Starting to fetch data
  Fetched 1,580,539 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/929117.jf' in 24 s at rate of 65,856 B/s
  Saved file to 'all_readings/929117.jf'
  Process reports that it wrote 1,580,539 bytes. OK.
  (Printed and reset $echo)
At 829 seconds(key=37)
array key 37 skipped. (Looking for group 0. 37 mod 4 = 1)

At 829 seconds(key=38)
array key 38 skipped. (Looking for group 0. 38 mod 4 = 2)

At 829 seconds(key=39)
array key 39 skipped. (Looking for group 0. 39 mod 4 = 3)

At 829 seconds(key=40)
  Starting to fetch data
  Fetched 592,392 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/940877.jf' in 9 s at rate of 65,821 B/s
  Saved file to 'all_readings/940877.jf'
  Process reports that it wrote 592,392 bytes. OK.
  (Printed and reset $echo)
At 838 seconds(key=41)
array key 41 skipped. (Looking for group 0. 41 mod 4 = 1)

At 838 seconds(key=42)
array key 42 skipped. (Looking for group 0. 42 mod 4 = 2)

At 838 seconds(key=43)
array key 43 skipped. (Looking for group 0. 43 mod 4 = 3)

At 838 seconds(key=44)
  Starting to fetch data
  Fetched 98,553 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/999986.jf' in 1 s at rate of 98,553 B/s
  Saved file to 'all_readings/999986.jf'
  Process reports that it wrote 98,553 bytes. OK.
  (Printed and reset $echo)
A total of 55,661,716 file bytes were written in 839 seconds.


FINISHED