Pooles Cavern. Data Transfer

This program was called automatically via CRON

viz: _GET['cron'] == 'yes'

The CRON job sends its output to the Freshen log file. But if the program is called manually, its output goes only to your browser screen.

Data transfer began at 20:13:01 on 03-Jul-2024

Software version 2.3. File /home/bcra/public_html/data/freshen.php (last modified 10:31:47 on 16-Jun-2024).
PHP time limit set to 5000 seconds.

Received 8,055 bytes from http://pooles.bcra.org.uk:3927/Exports/

That web page has been mined, and found to have 45 CSV files and 45 JF files to transfer.

$file_list is Array
(
    [0] => all_readings/1000930.csv
    [1] => all_readings/1008087.csv
    [2] => all_readings/1008089.csv
    [3] => all_readings/1017216.csv
    [4] => all_readings/1021454.csv
    [5] => all_readings/790060.csv
    [6] => all_readings/807565.csv
    [7] => all_readings/807566.csv
    [8] => all_readings/819585.csv
    [9] => all_readings/832627.csv
    [10] => all_readings/840298.csv
    [11] => all_readings/840299.csv
    [12] => all_readings/840300.csv
    [13] => all_readings/840301.csv
    [14] => all_readings/840308.csv
    [15] => all_readings/844534.csv
    [16] => all_readings/844555.csv
    [17] => all_readings/859646.csv
    [18] => all_readings/859658.csv
    [19] => all_readings/859669.csv
    [20] => all_readings/865344.csv
    [21] => all_readings/872568.csv
    [22] => all_readings/872642.csv
    [23] => all_readings/879721.csv
    [24] => all_readings/883599.csv
    [25] => all_readings/883600.csv
    [26] => all_readings/883606.csv
    [27] => all_readings/887883.csv
    [28] => all_readings/888271.csv
    [29] => all_readings/888275.csv
    [30] => all_readings/901903.csv
    [31] => all_readings/903422.csv
    [32] => all_readings/904973.csv
    [33] => all_readings/904993.csv
    [34] => all_readings/926759.csv
    [35] => all_readings/929116.csv
    [36] => all_readings/929117.csv
    [37] => all_readings/929128.csv
    [38] => all_readings/929129.csv
    [39] => all_readings/940875.csv
    [40] => all_readings/940877.csv
    [41] => all_readings/942588.csv
    [42] => all_readings/951585.csv
    [43] => all_readings/954904.csv
    [44] => all_readings/999986.csv
)
$file_list_raw is Array
(
    [0] => Data/current/1000930.jf
    [1] => Data/current/1008087.jf
    [2] => Data/current/1008089.jf
    [3] => Data/current/1017216.jf
    [4] => Data/current/1021454.jf
    [5] => Data/current/790060.jf
    [6] => Data/current/807565.jf
    [7] => Data/current/807566.jf
    [8] => Data/current/819585.jf
    [9] => Data/current/832627.jf
    [10] => Data/current/840298.jf
    [11] => Data/current/840299.jf
    [12] => Data/current/840300.jf
    [13] => Data/current/840301.jf
    [14] => Data/current/840308.jf
    [15] => Data/current/844534.jf
    [16] => Data/current/844555.jf
    [17] => Data/current/859646.jf
    [18] => Data/current/859658.jf
    [19] => Data/current/859669.jf
    [20] => Data/current/865344.jf
    [21] => Data/current/872568.jf
    [22] => Data/current/872642.jf
    [23] => Data/current/879721.jf
    [24] => Data/current/883599.jf
    [25] => Data/current/883600.jf
    [26] => Data/current/883606.jf
    [27] => Data/current/887883.jf
    [28] => Data/current/888271.jf
    [29] => Data/current/888275.jf
    [30] => Data/current/901903.jf
    [31] => Data/current/903422.jf
    [32] => Data/current/904973.jf
    [33] => Data/current/904993.jf
    [34] => Data/current/926759.jf
    [35] => Data/current/929116.jf
    [36] => Data/current/929117.jf
    [37] => Data/current/929128.jf
    [38] => Data/current/929129.jf
    [39] => Data/current/940875.jf
    [40] => Data/current/940877.jf
    [41] => Data/current/942588.jf
    [42] => Data/current/951585.jf
    [43] => Data/current/954904.jf
    [44] => Data/current/999986.jf
)

Flushed OB. Downloading now. This may take some time...

At 1 seconds (key=0)
  Starting to fetch data
  Fetched 1,044,730 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/1000930.csv' in 18 s at rate of 58,041 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/1000930.csv'
  Process reports that it wrote 1,044,730 bytes. OK.
  Extracted new restart as 327943
  Appended new restart data 327943 to file 'all_readings/1000930.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 19 seconds (key=1)
array key 1 skipped. (Looking for group 0. 1 mod 4 = 1)

At 19 seconds (key=2)
array key 2 skipped. (Looking for group 0. 2 mod 4 = 2)

At 19 seconds (key=3)
array key 3 skipped. (Looking for group 0. 3 mod 4 = 3)

At 19 seconds (key=4)
  Starting to fetch data
  Fetched 189,844 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/1021454.csv' in 3 s at rate of 63,281 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/1021454.csv'
  Process reports that it wrote 189,844 bytes. OK.
  Extracted new restart as 60587
  Appended new restart data 60587 to file 'all_readings/1021454.restart.txp'
  Process reports that it wrote 6 bytes. OK.
  (Printed and reset $echo)
At 22 seconds (key=5)
array key 5 skipped. (Looking for group 0. 5 mod 4 = 1)

At 22 seconds (key=6)
array key 6 skipped. (Looking for group 0. 6 mod 4 = 2)

At 22 seconds (key=7)
array key 7 skipped. (Looking for group 0. 7 mod 4 = 3)

At 22 seconds (key=8)
  Starting to fetch data
  Fetched 1,140,628 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/819585.csv' in 19 s at rate of 60,033 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/819585.csv'
  Process reports that it wrote 1,140,628 bytes. OK.
  Extracted new restart as 364825
  Appended new restart data 364825 to file 'all_readings/819585.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 41 seconds (key=9)
array key 9 skipped. (Looking for group 0. 9 mod 4 = 1)

At 41 seconds (key=10)
array key 10 skipped. (Looking for group 0. 10 mod 4 = 2)

At 41 seconds (key=11)
array key 11 skipped. (Looking for group 0. 11 mod 4 = 3)

At 41 seconds (key=12)
  Starting to fetch data
  Fetched 13,746,424 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/840300.csv' in 227 s at rate of 60,557 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/840300.csv'
  Process reports that it wrote 13,746,424 bytes. OK.
  Extracted new restart as 4885303
  Appended new restart data 4885303 to file 'all_readings/840300.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 269 seconds (key=13)
array key 13 skipped. (Looking for group 0. 13 mod 4 = 1)

At 269 seconds (key=14)
array key 14 skipped. (Looking for group 0. 14 mod 4 = 2)

At 269 seconds (key=15)
array key 15 skipped. (Looking for group 0. 15 mod 4 = 3)

At 269 seconds (key=16)
  Starting to fetch data
  Fetched 3,117,908 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/844555.csv' in 52 s at rate of 59,960 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/844555.csv'
  Process reports that it wrote 3,117,908 bytes. OK.
  Extracted new restart as 936279
  Appended new restart data 936279 to file 'all_readings/844555.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 321 seconds (key=17)
array key 17 skipped. (Looking for group 0. 17 mod 4 = 1)

At 321 seconds (key=18)
array key 18 skipped. (Looking for group 0. 18 mod 4 = 2)

At 321 seconds (key=19)
array key 19 skipped. (Looking for group 0. 19 mod 4 = 3)

At 321 seconds (key=20)
  Starting to fetch data
  Fetched 3,393,486 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/865344.csv' in 56 s at rate of 60,598 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/865344.csv'
  Process reports that it wrote 3,393,486 bytes. OK.
  Extracted new restart as 855038
  Appended new restart data 855038 to file 'all_readings/865344.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 378 seconds (key=21)
array key 21 skipped. (Looking for group 0. 21 mod 4 = 1)

At 378 seconds (key=22)
array key 22 skipped. (Looking for group 0. 22 mod 4 = 2)

At 378 seconds (key=23)
array key 23 skipped. (Looking for group 0. 23 mod 4 = 3)

At 378 seconds (key=24)
  Starting to fetch data
  Fetched 7,849,086 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/883599.csv' in 129 s at rate of 60,846 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/883599.csv'
  Process reports that it wrote 7,849,086 bytes. OK.
  Extracted new restart as 1867908
  Appended new restart data 1867908 to file 'all_readings/883599.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 508 seconds (key=25)
array key 25 skipped. (Looking for group 0. 25 mod 4 = 1)

At 508 seconds (key=26)
array key 26 skipped. (Looking for group 0. 26 mod 4 = 2)

At 508 seconds (key=27)
array key 27 skipped. (Looking for group 0. 27 mod 4 = 3)

At 508 seconds (key=28)
  Starting to fetch data
  Fetched 2,397,302 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/888271.csv' in 40 s at rate of 59,933 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/888271.csv'
  Process reports that it wrote 2,397,302 bytes. OK.
  Extracted new restart as 1021861
  Appended new restart data 1021861 to file 'all_readings/888271.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 548 seconds (key=29)
array key 29 skipped. (Looking for group 0. 29 mod 4 = 1)

At 548 seconds (key=30)
array key 30 skipped. (Looking for group 0. 30 mod 4 = 2)

At 548 seconds (key=31)
array key 31 skipped. (Looking for group 0. 31 mod 4 = 3)

At 548 seconds (key=32)
  Starting to fetch data
  Fetched 2,978,753 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/904973.csv' in 49 s at rate of 60,791 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/904973.csv'
  Process reports that it wrote 2,978,753 bytes. OK.
  Extracted new restart as 881351
  Appended new restart data 881351 to file 'all_readings/904973.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 597 seconds (key=33)
array key 33 skipped. (Looking for group 0. 33 mod 4 = 1)

At 597 seconds (key=34)
array key 34 skipped. (Looking for group 0. 34 mod 4 = 2)

At 597 seconds (key=35)
array key 35 skipped. (Looking for group 0. 35 mod 4 = 3)

At 597 seconds (key=36)
  Starting to fetch data
  Fetched 4,564,229 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/929117.csv' in 76 s at rate of 60,056 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/929117.csv'
  Process reports that it wrote 4,564,229 bytes. OK.
  Extracted new restart as 1566773
  Appended new restart data 1566773 to file 'all_readings/929117.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 673 seconds (key=37)
array key 37 skipped. (Looking for group 0. 37 mod 4 = 1)

At 673 seconds (key=38)
array key 38 skipped. (Looking for group 0. 38 mod 4 = 2)

At 673 seconds (key=39)
array key 39 skipped. (Looking for group 0. 39 mod 4 = 3)

At 673 seconds (key=40)
  Starting to fetch data
  Fetched 1,958,004 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/940877.csv' in 33 s at rate of 59,333 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/940877.csv'
  Process reports that it wrote 1,958,004 bytes. OK.
  Extracted new restart as 587884
  Appended new restart data 587884 to file 'all_readings/940877.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 706 seconds (key=41)
array key 41 skipped. (Looking for group 0. 41 mod 4 = 1)

At 706 seconds (key=42)
array key 42 skipped. (Looking for group 0. 42 mod 4 = 2)

At 706 seconds (key=43)
array key 43 skipped. (Looking for group 0. 43 mod 4 = 3)

At 706 seconds (key=44)
  Starting to fetch data
  Fetched 316,264 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/999986.csv' in 5 s at rate of 63,253 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/999986.csv'
  Process reports that it wrote 316,264 bytes. OK.
  Extracted new restart as 97733
  Appended new restart data 97733 to file 'all_readings/999986.restart.txp'
  Process reports that it wrote 6 bytes. OK.
  (Printed and reset $echo)

FINISHED first processing pass. Now looking at *.jf files ...

Now scanning for *.jf files ...

At 711 seconds(key=0)
  Starting to fetch data
  Fetched 331,425 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/1000930.jf' in 6 s at rate of 55,238 B/s
  Saved file to 'all_readings/1000930.jf'
  Process reports that it wrote 331,425 bytes. OK.
  (Printed and reset $echo)
At 717 seconds(key=1)
array key 1 skipped. (Looking for group 0. 1 mod 4 = 1)

At 717 seconds(key=2)
array key 2 skipped. (Looking for group 0. 2 mod 4 = 2)

At 717 seconds(key=3)
array key 3 skipped. (Looking for group 0. 3 mod 4 = 3)

At 717 seconds(key=4)
  Starting to fetch data
  Fetched 61,033 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/1021454.jf' in 2 s at rate of 30,517 B/s
  Saved file to 'all_readings/1021454.jf'
  Process reports that it wrote 61,033 bytes. OK.
  (Printed and reset $echo)
At 719 seconds(key=5)
array key 5 skipped. (Looking for group 0. 5 mod 4 = 1)

At 719 seconds(key=6)
array key 6 skipped. (Looking for group 0. 6 mod 4 = 2)

At 719 seconds(key=7)
array key 7 skipped. (Looking for group 0. 7 mod 4 = 3)

At 719 seconds(key=8)
  Starting to fetch data
  Fetched 365,789 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/819585.jf' in 6 s at rate of 60,965 B/s
  Saved file to 'all_readings/819585.jf'
  Process reports that it wrote 365,789 bytes. OK.
  (Printed and reset $echo)
At 725 seconds(key=9)
array key 9 skipped. (Looking for group 0. 9 mod 4 = 1)

At 725 seconds(key=10)
array key 10 skipped. (Looking for group 0. 10 mod 4 = 2)

At 725 seconds(key=11)
array key 11 skipped. (Looking for group 0. 11 mod 4 = 3)

At 725 seconds(key=12)
  Starting to fetch data
  Fetched 4,445,650 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/840300.jf' in 73 s at rate of 60,899 B/s
  Saved file to 'all_readings/840300.jf'
  Process reports that it wrote 4,445,650 bytes. OK.
  (Printed and reset $echo)
At 798 seconds(key=13)
array key 13 skipped. (Looking for group 0. 13 mod 4 = 1)

At 798 seconds(key=14)
array key 14 skipped. (Looking for group 0. 14 mod 4 = 2)

At 798 seconds(key=15)
array key 15 skipped. (Looking for group 0. 15 mod 4 = 3)

At 798 seconds(key=16)
  Starting to fetch data
  Fetched 944,956 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/844555.jf' in 15 s at rate of 62,997 B/s
  Saved file to 'all_readings/844555.jf'
  Process reports that it wrote 944,956 bytes. OK.
  (Printed and reset $echo)
At 814 seconds(key=17)
array key 17 skipped. (Looking for group 0. 17 mod 4 = 1)

At 814 seconds(key=18)
array key 18 skipped. (Looking for group 0. 18 mod 4 = 2)

At 814 seconds(key=19)
array key 19 skipped. (Looking for group 0. 19 mod 4 = 3)

At 814 seconds(key=20)
  Starting to fetch data
  Fetched 861,163 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/865344.jf' in 14 s at rate of 61,512 B/s
  Saved file to 'all_readings/865344.jf'
  Process reports that it wrote 861,163 bytes. OK.
  (Printed and reset $echo)
At 828 seconds(key=21)
array key 21 skipped. (Looking for group 0. 21 mod 4 = 1)

At 828 seconds(key=22)
array key 22 skipped. (Looking for group 0. 22 mod 4 = 2)

At 828 seconds(key=23)
array key 23 skipped. (Looking for group 0. 23 mod 4 = 3)

At 828 seconds(key=24)
  Starting to fetch data
  Fetched 1,885,921 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/883599.jf' in 30 s at rate of 62,864 B/s
  Saved file to 'all_readings/883599.jf'
  Process reports that it wrote 1,885,921 bytes. OK.
  (Printed and reset $echo)
At 859 seconds(key=25)
array key 25 skipped. (Looking for group 0. 25 mod 4 = 1)

At 859 seconds(key=26)
array key 26 skipped. (Looking for group 0. 26 mod 4 = 2)

At 859 seconds(key=27)
array key 27 skipped. (Looking for group 0. 27 mod 4 = 3)

At 859 seconds(key=28)
  Starting to fetch data
  Fetched 899,493 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/888271.jf' in 14 s at rate of 64,250 B/s
  Saved file to 'all_readings/888271.jf'
  Process reports that it wrote 899,493 bytes. OK.
  (Printed and reset $echo)
At 873 seconds(key=29)
array key 29 skipped. (Looking for group 0. 29 mod 4 = 1)

At 873 seconds(key=30)
array key 30 skipped. (Looking for group 0. 30 mod 4 = 2)

At 873 seconds(key=31)
array key 31 skipped. (Looking for group 0. 31 mod 4 = 3)

At 873 seconds(key=32)
  Starting to fetch data
  Fetched 889,690 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/904973.jf' in 15 s at rate of 59,313 B/s
  Saved file to 'all_readings/904973.jf'
  Process reports that it wrote 889,690 bytes. OK.
  (Printed and reset $echo)
At 888 seconds(key=33)
array key 33 skipped. (Looking for group 0. 33 mod 4 = 1)

At 888 seconds(key=34)
array key 34 skipped. (Looking for group 0. 34 mod 4 = 2)

At 888 seconds(key=35)
array key 35 skipped. (Looking for group 0. 35 mod 4 = 3)

At 888 seconds(key=36)
  Starting to fetch data
  Fetched 1,580,539 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/929117.jf' in 26 s at rate of 60,790 B/s
  Saved file to 'all_readings/929117.jf'
  Process reports that it wrote 1,580,539 bytes. OK.
  (Printed and reset $echo)
At 914 seconds(key=37)
array key 37 skipped. (Looking for group 0. 37 mod 4 = 1)

At 914 seconds(key=38)
array key 38 skipped. (Looking for group 0. 38 mod 4 = 2)

At 914 seconds(key=39)
array key 39 skipped. (Looking for group 0. 39 mod 4 = 3)

At 914 seconds(key=40)
  Starting to fetch data
  Fetched 592,392 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/940877.jf' in 10 s at rate of 59,239 B/s
  Saved file to 'all_readings/940877.jf'
  Process reports that it wrote 592,392 bytes. OK.
  (Printed and reset $echo)
At 924 seconds(key=41)
array key 41 skipped. (Looking for group 0. 41 mod 4 = 1)

At 924 seconds(key=42)
array key 42 skipped. (Looking for group 0. 42 mod 4 = 2)

At 924 seconds(key=43)
array key 43 skipped. (Looking for group 0. 43 mod 4 = 3)

At 924 seconds(key=44)
  Starting to fetch data
  Fetched 98,553 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/999986.jf' in 2 s at rate of 49,277 B/s
  Saved file to 'all_readings/999986.jf'
  Process reports that it wrote 98,553 bytes. OK.
  (Printed and reset $echo)
A total of 55,653,348 file bytes were written in 926 seconds.


FINISHED