Pooles Cavern. Data Transfer

This program was called automatically via CRON

viz: _GET['cron'] == 'yes'

The CRON job sends its output to the Freshen log file. But if the program is called manually, its output goes only to your browser screen.

Data transfer began at 14:13:01 on 04-Jul-2024

Software version 2.3. File /home/bcra/public_html/data/freshen.php (last modified 10:31:47 on 16-Jun-2024).
PHP time limit set to 5000 seconds.

Received 8,055 bytes from http://pooles.bcra.org.uk:3927/Exports/

That web page has been mined, and found to have 45 CSV files and 45 JF files to transfer.

$file_list is Array
(
    [0] => all_readings/1000930.csv
    [1] => all_readings/1008087.csv
    [2] => all_readings/1008089.csv
    [3] => all_readings/1017216.csv
    [4] => all_readings/1021454.csv
    [5] => all_readings/790060.csv
    [6] => all_readings/807565.csv
    [7] => all_readings/807566.csv
    [8] => all_readings/819585.csv
    [9] => all_readings/832627.csv
    [10] => all_readings/840298.csv
    [11] => all_readings/840299.csv
    [12] => all_readings/840300.csv
    [13] => all_readings/840301.csv
    [14] => all_readings/840308.csv
    [15] => all_readings/844534.csv
    [16] => all_readings/844555.csv
    [17] => all_readings/859646.csv
    [18] => all_readings/859658.csv
    [19] => all_readings/859669.csv
    [20] => all_readings/865344.csv
    [21] => all_readings/872568.csv
    [22] => all_readings/872642.csv
    [23] => all_readings/879721.csv
    [24] => all_readings/883599.csv
    [25] => all_readings/883600.csv
    [26] => all_readings/883606.csv
    [27] => all_readings/887883.csv
    [28] => all_readings/888271.csv
    [29] => all_readings/888275.csv
    [30] => all_readings/901903.csv
    [31] => all_readings/903422.csv
    [32] => all_readings/904973.csv
    [33] => all_readings/904993.csv
    [34] => all_readings/926759.csv
    [35] => all_readings/929116.csv
    [36] => all_readings/929117.csv
    [37] => all_readings/929128.csv
    [38] => all_readings/929129.csv
    [39] => all_readings/940875.csv
    [40] => all_readings/940877.csv
    [41] => all_readings/942588.csv
    [42] => all_readings/951585.csv
    [43] => all_readings/954904.csv
    [44] => all_readings/999986.csv
)
$file_list_raw is Array
(
    [0] => Data/current/1000930.jf
    [1] => Data/current/1008087.jf
    [2] => Data/current/1008089.jf
    [3] => Data/current/1017216.jf
    [4] => Data/current/1021454.jf
    [5] => Data/current/790060.jf
    [6] => Data/current/807565.jf
    [7] => Data/current/807566.jf
    [8] => Data/current/819585.jf
    [9] => Data/current/832627.jf
    [10] => Data/current/840298.jf
    [11] => Data/current/840299.jf
    [12] => Data/current/840300.jf
    [13] => Data/current/840301.jf
    [14] => Data/current/840308.jf
    [15] => Data/current/844534.jf
    [16] => Data/current/844555.jf
    [17] => Data/current/859646.jf
    [18] => Data/current/859658.jf
    [19] => Data/current/859669.jf
    [20] => Data/current/865344.jf
    [21] => Data/current/872568.jf
    [22] => Data/current/872642.jf
    [23] => Data/current/879721.jf
    [24] => Data/current/883599.jf
    [25] => Data/current/883600.jf
    [26] => Data/current/883606.jf
    [27] => Data/current/887883.jf
    [28] => Data/current/888271.jf
    [29] => Data/current/888275.jf
    [30] => Data/current/901903.jf
    [31] => Data/current/903422.jf
    [32] => Data/current/904973.jf
    [33] => Data/current/904993.jf
    [34] => Data/current/926759.jf
    [35] => Data/current/929116.jf
    [36] => Data/current/929117.jf
    [37] => Data/current/929128.jf
    [38] => Data/current/929129.jf
    [39] => Data/current/940875.jf
    [40] => Data/current/940877.jf
    [41] => Data/current/942588.jf
    [42] => Data/current/951585.jf
    [43] => Data/current/954904.jf
    [44] => Data/current/999986.jf
)

Flushed OB. Downloading now. This may take some time...

At 1 seconds (key=0)
array key 0 skipped. (Looking for group 2. 0 mod 4 = 0)

At 1 seconds (key=1)
array key 1 skipped. (Looking for group 2. 1 mod 4 = 1)

At 1 seconds (key=2)
  Starting to fetch data
  Fetched 150,076 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/1008089.csv' in 3 s at rate of 50,025 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/1008089.csv'
  Process reports that it wrote 150,076 bytes. OK.
  Extracted new restart as 447357
  Appended new restart data 447357 to file 'all_readings/1008089.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 4 seconds (key=3)
array key 3 skipped. (Looking for group 2. 3 mod 4 = 3)

At 4 seconds (key=4)
array key 4 skipped. (Looking for group 2. 4 mod 4 = 0)

At 4 seconds (key=5)
array key 5 skipped. (Looking for group 2. 5 mod 4 = 1)

At 4 seconds (key=6)
  Starting to fetch data
  Fetched 9,242,562 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/807565.csv' in 137 s at rate of 67,464 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/807565.csv'
  Process reports that it wrote 9,242,562 bytes. OK.
  Extracted new restart as 2345008
  Appended new restart data 2345008 to file 'all_readings/807565.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 142 seconds (key=7)
array key 7 skipped. (Looking for group 2. 7 mod 4 = 3)

At 142 seconds (key=8)
array key 8 skipped. (Looking for group 2. 8 mod 4 = 0)

At 142 seconds (key=9)
array key 9 skipped. (Looking for group 2. 9 mod 4 = 1)

At 142 seconds (key=10)
  Starting to fetch data
  Fetched 769,412 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/840298.csv' in 11 s at rate of 69,947 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/840298.csv'
  Process reports that it wrote 769,412 bytes. OK.
  Extracted new restart as 304488
  Appended new restart data 304488 to file 'all_readings/840298.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 153 seconds (key=11)
array key 11 skipped. (Looking for group 2. 11 mod 4 = 3)

At 153 seconds (key=12)
array key 12 skipped. (Looking for group 2. 12 mod 4 = 0)

At 153 seconds (key=13)
array key 13 skipped. (Looking for group 2. 13 mod 4 = 1)

At 153 seconds (key=14)
  Starting to fetch data
  Fetched 6,028,026 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/840308.csv' in 90 s at rate of 66,978 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/840308.csv'
  Process reports that it wrote 6,028,026 bytes. OK.
  Extracted new restart as 2340144
  Appended new restart data 2340144 to file 'all_readings/840308.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 243 seconds (key=15)
array key 15 skipped. (Looking for group 2. 15 mod 4 = 3)

At 243 seconds (key=16)
array key 16 skipped. (Looking for group 2. 16 mod 4 = 0)

At 243 seconds (key=17)
array key 17 skipped. (Looking for group 2. 17 mod 4 = 1)

At 243 seconds (key=18)
  Starting to fetch data
  Fetched 7,529,171 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/859658.csv' in 112 s at rate of 67,225 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/859658.csv'
  Process reports that it wrote 7,529,171 bytes. OK.
  Extracted new restart as 2467224
  Appended new restart data 2467224 to file 'all_readings/859658.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 356 seconds (key=19)
array key 19 skipped. (Looking for group 2. 19 mod 4 = 3)

At 356 seconds (key=20)
array key 20 skipped. (Looking for group 2. 20 mod 4 = 0)

At 356 seconds (key=21)
array key 21 skipped. (Looking for group 2. 21 mod 4 = 1)

At 356 seconds (key=22)
  Starting to fetch data
  Fetched 940,529 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/872642.csv' in 14 s at rate of 67,181 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/872642.csv'
  Process reports that it wrote 940,529 bytes. OK.
  Extracted new restart as 320276
  Appended new restart data 320276 to file 'all_readings/872642.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 370 seconds (key=23)
array key 23 skipped. (Looking for group 2. 23 mod 4 = 3)

At 370 seconds (key=24)
array key 24 skipped. (Looking for group 2. 24 mod 4 = 0)

At 370 seconds (key=25)
array key 25 skipped. (Looking for group 2. 25 mod 4 = 1)

At 370 seconds (key=26)
  Starting to fetch data
  Fetched 1,400,937 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/883606.csv' in 21 s at rate of 66,711 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/883606.csv'
  Process reports that it wrote 1,400,937 bytes. OK.
  Extracted new restart as 355847
  Appended new restart data 355847 to file 'all_readings/883606.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 391 seconds (key=27)
array key 27 skipped. (Looking for group 2. 27 mod 4 = 3)

At 391 seconds (key=28)
array key 28 skipped. (Looking for group 2. 28 mod 4 = 0)

At 391 seconds (key=29)
array key 29 skipped. (Looking for group 2. 29 mod 4 = 1)

At 391 seconds (key=30)
  Starting to fetch data
  Fetched 889,252 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/901903.csv' in 14 s at rate of 63,518 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/901903.csv'
  Process reports that it wrote 889,252 bytes. OK.
  Extracted new restart as 282378
  Appended new restart data 282378 to file 'all_readings/901903.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 405 seconds (key=31)
array key 31 skipped. (Looking for group 2. 31 mod 4 = 3)

At 405 seconds (key=32)
array key 32 skipped. (Looking for group 2. 32 mod 4 = 0)

At 405 seconds (key=33)
array key 33 skipped. (Looking for group 2. 33 mod 4 = 1)

At 405 seconds (key=34)
  Starting to fetch data
  Fetched 5,420,733 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/926759.csv' in 81 s at rate of 66,923 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/926759.csv'
  Process reports that it wrote 5,420,733 bytes. OK.
  Extracted new restart as 1622996
  Appended new restart data 1622996 to file 'all_readings/926759.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)
At 487 seconds (key=35)
array key 35 skipped. (Looking for group 2. 35 mod 4 = 3)

At 487 seconds (key=36)
array key 36 skipped. (Looking for group 2. 36 mod 4 = 0)

At 487 seconds (key=37)
array key 37 skipped. (Looking for group 2. 37 mod 4 = 1)

At 487 seconds (key=38)
  Starting to fetch data
  Fetched 3,521,346 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/929129.csv' in 52 s at rate of 67,718 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/929129.csv'
  Process reports that it wrote 3,521,346 bytes. OK.
  Extracted new restart as 829121
  Appended new restart data 829121 to file 'all_readings/929129.restart.txp'
  Process reports that it wrote 7 bytes. OK.
  (Printed and reset $echo)
At 539 seconds (key=39)
array key 39 skipped. (Looking for group 2. 39 mod 4 = 3)

At 539 seconds (key=40)
array key 40 skipped. (Looking for group 2. 40 mod 4 = 0)

At 539 seconds (key=41)
array key 41 skipped. (Looking for group 2. 41 mod 4 = 1)

At 539 seconds (key=42)
  Starting to fetch data
  Fetched 3,432,662 bytes from 'http://pooles.bcra.org.uk:3927/Exports/all_readings/951585.csv' in 52 s at rate of 66,013 B/s
Experimental mining for Vbatt_chk. Code not finished.
  Saved file to 'all_readings/951585.csv'
  Process reports that it wrote 3,432,662 bytes. OK.
  Extracted new restart as 1894643
  Appended new restart data 1894643 to file 'all_readings/951585.restart.txp'
  Process reports that it wrote 8 bytes. OK.
  (Printed and reset $echo)

FINISHED first processing pass. Now looking at *.jf files ...

Now scanning for *.jf files ...

At 591 seconds(key=0)
array key 0 skipped. (Looking for group 2. 0 mod 4 = 0)

At 591 seconds(key=1)
array key 1 skipped. (Looking for group 2. 1 mod 4 = 1)

At 591 seconds(key=2)
  Starting to fetch data
  Fetched 38,752 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/1008089.jf' in 2 s at rate of 19,376 B/s
  Saved file to 'all_readings/1008089.jf'
  Process reports that it wrote 38,752 bytes. OK.
  (Printed and reset $echo)
At 593 seconds(key=3)
array key 3 skipped. (Looking for group 2. 3 mod 4 = 3)

At 593 seconds(key=4)
array key 4 skipped. (Looking for group 2. 4 mod 4 = 0)

At 593 seconds(key=5)
array key 5 skipped. (Looking for group 2. 5 mod 4 = 1)

At 593 seconds(key=6)
  Starting to fetch data
  Fetched 2,360,394 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/807565.jf' in 35 s at rate of 67,440 B/s
  Saved file to 'all_readings/807565.jf'
  Process reports that it wrote 2,360,394 bytes. OK.
  (Printed and reset $echo)
At 628 seconds(key=7)
array key 7 skipped. (Looking for group 2. 7 mod 4 = 3)

At 628 seconds(key=8)
array key 8 skipped. (Looking for group 2. 8 mod 4 = 0)

At 628 seconds(key=9)
array key 9 skipped. (Looking for group 2. 9 mod 4 = 1)

At 628 seconds(key=10)
  Starting to fetch data
  Fetched 307,887 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/840298.jf' in 5 s at rate of 61,577 B/s
  Saved file to 'all_readings/840298.jf'
  Process reports that it wrote 307,887 bytes. OK.
  (Printed and reset $echo)
At 633 seconds(key=11)
array key 11 skipped. (Looking for group 2. 11 mod 4 = 3)

At 633 seconds(key=12)
array key 12 skipped. (Looking for group 2. 12 mod 4 = 0)

At 633 seconds(key=13)
array key 13 skipped. (Looking for group 2. 13 mod 4 = 1)

At 633 seconds(key=14)
  Starting to fetch data
  Fetched 2,042,825 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/840308.jf' in 30 s at rate of 68,094 B/s
  Saved file to 'all_readings/840308.jf'
  Process reports that it wrote 2,042,825 bytes. OK.
  (Printed and reset $echo)
At 663 seconds(key=15)
array key 15 skipped. (Looking for group 2. 15 mod 4 = 3)

At 663 seconds(key=16)
array key 16 skipped. (Looking for group 2. 16 mod 4 = 0)

At 663 seconds(key=17)
array key 17 skipped. (Looking for group 2. 17 mod 4 = 1)

At 663 seconds(key=18)
  Starting to fetch data
  Fetched 2,485,704 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/859658.jf' in 37 s at rate of 67,181 B/s
  Saved file to 'all_readings/859658.jf'
  Process reports that it wrote 2,485,704 bytes. OK.
  (Printed and reset $echo)
At 700 seconds(key=19)
array key 19 skipped. (Looking for group 2. 19 mod 4 = 3)

At 700 seconds(key=20)
array key 20 skipped. (Looking for group 2. 20 mod 4 = 0)

At 700 seconds(key=21)
array key 21 skipped. (Looking for group 2. 21 mod 4 = 1)

At 700 seconds(key=22)
  Starting to fetch data
  Fetched 322,967 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/872642.jf' in 5 s at rate of 64,593 B/s
  Saved file to 'all_readings/872642.jf'
  Process reports that it wrote 322,967 bytes. OK.
  (Printed and reset $echo)
At 705 seconds(key=23)
array key 23 skipped. (Looking for group 2. 23 mod 4 = 3)

At 705 seconds(key=24)
array key 24 skipped. (Looking for group 2. 24 mod 4 = 0)

At 705 seconds(key=25)
array key 25 skipped. (Looking for group 2. 25 mod 4 = 1)

At 705 seconds(key=26)
  Starting to fetch data
  Fetched 359,351 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/883606.jf' in 5 s at rate of 71,870 B/s
  Saved file to 'all_readings/883606.jf'
  Process reports that it wrote 359,351 bytes. OK.
  (Printed and reset $echo)
At 710 seconds(key=27)
array key 27 skipped. (Looking for group 2. 27 mod 4 = 3)

At 710 seconds(key=28)
array key 28 skipped. (Looking for group 2. 28 mod 4 = 0)

At 710 seconds(key=29)
array key 29 skipped. (Looking for group 2. 29 mod 4 = 1)

At 710 seconds(key=30)
  Starting to fetch data
  Fetched 284,100 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/901903.jf' in 5 s at rate of 56,820 B/s
  Saved file to 'all_readings/901903.jf'
  Process reports that it wrote 284,100 bytes. OK.
  (Printed and reset $echo)
At 715 seconds(key=31)
array key 31 skipped. (Looking for group 2. 31 mod 4 = 3)

At 715 seconds(key=32)
array key 32 skipped. (Looking for group 2. 32 mod 4 = 0)

At 715 seconds(key=33)
array key 33 skipped. (Looking for group 2. 33 mod 4 = 1)

At 715 seconds(key=34)
  Starting to fetch data
  Fetched 1,635,783 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/926759.jf' in 24 s at rate of 68,158 B/s
  Saved file to 'all_readings/926759.jf'
  Process reports that it wrote 1,635,783 bytes. OK.
  (Printed and reset $echo)
At 739 seconds(key=35)
array key 35 skipped. (Looking for group 2. 35 mod 4 = 3)

At 739 seconds(key=36)
array key 36 skipped. (Looking for group 2. 36 mod 4 = 0)

At 739 seconds(key=37)
array key 37 skipped. (Looking for group 2. 37 mod 4 = 1)

At 739 seconds(key=38)
  Starting to fetch data
  Fetched 837,364 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/929129.jf' in 13 s at rate of 64,413 B/s
  Saved file to 'all_readings/929129.jf'
  Process reports that it wrote 837,364 bytes. OK.
  (Printed and reset $echo)
At 752 seconds(key=39)
array key 39 skipped. (Looking for group 2. 39 mod 4 = 3)

At 752 seconds(key=40)
array key 40 skipped. (Looking for group 2. 40 mod 4 = 0)

At 752 seconds(key=41)
array key 41 skipped. (Looking for group 2. 41 mod 4 = 1)

At 752 seconds(key=42)
  Starting to fetch data
  Fetched 1,184,013 bytes from 'http://pooles.bcra.org.uk:3927/Data/current/951585.jf' in 17 s at rate of 69,648 B/s
  Saved file to 'all_readings/951585.jf'
  Process reports that it wrote 1,184,013 bytes. OK.
  (Printed and reset $echo)
A total of 51,183,928 file bytes were written in 769 seconds.

At 769 seconds(key=43) array key 43 skipped. (Looking for group 2. 43 mod 4 = 3) At 769 seconds(key=44) array key 44 skipped. (Looking for group 2. 44 mod 4 = 0)

FINISHED