Downloading Flights =================== This notebook dumps flights to file using the OpenSky impala shell. Ensure you have correctly configured the ``traffic`` library before use, as well as setting the data location in ``~/.config/flight_processing/flight_processing.conf``. .. code:: ipython3 from flight_processing import DataConfig from flight_processing.data import FlightDownloader import logging logger = logging.getLogger() logger.setLevel(level=logging.INFO) logging.getLogger('traffic').disabled = True Example 1: known dataset ------------------------ This example uses the already encoded bounds of Switzerland to download flights. First we download the flights as a ``Traffic`` object, then we dump 1 hour of flights to a file, then finally we dump 3 more hours of flights to files in a single bulk command. .. code:: ipython3 # Initialise downloader downloader = FlightDownloader("switzerland") .. code:: ipython3 # Download one hour of flights as a usable object downloader.download_flights("2020-01-01 00:00", "2020-01-01 01:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-01-01 00:00:00 and 2020-01-01 01:00:00 from OpenSky. INFO:root:Sending request between time 2020-01-01 00:00:00+00:00 and 2020-01-01 01:00:00+00:00 and hour 2020-01-01 00:00:00+00:00 and 2020-01-01 01:00:00+00:00 INFO:paramiko.transport:Connected (version 2.0, client OpenSSH_7.6p1) INFO:paramiko.transport:Authentication (password) successful! INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1577836800.0 and hour<1577840400.0 and time>=1577836800.0 and time<1577840400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/c564afed75a09badb9ce574a5b0e280a INFO:numexpr.utils:Note: NumExpr detected 32 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 8. INFO:numexpr.utils:NumExpr defaulting to 8 threads. .. raw:: html Traffic with 13 identifiers
count
icao24 callsign
4b1806 SWR 3599
4b180b SWR1327 3596
4b17fb SWR193V 2156
424352 AFL2605 1591
3965ab AFR470 1546
4b5c4d FLORI513 1385
4b5c61 FLORI539 1011
300621 IBRXA 580
4b1808 SWR121E 540
471ee2 WZZ6192 470
.. code:: ipython3 # Download flights and dump as JSON downloader.dump_flights("2020-01-01 00:00", "2020-01-01 01:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-01-01 00:00:00 and 2020-01-01 01:00:00 from OpenSky. INFO:root:Sending request between time 2020-01-01 00:00:00+00:00 and 2020-01-01 01:00:00+00:00 and hour 2020-01-01 00:00:00+00:00 and 2020-01-01 01:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1577836800.0 and hour<1577840400.0 and time>=1577836800.0 and time<1577840400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/c564afed75a09badb9ce574a5b0e280a INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland/20200101/0000.json. .. code:: ipython3 # Download 3 hours of flights and dump as JSON files downloader.dump_flights_bulk("2020-01-01 01:00", "2020-01-01 04:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights in bulk between 2020-01-01 01:00:00 and 2020-01-01 04:00:00. INFO:flight_processing.utils:Executing function 3 times between 2020-01-01 01:00:00 and 2020-01-01 04:00:00 with time delta 1:00:00. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-01-01 01:00:00 and 2020-01-01 02:00:00 from OpenSky. INFO:root:Sending request between time 2020-01-01 01:00:00+00:00 and 2020-01-01 02:00:00+00:00 and hour 2020-01-01 01:00:00+00:00 and 2020-01-01 02:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1577840400.0 and hour<1577844000.0 and time>=1577840400.0 and time<1577844000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/d64591914eb130bfebbbc8c9f09583d7 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland/20200101/0100.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-01-01 02:00:00 and 2020-01-01 03:00:00 from OpenSky. INFO:root:Sending request between time 2020-01-01 02:00:00+00:00 and 2020-01-01 03:00:00+00:00 and hour 2020-01-01 02:00:00+00:00 and 2020-01-01 03:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1577844000.0 and hour<1577847600.0 and time>=1577844000.0 and time<1577847600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/499b9720d5965dd1bcdf84191f90b274 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland/20200101/0200.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-01-01 03:00:00 and 2020-01-01 04:00:00 from OpenSky. INFO:root:Sending request between time 2020-01-01 03:00:00+00:00 and 2020-01-01 04:00:00+00:00 and hour 2020-01-01 03:00:00+00:00 and 2020-01-01 04:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1577847600.0 and hour<1577851200.0 and time>=1577847600.0 and time<1577851200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/f3e766e3c770358e6940973dc90241ff INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland/20200101/0300.json. .. code:: ipython3 # Cleanup del downloader Example 2: new dataset ---------------------- This example manually encodes the bounds of Switzerland to download flights in the same way as above - this can be done with any country or region. First we download the flights as a ``Traffic`` object, then we dump 1 hour of flights to a file, then finally we dump 23 more hours of flights to files in a single bulk command. .. code:: ipython3 dataset = DataConfig("switzerland-custom", minlon=5.3, maxlon=10.7, minlat=45.5, maxlat=48, detail=6) downloader = FlightDownloader(dataset) .. code:: ipython3 # Download one hour of flights as a usable object downloader.download_flights("2020-03-05 00:00", "2020-03-05 01:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 00:00:00 and 2020-03-05 01:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 00:00:00+00:00 and 2020-03-05 01:00:00+00:00 and hour 2020-03-05 00:00:00+00:00 and 2020-03-05 01:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583366400.0 and hour<1583370000.0 and time>=1583366400.0 and time<1583370000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/28d19cb664ef3c215b572a288db119ad .. raw:: html Traffic with 15 identifiers
count
icao24 callsign
4b17fe SWR 3599
3e0a38 BPO245 2761
4ca7f9 ABR1624 2383
01d78d ECHO2 1991
44014a EJU9044 1990
424350 AFL2605 1660
06a1e6 QTR8111 1539
4caa86 ANE2021 1400
451dbd BCS130 622
4b43aa RGA2 545
.. code:: ipython3 # Download flights and dump as JSON downloader.dump_flights("2020-03-05 00:00", "2020-03-05 01:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 00:00:00 and 2020-03-05 01:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 00:00:00+00:00 and 2020-03-05 01:00:00+00:00 and hour 2020-03-05 00:00:00+00:00 and 2020-03-05 01:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583366400.0 and hour<1583370000.0 and time>=1583366400.0 and time<1583370000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/28d19cb664ef3c215b572a288db119ad INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0000.json. .. code:: ipython3 # Download 23 hours of flights and dump as JSON files downloader.dump_flights_bulk("2020-03-05 01:00", "2020-03-06 00:00") .. parsed-literal:: INFO:flight_processing.data.flight_downloader:Downloading flights in bulk between 2020-03-05 01:00:00 and 2020-03-06 00:00:00. INFO:flight_processing.utils:Executing function 23 times between 2020-03-05 01:00:00 and 2020-03-06 00:00:00 with time delta 1:00:00. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 01:00:00 and 2020-03-05 02:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 01:00:00+00:00 and 2020-03-05 02:00:00+00:00 and hour 2020-03-05 01:00:00+00:00 and 2020-03-05 02:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583370000.0 and hour<1583373600.0 and time>=1583370000.0 and time<1583373600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/8e0925cfa17b75fa340f324dde14be5b INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0100.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 02:00:00 and 2020-03-05 03:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 02:00:00+00:00 and 2020-03-05 03:00:00+00:00 and hour 2020-03-05 02:00:00+00:00 and 2020-03-05 03:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583373600.0 and hour<1583377200.0 and time>=1583373600.0 and time<1583377200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/768917fa05acf32f1b0afb2d9e8d346f INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0200.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 03:00:00 and 2020-03-05 04:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 03:00:00+00:00 and 2020-03-05 04:00:00+00:00 and hour 2020-03-05 03:00:00+00:00 and 2020-03-05 04:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583377200.0 and hour<1583380800.0 and time>=1583377200.0 and time<1583380800.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/aed113955f3719266442fb2043f6fc63 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0300.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 04:00:00 and 2020-03-05 05:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 04:00:00+00:00 and 2020-03-05 05:00:00+00:00 and hour 2020-03-05 04:00:00+00:00 and 2020-03-05 05:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583380800.0 and hour<1583384400.0 and time>=1583380800.0 and time<1583384400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/99ec6c6a35b95a313b6037c93e0c7c16 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0400.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 05:00:00 and 2020-03-05 06:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 05:00:00+00:00 and 2020-03-05 06:00:00+00:00 and hour 2020-03-05 05:00:00+00:00 and 2020-03-05 06:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583384400.0 and hour<1583388000.0 and time>=1583384400.0 and time<1583388000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/defdd4e424d43bcdeffda3431fcc0310 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0500.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 06:00:00 and 2020-03-05 07:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 06:00:00+00:00 and 2020-03-05 07:00:00+00:00 and hour 2020-03-05 06:00:00+00:00 and 2020-03-05 07:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583388000.0 and hour<1583391600.0 and time>=1583388000.0 and time<1583391600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/7657b84539c72f6f617fa4f5095a1f58 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0600.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 07:00:00 and 2020-03-05 08:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 07:00:00+00:00 and 2020-03-05 08:00:00+00:00 and hour 2020-03-05 07:00:00+00:00 and 2020-03-05 08:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583391600.0 and hour<1583395200.0 and time>=1583391600.0 and time<1583395200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/1b393565cff9a9d899b9fb460985bd31 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0700.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 08:00:00 and 2020-03-05 09:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 08:00:00+00:00 and 2020-03-05 09:00:00+00:00 and hour 2020-03-05 08:00:00+00:00 and 2020-03-05 09:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583395200.0 and hour<1583398800.0 and time>=1583395200.0 and time<1583398800.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/e7baff3622fe47dde6ce7d1ddaf4fd2a INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0800.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 09:00:00 and 2020-03-05 10:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 09:00:00+00:00 and 2020-03-05 10:00:00+00:00 and hour 2020-03-05 09:00:00+00:00 and 2020-03-05 10:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583398800.0 and hour<1583402400.0 and time>=1583398800.0 and time<1583402400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/e64ea6e6ed69db83bda3c5cca3f6c8d8 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/0900.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 10:00:00 and 2020-03-05 11:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 10:00:00+00:00 and 2020-03-05 11:00:00+00:00 and hour 2020-03-05 10:00:00+00:00 and 2020-03-05 11:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583402400.0 and hour<1583406000.0 and time>=1583402400.0 and time<1583406000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/6ed2a01f81890dca2fdb6aedc1acd0e7 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1000.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 11:00:00 and 2020-03-05 12:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 11:00:00+00:00 and 2020-03-05 12:00:00+00:00 and hour 2020-03-05 11:00:00+00:00 and 2020-03-05 12:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583406000.0 and hour<1583409600.0 and time>=1583406000.0 and time<1583409600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/3a94a12f2d398a9c3e44d1d35ae7b3e6 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1100.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 12:00:00 and 2020-03-05 13:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 12:00:00+00:00 and 2020-03-05 13:00:00+00:00 and hour 2020-03-05 12:00:00+00:00 and 2020-03-05 13:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583409600.0 and hour<1583413200.0 and time>=1583409600.0 and time<1583413200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/1a7860026859e0a77453a5d0364237c8 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1200.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 13:00:00 and 2020-03-05 14:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 13:00:00+00:00 and 2020-03-05 14:00:00+00:00 and hour 2020-03-05 13:00:00+00:00 and 2020-03-05 14:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583413200.0 and hour<1583416800.0 and time>=1583413200.0 and time<1583416800.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/d5cdf044b798d884e72d3e33d67ea7e0 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1300.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 14:00:00 and 2020-03-05 15:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 14:00:00+00:00 and 2020-03-05 15:00:00+00:00 and hour 2020-03-05 14:00:00+00:00 and 2020-03-05 15:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583416800.0 and hour<1583420400.0 and time>=1583416800.0 and time<1583420400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/156af8f9396f40c58016f78d14cb2def INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1400.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 15:00:00 and 2020-03-05 16:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 15:00:00+00:00 and 2020-03-05 16:00:00+00:00 and hour 2020-03-05 15:00:00+00:00 and 2020-03-05 16:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583420400.0 and hour<1583424000.0 and time>=1583420400.0 and time<1583424000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/ecb8c2e81440276aabe8f4832a805c75 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1500.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 16:00:00 and 2020-03-05 17:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 16:00:00+00:00 and 2020-03-05 17:00:00+00:00 and hour 2020-03-05 16:00:00+00:00 and 2020-03-05 17:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583424000.0 and hour<1583427600.0 and time>=1583424000.0 and time<1583427600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/c45730969ec9b83ff33c4d3eff3dc60e INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1600.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 17:00:00 and 2020-03-05 18:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 17:00:00+00:00 and 2020-03-05 18:00:00+00:00 and hour 2020-03-05 17:00:00+00:00 and 2020-03-05 18:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583427600.0 and hour<1583431200.0 and time>=1583427600.0 and time<1583431200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/53ed8b22ff6b3044dfb091efffc627fc INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1700.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 18:00:00 and 2020-03-05 19:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 18:00:00+00:00 and 2020-03-05 19:00:00+00:00 and hour 2020-03-05 18:00:00+00:00 and 2020-03-05 19:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583431200.0 and hour<1583434800.0 and time>=1583431200.0 and time<1583434800.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/952e19914edd6e8664d84df765281b9b INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1800.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 19:00:00 and 2020-03-05 20:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 19:00:00+00:00 and 2020-03-05 20:00:00+00:00 and hour 2020-03-05 19:00:00+00:00 and 2020-03-05 20:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583434800.0 and hour<1583438400.0 and time>=1583434800.0 and time<1583438400.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/af571277f703242c929300e69b48aec8 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/1900.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 20:00:00 and 2020-03-05 21:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 20:00:00+00:00 and 2020-03-05 21:00:00+00:00 and hour 2020-03-05 20:00:00+00:00 and 2020-03-05 21:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583438400.0 and hour<1583442000.0 and time>=1583438400.0 and time<1583442000.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/ad27d798c072d7639bb8dd22fd33945d INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/2000.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 21:00:00 and 2020-03-05 22:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 21:00:00+00:00 and 2020-03-05 22:00:00+00:00 and hour 2020-03-05 21:00:00+00:00 and 2020-03-05 22:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583442000.0 and hour<1583445600.0 and time>=1583442000.0 and time<1583445600.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/167c4b60aa70a23e9c114ca47df3cd12 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/2100.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 22:00:00 and 2020-03-05 23:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 22:00:00+00:00 and 2020-03-05 23:00:00+00:00 and hour 2020-03-05 22:00:00+00:00 and 2020-03-05 23:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583445600.0 and hour<1583449200.0 and time>=1583445600.0 and time<1583449200.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/3984469e45cd2eae9fec9e43f49b7865 INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/2200.json. INFO:flight_processing.data.flight_downloader:Downloading flights between 2020-03-05 23:00:00 and 2020-03-06 00:00:00 from OpenSky. INFO:root:Sending request between time 2020-03-05 23:00:00+00:00 and 2020-03-06 00:00:00+00:00 and hour 2020-03-05 23:00:00+00:00 and 2020-03-06 00:00:00+00:00 INFO:root:Sending request: select time, icao24, lat, lon, velocity, heading, vertrate, callsign, onground, alert, spi, squawk, baroaltitude, geoaltitude, lastposupdate, lastcontact, hour from state_vectors_data4 where hour>=1583449200.0 and hour<1583452800.0 and time>=1583449200.0 and time<1583452800.0 and lon>=5.3 and lon<=10.7 and lat>=45.5 and lat<=48 INFO:root:Reading request in cache /mnt/cold_data/josh/traffic_cache/opensky/2b540de75ee1f39ce61cba8b9f086b3c INFO:flight_processing.data.flight_downloader:Converting flights to list of coordinates. INFO:flight_processing.data.flight_downloader:Dumping coordinates to JSON string. INFO:flight_processing.data.flight_downloader:Saving JSON flights to /mnt/cold_data/josh/processing/flights/switzerland-custom/20200305/2300.json. .. code:: ipython3 # Cleanup del downloader