Board index FlightGear Development Scenery

Unreliable terrasync

Questions and discussion about enhancing and populating the FlightGear world.

Unreliable terrasync

Postby mathieugouin » Sat Feb 23, 2019 3:45 am

Hello,

I'm not sure I'm posting to the right forum...

I experience what seems to be unreliable terrasync download.

I have FG 2018.1.1.

I have enabled terrasync from my .fgfsrc as:
Code: Select all
--enable-terrasync


The terrain is loaded but the some objects are sometimes not present.

I looked at the fgfs.log. From there I see lines that worry me. I have listed only lines with terrasync & failed in them. Let me know if you would need the full log.
Code: Select all
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Buildings/w080n40/w073n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Buildings/w080n40/w073n45'
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Roads/w080n40/w073n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Roads/w080n40/w073n45'
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Pylons/w080n40/w073n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Pylons/w080n40/w073n45'
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Buildings/w080n40/w074n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Buildings/w080n40/w074n45'
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Roads/w080n40/w074n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Roads/w080n40/w074n45'
terrasync:4:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/io/HTTPRepository.cxx:1105:Failed to get root of repo:https://mpserver16.flightgear.org/scenery/Pylons/w080n40/w074n45 7
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:724:Failed to sync'Pylons/w080n40/w074n45'


Could this be because I run a too old FG version?

Thanks in advance!
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby wkitty42 » Sat Feb 23, 2019 8:06 am

No, it is likely that there are none of those objects in that tile directory... Oh, wait... That's failed to sync?? I can't check my system right now but if you post a "reminder" message, I can check it out next time I'm on in a few hours...
"You get more air close to the ground," said Angalo. "I read that in a book. You get lots of air low down, and not much when you go up."
"Why not?" said Gurder.
"Dunno. It's frightened of heights, I guess."
User avatar
wkitty42
 
Posts: 9148
Joined: Fri Feb 20, 2015 4:46 pm
Location: central NC, USA
Callsign: wk42
Version: git next
OS: Kubuntu 20.04

Re: Unreliable terrasync

Postby mathieugouin » Sat Feb 23, 2019 3:47 pm

Sure I will remind you in a few hours.

If it can help investigation, I added a few weeks ago some objects around CYHU using the scene models map. The objects got approved and I see them on the scenery map.

Could this be that not all mirrors are updated at the same time?

Thanks again!
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby wkitty42 » Sat Feb 23, 2019 6:52 pm

it is possible that a/some mirrors are not fully up to sync... if that's the case, then a note in the developer's mailing list on SF generally takes care of that...

now that i've had some sleep and a few minutes answering this post, i can say that the messages you posted above are legitimate and normal... the "w080n40" directory simply does not exist in the "Buildings", "Roads", or "Pylons" directories in terrasync... you'll see the same types of messages when flying over areas that don't have objects in them... FG will make requests to see if there are objects and if not, it will report that with messages similar to those above...
"You get more air close to the ground," said Angalo. "I read that in a book. You get lots of air low down, and not much when you go up."
"Why not?" said Gurder.
"Dunno. It's frightened of heights, I guess."
User avatar
wkitty42
 
Posts: 9148
Joined: Fri Feb 20, 2015 4:46 pm
Location: central NC, USA
Callsign: wk42
Version: git next
OS: Kubuntu 20.04

Re: Unreliable terrasync

Postby mathieugouin » Tue Feb 26, 2019 4:41 am

if that's the case, then a note in the developer's mailing list on SF generally takes care of that...


Do you recommend I post a question about that on the mailing list?

Thanks
Mathieu
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby wkitty42 » Tue Feb 26, 2019 1:28 pm

only if the mirror(s) your system uses are not up to date...
"You get more air close to the ground," said Angalo. "I read that in a book. You get lots of air low down, and not much when you go up."
"Why not?" said Gurder.
"Dunno. It's frightened of heights, I guess."
User avatar
wkitty42
 
Posts: 9148
Joined: Fri Feb 20, 2015 4:46 pm
Location: central NC, USA
Callsign: wk42
Version: git next
OS: Kubuntu 20.04

Re: Unreliable terrasync

Postby mathieugouin » Wed Feb 27, 2019 6:13 am

Ok, I have confirmation of a faulty mirror:

Code: Select all
terrasync:3:/build/simgear-neYw_f/simgear-2018.1.1+dfsg/simgear/scene/tsync/terrasync.cxx:630:terrasync scenery provider of the day is 'https://ukmirror.flightgear.org/fgscenery'
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby wkitty42 » Fri Mar 01, 2019 1:10 am

are you saying that you are not having the same tile problem with the other scenery servers?
the line above is only telling us that your sim has chosen the ukmirror server but nothing about the tiles you were reporting as problematic with some other server...
"You get more air close to the ground," said Angalo. "I read that in a book. You get lots of air low down, and not much when you go up."
"Why not?" said Gurder.
"Dunno. It's frightened of heights, I guess."
User avatar
wkitty42
 
Posts: 9148
Joined: Fri Feb 20, 2015 4:46 pm
Location: central NC, USA
Callsign: wk42
Version: git next
OS: Kubuntu 20.04

Re: Unreliable terrasync

Postby mathieugouin » Fri Mar 01, 2019 2:21 am

I'm saying with this mirror, the tower I added for CYHU airport is not showing.

Is it possible to force another mirror?

I'm not sure how the mirror selection works but I'm surprised to be directed to a UK mirror while I'm in Canada...
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby wkitty42 » Fri Mar 01, 2019 6:34 pm

there are only a few mirrors, currently... yes, you can force a scenery server... i use the following in the launcher's "additional settings" box or in a --config=blah.xml or in a .fgfsrc...
Code: Select all
################################################################
# terrasync server overrides.
# FG will use the uncommented entry for terrasync.
# remember to uncomment only one entry at a time.
################################################################
#--prop:/sim/terrasync/http-server=automatic
--prop:/sim/terrasync/http-server=http://flightgear.sourceforge.net/scenery
#--prop:/sim/terrasync/http-server=http://fgfs.goneabitbursar.com/terrascenery
#--prop:/sim/terrasync/http-server=http://ns334561.ip-5-196-65.eu/terrasync
#--prop:/sim/terrasync/http-server=https://ukmirror.flightgear.org/fgscenery
#--prop:/sim/terrasync/http-server=https://dream.t3r.de/fgscenery
#--prop:/sim/terrasync/http-server=https://mpserver16.flightgear.org/scenery
################################################################


when automatic is selected, FG will query the DNS for NAPTR records to select which terrasync server to use... a couple of them are currently disabled... you can find them with the following command
Code: Select all
dig terrasync.flightgear.org ANY
... that's how i got the above list that i'm using...

the above command will return results similar to these
Code: Select all
; <<>> DiG 9.9.5-3ubuntu0.19-Ubuntu <<>> terrasync.flightgear.org ANY
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 1928
;; flags: qr rd ra; QUERY: 1, ANSWER: 6, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;terrasync.flightgear.org.      IN      ANY

;; ANSWER SECTION:
terrasync.flightgear.org. 599   IN      NAPTR   100 50 "U" "disabled" "!^.*$!http://ns334561.ip-5-196-65.eu/terrasync!" .
terrasync.flightgear.org. 599   IN      NAPTR   100 100 "U" "ws20" "!^.*$!http://flightgear.sourceforge.net/scenery!" .
terrasync.flightgear.org. 599   IN      NAPTR   100 50 "U" "disabled" "!^.*$!http://fgfs.goneabitbursar.com/terrascenery!" .
terrasync.flightgear.org. 599   IN      NAPTR   100 50 "U" "ws20" "!^.*$!https://mpserver16.flightgear.org/scenery!" .
terrasync.flightgear.org. 599   IN      NAPTR   100 50 "U" "ws20" "!^.*$!https://ukmirror.flightgear.org/fgscenery!" .
terrasync.flightgear.org. 599   IN      NAPTR   100 50 "U" "ws20" "!^.*$!https://dream.t3r.de/fgscenery!" .

;; Query time: 41 msec
;; SERVER: 192.168.42.1#53(192.168.42.1)
;; WHEN: Fri Mar 01 12:23:42 EST 2019
;; MSG SIZE  rcvd: 489

there is also this (slightly outdated) wiki page: http://wiki.flightgear.org/Dns
"You get more air close to the ground," said Angalo. "I read that in a book. You get lots of air low down, and not much when you go up."
"Why not?" said Gurder.
"Dunno. It's frightened of heights, I guess."
User avatar
wkitty42
 
Posts: 9148
Joined: Fri Feb 20, 2015 4:46 pm
Location: central NC, USA
Callsign: wk42
Version: git next
OS: Kubuntu 20.04

Re: Unreliable terrasync

Postby mathieugouin » Fri Mar 01, 2019 11:52 pm

That is a perfect explanation! Thank you very much!

This way I'll be able to test other servers to confirm which one are not updated.

I'll report back.
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby mathieugouin » Mon Mar 11, 2019 3:35 am

Ok, so I've done more tests...

As of today my dig output is as follows:

Code: Select all
dig terrasync.flightgear.org ANY

; <<>> DiG 9.11.3-1ubuntu1.5-Ubuntu <<>> terrasync.flightgear.org ANY
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 44920
;; flags: qr rd ra; QUERY: 1, ANSWER: 6, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;terrasync.flightgear.org.   IN   ANY

;; ANSWER SECTION:
terrasync.flightgear.org. 600   IN   NAPTR   100 100 "U" "ws20" "!^.*$!http://flightgear.sourceforge.net/scenery!" .
terrasync.flightgear.org. 600   IN   NAPTR   100 50 "U" "ws20" "!^.*$!https://ukmirror.flightgear.org/fgscenery!" .
terrasync.flightgear.org. 600   IN   NAPTR   100 50 "U" "ws20" "!^.*$!https://dream.t3r.de/fgscenery!" .
terrasync.flightgear.org. 600   IN   NAPTR   100 50 "U" "ws20" "!^.*$!https://mpserver16.flightgear.org/scenery!" .
terrasync.flightgear.org. 600   IN   NAPTR   100 50 "U" "disabled" "!^.*$!http://fgfs.goneabitbursar.com/terrascenery!" .
terrasync.flightgear.org. 600   IN   NAPTR   100 50 "U" "disabled" "!^.*$!http://ns334561.ip-5-196-65.eu/terrasync!" .

;; Query time: 106 msec
;; SERVER: 127.0.0.53#53(127.0.0.53)
;; WHEN: Sun Mar 10 22:24:09 EDT 2019
;; MSG SIZE  rcvd: 489


Here are my reports of server update status. I performed my tests on the CYHU airport. I recently added a tower and if I see the tower, it is my cue for an updated server. Sitting on the 06L runway, the tower should be slightly at the right, down the runway.

I tried various server with the --props in my .fgfsrc

  • --prop:/sim/terrasync/http-server=automatic : not updated, probably falling back to ukmirror
  • --prop:/sim/terrasync/http-server=https://ukmirror.flightgear.org/fgscenery : not updated
  • --prop:/sim/terrasync/http-server=https://dream.t3r.de/fgscenery : updated
  • --prop:/sim/terrasync/http-server=https://mpserver16.flightgear.org/scenery : updated
  • --prop:/sim/terrasync/http-server=http://flightgear.sourceforge.net/scenery : updated
  • --prop:/sim/terrasync/http-server=http://fgfs.goneabitbursar.com/terrascenery : did not try because of the disabled dig report
  • --prop:/sim/terrasync/http-server=http://ns334561.ip-5-196-65.eu/terrasync : did not try because of the disabled dig report

Can somebody with server knowledge confirm the issue?

On my side, I can work with hardcoding a server, but the fact that the airport was sometimes showing up, sometimes not was driving me nuts... probably the automatic server setting alternating between an updated vs non-updated server.

Thanks!
Mathieu
mathieugouin
 
Posts: 36
Joined: Thu Jan 06, 2011 4:37 am
Location: CYHU
Callsign: MGOUIN
Version: V2018.1.1
OS: Lubuntu 18.04

Re: Unreliable terrasync

Postby Torsten » Mon Mar 11, 2019 8:16 am

This looks like the syncing of the ukmirror hangs. I just sent a heads up to it's operator.

FWIW the .dirindex file at the root of the scenery directory has a timestamp:
https://ukmirror.flightgear.org/fgscenery/.dirindex
Code: Select all
version:1
path:
time:20181127-10:36Z
d:Airports:511efdcb7f3baeaf20649ccfc260a31302d861cb
d:Models:9f7800a930f8506db7aa5e4a8b0e06b283d3db3a
d:Objects:dbe2c170c7c9d6916fdf05b57eaa2d91d6598821
d:Terrain:54ae7b64d9b3b068c188e0c13ee749fcffab23f8
d:Buildings:19060725efc2a301fa6844991e2922d42d8de5e2
d:Pylons:378b3dd58ce3058f2992b70aa5ecf8947a4d7f9e
d:Roads:89f8f10406041948368c76c0a2e794d45ac536b7


https://dream.t3r.de/fgscenery/.dirindex
Code: Select all
version:1
path:
time:20190307-08:23Z
d:Airports:511efdcb7f3baeaf20649ccfc260a31302d861cb
d:Models:09704d0e5bfc73f2d1ada0a0433ba8c22781862b
d:Objects:17b727ca0f3bb83a200fd7695a5044cf5e81b908
d:Terrain:54ae7b64d9b3b068c188e0c13ee749fcffab23f8
d:Buildings:19060725efc2a301fa6844991e2922d42d8de5e2
d:Pylons:378b3dd58ce3058f2992b70aa5ecf8947a4d7f9e
d:Roads:89f8f10406041948368c76c0a2e794d45ac536b7


See that the ukmirror has not received any updates since November last year and the Objects hash differs. Interesting that nobody noticed earlier.

Thanks for pointing this one out. And sorry for the trouble this caused.

Torsten
flightgear.org - where development happens.
User avatar
Torsten
 
Posts: 648
Joined: Fri Feb 01, 2008 10:22 pm
Location: near Hamburg, Germany
Callsign: offline
Version: next
OS: Linux

Re: Unreliable terrasync

Postby V12 » Mon Mar 11, 2019 2:08 pm

mathieugouin wrote in Mon Mar 11, 2019 3:35 am:
  • --prop:/sim/terrasync/http-server=automatic : not updated, probably falling back to ukmirror
  • --prop:/sim/terrasync/http-server=https://ukmirror.flightgear.org/fgscenery : not updated
  • --prop:/sim/terrasync/http-server=https://dream.t3r.de/fgscenery : updated
  • --prop:/sim/terrasync/http-server=https://mpserver16.flightgear.org/scenery : updated
  • --prop:/sim/terrasync/http-server=http://flightgear.sourceforge.net/scenery : updated
  • --prop:/sim/terrasync/http-server=http://fgfs.goneabitbursar.com/terrascenery : did not try because of the disabled dig report
  • --prop:/sim/terrasync/http-server=http://ns334561.ip-5-196-65.eu/terrasync : did not try because of the disabled dig report

For me, not updated, some objects are still with wrong positions, I used update form 3 days ago. ukmirror have not any my objects submited 2019.03.01
Fly high, fly fast - fly Concorde !
V12
 
Posts: 2757
Joined: Thu Jan 12, 2017 5:27 pm
Location: LZIB
Callsign: BAWV12

Re: Unreliable terrasync

Postby V12 » Tue Mar 12, 2019 7:47 am

Database updated, elevation values for LZIB are new, evening will test in FG.

EDIT :
Object's elevations are OK.
Fly high, fly fast - fly Concorde !
V12
 
Posts: 2757
Joined: Thu Jan 12, 2017 5:27 pm
Location: LZIB
Callsign: BAWV12

Next

Return to Scenery

Who is online

Users browsing this forum: No registered users and 6 guests