Board index FlightGear Development Scenery

osm2city worldbuild

Questions and discussion about enhancing and populating the FlightGear world.

Re: osm2city worldbuild

Postby merspieler » Wed Apr 24, 2019 6:43 am

ok, then I'll provide you with a link for plain http, to the storage as soon as I've set it up.
Will you sync manually or should I have an after-build hook that calls your server to pull the update?
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby ludomotico » Wed Apr 24, 2019 3:43 pm

merspieler wrote in Thu Apr 04, 2019 9:23 am:[*] You may share the scenery (NOT the link but the files it self) under the terms of the GPL2+[/list]


Please, check openstreetmap license: https://www.openstreetmap.org/copyright

As far as I understand, if you "alter or build upon our data", the resulting work must be distributed under the ODbL, not the GPL2+.
User avatar
ludomotico
 
Posts: 1018
Joined: Tue Apr 24, 2012 1:01 pm
Version: git
OS: Debian GNU/Linux

Re: osm2city worldbuild

Postby merspieler » Thu Apr 25, 2019 12:12 am

Thanks for bringing this to my attention.
I've, worngly, assumed that GPL falls under ODbL 4.4 a. iii. : "A compatible license". Taking a closer look at this, shows, that it's incompatible.

I'll updated the initial post...

UPDATE:
Since I'm currently unable to update the initial post... assume the WTFPL for use
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby Johan G » Fri Apr 26, 2019 12:00 pm

merspieler wrote in Thu Apr 25, 2019 12:12 am:Taking a closer look at this, shows, that it's incompatible.

Hmm, that looks more like what data can be added to OpenStreetMap than the other way around. From the first section:
Our goal must be that consumers of OSM data can use our data with a high level of confidence that they can actually use the data on the terms of our distribution licence, the ODbL 1.0. To enable this, licences for data sources utilized for adding objects to OpenStreetMap or improving existing data need to be carefully vetted for compatibility.


But yes, ludmotico seem to be correct:
ludomotico wrote in Wed Apr 24, 2019 3:43 pm:Please, check openstreetmap license: https://www.openstreetmap.org/copyright

As far as I understand, if you "alter or build upon our data", the resulting work must be distributed under the ODbL, not the GPL2+.



(Sometimes I feel licences is a necessary evil that complicate things.)
Low-level flying — It's all fun and games till someone looses an engine. (Paraphrased from a YouTube video)
Improving the Dassault Mirage F1 (Wiki, Forum, GitLab. Work in slow progress)
Johan G
Moderator
 
Posts: 5546
Joined: Fri Aug 06, 2010 5:33 pm
Location: Sweden
Callsign: SE-JG
IRC name: Johan_G
Version: 3.0.0
OS: Windows 7, 32 bit

Re: osm2city worldbuild

Postby merspieler » Sun Apr 28, 2019 3:55 am

For all of you, who are interrested in some stats...
Download worldwide osm data:
Size 45GB
Time: 9h

Splitting world into 10 by 10 degrees areas: 2h 37m

For the testbuild I've been running with the e010n40 10 by 10 degrees area. This area has the 3rd densest coverage by osm.
Compressed osm file size: 3.3GB
In database size: 123.3GB
Database inport took: 11h 18m

I've build that tile once with and once without the stg building list (new feature in next):
Code: Select all
                |without|with           |savings
build time      |~6d    |unknown*       |unknown
scenery size    |42GB   |34GB           |19%
ziped size      |8.7GB  |7GB            |19.5%

*Build was interrupted so I've got only a very rough estimate, how long it took.

Due to the significant reduction in file size I'll run the worldbuild with the stg building list feature.
Last edited by merspieler on Mon Jun 03, 2019 12:33 am, edited 3 times in total.
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby vanosten » Sun Apr 28, 2019 6:04 am

In densely populated areas and if running with generating "missing" buildings, the sie reduction should actually be even more drastic with BUILDING_LIST. However: rendering in Windows will not work (it has been doing for months in Linux in the development version - I do not know about Mac) - and there is no ETA when someone with the necessary knowledge will have a look at.
Maintaining osm2city. Contributing with ground attack stuff to the OPRF FlightGear military-simulation community.
vanosten
 
Posts: 419
Joined: Sat Sep 25, 2010 5:38 pm
Location: Denmark - but I am Swiss
Callsign: HB-VANO
Version: latest
OS: Win 10 and Ubuntu

Re: osm2city worldbuild

Postby merspieler » Sat May 11, 2019 8:19 am

Since a few days, the initial post contains a Progress indication, example: Image
This shows, how many areas have already been build.
The scenery is build in the following way:
First the poles, then rows from south to north and every row from west to east.
If you want to find out, where the tile is, that's beeing currently build, see the following map:
Image
I hope, this give a little more insight, into the progress.
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby lomar » Sat May 25, 2019 11:09 pm

hello,
that's a nice initiative you have done here!
but i would like to ask for something: how would the worldbuild interact with the static objects? will it overwrite the already existing ones? and would a tile be regenerated whenever a new static object is added in it? how would it work?
also, if someone have more details about this OSM licensing issue, i'm interested in it as i'm also using their data on another project.

I wish you guys the best of luck with this project! it will be an enormous improvement to the sim.

Kind regards!
lomar
 
Posts: 219
Joined: Mon Jun 30, 2014 1:38 am
Location: Rio de Janeiro, Brazil
Callsign: lomar
Version: latest
OS: win 10

Re: osm2city worldbuild

Postby merspieler » Sun May 26, 2019 12:20 am

if there is currently a static (or shared) object, it will not place a building/road/etc there.

for adding new buildings: the tile would have to be regenerated which is not set up yet and not yet one of my concerns but i'm aware of this toppic.
I can think about it, when the build get's into terrasync which will not happen, until someone (not me) will fix the STG building list on windows.
In addition, the first goal was never to get it compatible with further scenery improvments but just test the osm2city software for problems... and to find them, i'd need more testers

if you want to know more about licensing... why don't you just ask on their mailing list ;-) i'd be interrested in more answers as well
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby merspieler » Sun Jul 14, 2019 2:14 am

Great news... I've finally got my server ready to run with 100MBit/s so you can now download the latest files from here.
New files will appear as soon as they have been fully generated.

NOTE: Due to my ISP only providing me with a public IPv6 address, you'll need IPv6 too, to access the files. If you've got only IPv4, you can either download the files from paju1986's mirror which is updated once a week or you try a tunneling service like the one of netassist.
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby sidi762 » Fri Jul 19, 2019 2:29 am

Image

Thanks for your work!

I've just tried it out and find it very impressing.
sidi762
 
Posts: 141
Joined: Sat Jun 18, 2016 8:15 am
Location: Beijing, China
Callsign: DAG0762
Version: 2018.3.2
OS: MacOS Mojave

Re: osm2city worldbuild

Postby merspieler » Fri Jul 19, 2019 3:12 am

Thank you, you're welcome...
Nice screenhow by the way.
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby miguel » Wed Jul 24, 2019 4:00 pm

World Entire World next In progress merspieler NOTE: Requires a next/nightly build on Linux. Work in Progress! More information in the forum.

send progress to this place
Thank you
miguel
 
Posts: 63
Joined: Wed Aug 19, 2015 4:05 pm

Re: osm2city worldbuild

Postby merspieler » Wed Jul 24, 2019 8:54 pm

An update, just for you ;-)

It hit the european area which is packed most densly with osm data. Expected build time per 10 by 10 degrees area is about a week.

I'll be soon migrating the build to a different machine with more RAM and CPU power which will increase build speed.

About the requirements. Accoring to the mailing list, the next release will have support for the BUILDING_LIST on all platforms. I assume (can't test tho) that current nightlys should work already.
Love at first flight A<380
Checkout Autopush. An improvment to the pushback to make your life easier.
Attempting an osm2city worldbuild... Testers needed!
merspieler
 
Posts: 331
Joined: Thu Oct 26, 2017 10:43 am
Location: Wish to be in YBCS
Callsign: JST935. ORI1711
IRC name: merspieler
Version: next
OS: Debian Bullseye

Re: osm2city worldbuild

Postby miguel » Thu Jul 25, 2019 4:16 pm

Not for my.
I am tested .progress 176/578.
There's more.?
Thank you.
If you've bothered, forgiveness
miguel
 
Posts: 63
Joined: Wed Aug 19, 2015 4:05 pm

PreviousNext

Return to Scenery

Who is online

Users browsing this forum: AhrefsBot [Bot], Google [Bot] and 2 guests