osm2city worldbuild

[merspieler]

This topic is intended to announce and organize efforts for the osm2city worldbuild.

I will update this post to stay up to date.

Current status: <--Manually updated
2019-05-08: After an interruption of about one week (db connection issue) the build is running again. Tasmania, Sourthern Island of New Zealand and southern tip of South America have been build so far.
2019-05-22: Over the last days I've got some delays due to repeated out of memory problems. Despite these problems we've got almost the entire southern hemisphere covered. Note that this doesn't mean, we're half way through the build, the nothern hemisphere has more land mass and much more osm data available.
2019-07-14: Currently the last corner of the US is building... this includes NYC and Boston. You can now find the up-to-date files on my site (IPv6 only).
2019-08-20: The build came to a halt cause of difficulties in the server, I've planed to migrate the build to. Since this server is supposed to host as well the done scenery, my mirror is currently down as well.
2019-08-29: I've decided to call the first run of the worldbuild a day. When all bugs I've found are fixed and the new shader based buildings are stable I'll begin from scratch.

I'm looking for testers... What do you need to be a tester?
System requirements:

• A download manager (To be able to continue interrupted downloads)
• About 40-50GB free disk space (for the biggest areas)
• To be able to run Nightly/Next build (cause of dependenc on some new feature)
• Gitlab account for issue tracking

What I expect from you:

• Visual check of scenery using the UFO
• Checking scenery with osm data
• Comparing skylines of major cities and complex intersections with real life pictures
• Report any problems
• Being reliable
• Enough time to review whole tiles (10 by 10 degree areas... that's HUGH!!! will take many hours)

If you're interrested in becoming a tester write me a pm here on the forum.

For any questions please reply in this thread.

You can download the scenery either from my site (IPv6 only) or you can download it from the mirror provided by paju1986 (Thank you for that).
NOTE: You will need a Next/Nightly Flightgear build.
If you find any problems please document them on gitlab

[Catalanoic]

I think i can do most of the things you described.

[legoboyvdlp]

Are you coordinating this with Torsten? I believe there were plans to do this for TerraSync in the future - so to avoid wasting effort might as well just make this be the definitive version and distribute it, then let it be updated automatically with the rest of world scenery

Certainly sounds ambitious, looking forward to seeing what you achieve.

[merspieler]

No, I'm not coordinating this with Torsten... I haven't even got a reply to my mail on the mailing list...
And please... don't confuse TerraSync with osm2city... i'm just building osm2city which has (almost) nothing to do with the new scenery worldbuild.

[legoboyvdlp]

Actually, sorry - what I meant was that since osm2city can be distributed via TerraSync you might as well try and get it in if possible to avoid other people having to run it with duplication of work?
And then the planned regular scenery updates could run osm2city and incrementally update tiles as needed?

[merspieler]

We'll see... primary goal is to debug and fix osm2city as best as possible... and ofc haveing a worldwide coverage. I didn't bother yet to get it into ts... will consider it, if I get stable results.

[V12]

Where will be generated OSM data stored ? This will be a lot of gigabytes for all world.

[Catalanoic]

torrent works as an option, at the devel list some people managed to share +6 GB torrent for FlightGear EarthView without third-party sites.

[merspieler]

For now... for testing, i'll host it from my server (1Mbit/s uplink)... hence the limitation for testers only.

I've brought up torrent in the past for terrasync too... i know that it works. I'll see... main focus is currently on creating it without any problems on osm2city.py side... I can think later about distribution... and if i wait long enough, i've got the 100Mbit/s FTTH uplink... (is a bit like the BER airport :-/ noone knows when it really comes).

and yes... it will be lots of GB... just as refference: the 10 by 10 degree tile e010n40 (which is the 3rd densest are of osm data) which i've build for testing puroses had a size of 42GB unziped. the zip file where 8.7GB large... while australia is ziped only 1.4GB... due to much less coverage. Currently i'm rerunning that tile to see if i can cut off a good bit of that using the BUILDING_LIST(uses "random" buildings at some points) once that build is done, i'll decide if i'll use that parameter and kick off the build

[xDraconian]

Hi @merspieler,

It is a very ambitious project, and I'm excited to learn that you are taking on this challenge. I look forward to tracking your progress.
Happy world building!

Scott

[merspieler]

Thanks scott... btw... how's the preparation for the terragear worldbuild going? (haven't read anything on the ml lately...)

[xDraconian]

My todo list is getting shorter. Still three bugs in Terragear I need to track down. I'm currently working on new line textures. Also have at least two new TerraGear tools to write (but these are for enhancements, so these may come later).

The Hawaiian Islands and Tennessee custom scenery projects have helped a lot in testing and identifying bugs. It also helped a bunch to refine my workflow.

So, I feel like we're getting close. Haven't gotten an update from Torsten, so not sure where he is with his workflow.

[paju1986]

I have my own home server with 100Mb/s uplink if you are interested i can host the files there as a mirror i have an entire spare drive with 750Gb storage available

[merspieler]

paju1986: That would be great. Thanks for the offer.

How would you prefer to get the files onto your server?

[paju1986]

torrent, git, svn or just plain http download are fine for me, anything i can just left downloading on my server