Failed to open and read

[Aleuznelav2]

[tile]failed to open /mnt/d/users/samv2/downloads/geocraft-master/var/tiles/18_79307_96947.png: No such file or directory

Failed to read http://b.tile.openstreetmap.org/18/79307/96947.png (attempt 6). Waiting 128 seconds

It was running smoothly and then all of a sudden I'm getting this error and it gets stuck. I've retried the generation multiple times and it always gets stuck at some point.

[cherbert]

This issue is seriously annoying now. Geocraft is pretty unusable now. Constant Failed to read... waiting... errors and it never recovers. Is it openstreetmap throttling the downloads?

[cgutteridge]

I'm wondering if it's open streetmap detecting bots? Maybe try a lower setting for --mapzoom? It defaults to 18 but I suspect 16 or 17 might be an option

[Pieberius]

Do a little bit of research into the tiles you need first, and do a -wget command for the range of tiles you need. These can then be pasted into the var/tiles file or alteranatly you can mount the -wget command directly into the var/tile file and create the files directly in the right folder, running the geocraft sctipt should then detect a tile already pre existing and work without fault

for x {130000..130010}; do for y {87000..87010}; do -wget -O '18_'$x'_'$y'.png' https://a.tile.openstreetmap.org/18/$x/$y.png; done; done

this should get you 100 png files, just be sure to enter the range of tiles you are looking for in the top section in replacement for 130000/10 and 87000/10

[YesItsBenji]

relating to this issue, is there a config or a line of code somewhere we can change to make it not double the wait time when this happens, that is kinda annoying too.

[cherbert]

I'm wondering if it's open streetmap detecting bots? Maybe try a lower setting for --mapzoom? It defaults to 18 but I suspect 16 or 17 might be an option

I really don't think so. As doing a wget in the background works straight away. I have modified your code to use WGET instead of PNGLite. I don't know what PNGLite was doing in terms of simply downloading the initial png but it seems a bit overly complicated when a simple system call to WGET would suffice. It still seems to be bugging out after a while and yet again a background wget to the same PNG works. There has to be a bug somewhere as it really doesn't seem to be open streetmaps blocking us.

[cherbert]

ok, a bit of an update. Your Geocraft script definately has an issue somewhere when it's trying to download the tiles. I wrote my own script using Python which downloaded the entirety of London from openstreetmaps at zoom level 18 without a single issue. Geocraft can barely make it to complete 20 areas without a PNG read error. There is no throttling or banning going on.

Once I got around this issue and had pre-downloaded all the required tile png files I then hit a snag in terms of memory issues. Geocraft seems to eat up memory constantly while running to the point it will eventually crash completely. I don't know if this is a flaw in the Geocraft code or it's just a general flaw with using Perl which, from what I have read, isn't very good at giving back used memory to the OS.

Right now I'm looping the Geocraft script using a Linux shell script to keep re-launching Geocraft automatically when it crashes and using the --continue option to resume where it left off. Hopefully this will download the map I need and is due to finish in about a week or so. :-o

Wish me luck.