Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7 #128

Open
pcace opened this issue Oct 9, 2024 · 5 comments
Open

open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7 #128

pcace opened this issue Oct 9, 2024 · 5 comments

Comments

@pcace
Copy link

pcace commented Oct 9, 2024 •
edited
Loading

Hi there, i am trying to get the api to run. i have these variables:

OVERPASS_META=yes
OVERPASS_MODE=init
OVERPASS_PLANET_URL=http://download.geofabrik.de/europe/germany-latest.osm.bz2
OVERPASS_DIFF_URL=http://download.openstreetmap.fr/replication/europe/germany/minute/
OVERPASS_RULES_LOAD=10

running the container results in this output:

2024-10-09T14:29:13.636953033Z 127.0.0.1 - - [09/Oct/2024:14:29:13 +0000] "GET /api/interpreter?data=[out:json];node(8951963);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:16.102558032Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:16.106452509Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:18.745591303Z 127.0.0.1 - - [09/Oct/2024:14:29:18 +0000] "GET /api/interpreter?data=[out:json];node(4672305);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:19.187224680Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:19.190564922Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:22.272327009Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:22.275038716Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:23.872252638Z 127.0.0.1 - - [09/Oct/2024:14:29:23 +0000] "GET /api/interpreter?data=[out:json];node(2776999);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:25.357138402Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:25.360897111Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:28.442788731Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:28.446887667Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:28.997656981Z 127.0.0.1 - - [09/Oct/2024:14:29:28 +0000] "GET /api/interpreter?data=[out:json];node(9516056);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:31.527795002Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:31.531359032Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:34.077307868Z 127.0.0.1 - - [09/Oct/2024:14:29:34 +0000] "GET /api/interpreter?data=[out:json];node(9722446);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:34.612661547Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:34.615430994Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:37.698880225Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:37.702605573Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:39.144882254Z 127.0.0.1 - - [09/Oct/2024:14:29:39 +0000] "GET /api/interpreter?data=[out:json];node(7325553);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:40.782719225Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:40.786851621Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:43.867553860Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:43.870391626Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:44.223971518Z 127.0.0.1 - - [09/Oct/2024:14:29:44 +0000] "GET /api/interpreter?data=[out:json];node(3939488);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:46.954178576Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:46.958584529Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:49.326078448Z 127.0.0.1 - - [09/Oct/2024:14:29:49 +0000] "GET /api/interpreter?data=[out:json];node(4775712);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:50.038335785Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:50.042264932Z It took 1 to run the loop. Desired load is: 10%. Sleeping: 9
2024-10-09T14:29:54.442149280Z 127.0.0.1 - - [09/Oct/2024:14:29:54 +0000] "GET /api/interpreter?data=[out:json];node(4924389);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:29:59.152285506Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:29:59.155667518Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:29:59.545315805Z 127.0.0.1 - - [09/Oct/2024:14:29:59 +0000] "GET /api/interpreter?data=[out:json];node(830640);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:30:02.239166904Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:30:02.242753044Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:30:04.604736471Z 127.0.0.1 - - [09/Oct/2024:14:30:04 +0000] "GET /api/interpreter?data=[out:json];node(7866842);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:30:05.326880762Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:30:05.331050567Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:30:08.412734108Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:30:08.416323538Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:30:09.696745534Z 127.0.0.1 - - [09/Oct/2024:14:30:09 +0000] "GET /api/interpreter?data=[out:json];node(9578284);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:30:11.498004250Z runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:30:11.501876967Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:30:13.488286607Z 2024-10-09 14:30:13 INFO: Using replication server at http://download.openstreetmap.fr/replication/europe/germany/minute/
2024-10-09T14:30:13.488306416Z 2024-10-09 14:30:13 DEBUG: Using given sequence ID 6296706
2024-10-09T14:30:13.488310916Z 2024-10-09 14:30:13 DEBUG: Starting download at ID 6296707 (max 100 MB)
2024-10-09T14:30:13.489208989Z 2024-10-09 14:30:13 DEBUG: Starting new HTTP connection (1): download.openstreetmap.fr:80
2024-10-09T14:30:13.528058904Z 2024-10-09 14:30:13 DEBUG: http://download.openstreetmap.fr:80 "GET /replication/europe/germany/minute//state.txt HTTP/11" 200 104
2024-10-09T14:30:13.550707545Z 2024-10-09 14:30:13 DEBUG: http://download.openstreetmap.fr:80 "GET /replication/europe/germany/minute//006/296/707.osc.gz HTTP/11" 200 13699
2024-10-09T14:30:13.553443002Z 2024-10-09 14:30:13 DEBUG: Downloaded change 6296707. (102345 kB available in download buffer)
2024-10-09T14:30:13.590914229Z /app/bin/update_from_dir --osc-dir=/db/diffs --version=2024-10-09T14:28:45Z --flush-size=16 --meta
2024-10-09T14:30:13.941086454Z Reading XML file ... finished reading nodes. Compute current ... ready. Flushing to database ....... done.
2024-10-09T14:30:14.249195580Z Reading XML file ... finished reading ways. Compute current ... ready. Flushing to database ....... done.
2024-10-09T14:30:14.593224827Z Reading XML file ... finished reading relations. runtime error: open64: 2 No such file or directory /db/db//osm3s_areas Unix_Socket::7
2024-10-09T14:30:14.596516689Z It took 0 to run the loop. Desired load is: 10%. Sleeping: 3
2024-10-09T14:30:14.755867608Z Flushing to database ....127.0.0.1 - - [09/Oct/2024:14:30:14 +0000] "GET /api/interpreter?data=[out:json];node(7167263);out; HTTP/1.1" 200 634 "-" "curl/7.88.1"
2024-10-09T14:30:14.889795140Z ... done.
2024-10-09T14:30:15.125821878Z Update complete.
2024-10-09T14:30:15.129869915Z There are still some updates remaining
2024-10-09T14:30:15.204274243Z 2024-10-09 14:30:15 INFO: Using replication server at http://download.openstreetmap.fr/replication/europe/germany/minute/
2024-10-09T14:30:15.204292693Z 2024-10-09 14:30:15 DEBUG: Using given sequence ID 6296707
2024-10-09T14:30:15.204296913Z 2024-10-09 14:30:15 DEBUG: Starting download at ID 6296708 (max 100 MB)
2024-10-09T14:30:15.205165625Z 2024-10-09 14:30:15 DEBUG: Starting new HTTP connection (1): download.openstreetmap.fr:80
2024-10-09T14:30:15.238148861Z 2024-10-09 14:30:15 DEBUG: http://download.openstreetmap.fr:80 "GET /replication/europe/germany/minute//state.txt HTTP/11" 200 104
2024-10-09T14:30:15.239562709Z 2024-10-09 14:30:15 ERROR: Error while downloading diffs.
2024-10-09T14:30:15.263663408Z Empty version, skipping file
2024-10-09T14:30:15.264297922Z <?xml version='1.0' encoding='UTF-8'?>
2024-10-09T14:30:15.264303622Z <osmChange version="0.6" generator="libosmium/2.20.0">
2024-10-09T14:30:15.264306302Z </osmChange>
2024-10-09T14:30:15.265191475Z Update finished with status code: 3

over and over again. Is there anything i can try to make it work? or is this somehow known?

from within the container i cannot run this:

app/bin/dispatcher --osm-base --db-dir=/db/db --meta
File_Error No such file or directory 2 /db/db//osm3s_osm_base Unix_Socket::4

thanks a lot!!
@BobLamarley
Copy link

BobLamarley commented Oct 25, 2024 •
edited
Loading

Hi,
I'm having the same, running this command:

docker run \
  -e OVERPASS_META=yes \
  -e OVERPASS_MODE=init \
  -e OVERPASS_PLANET_URL=http://download.geofabrik.de/europe/monaco-latest.osm.bz2 \
  -e OVERPASS_DIFF_URL=http://download.openstreetmap.fr/replication/europe/monaco/minute \
  -e OVERPASS_RULES_LOAD=10 \
  -v overpass-data:/db \
  -p 12345:80 \
  -i -t \
  --name overpass_monaco wiktorn/overpass-api
image

Did you find any solutions ?

@pcace
Copy link
Author

pcace commented Nov 11, 2024

Hi, I'm having the same, running this command:

docker run \
  -e OVERPASS_META=yes \
  -e OVERPASS_MODE=init \
  -e OVERPASS_PLANET_URL=http://download.geofabrik.de/europe/monaco-latest.osm.bz2 \
  -e OVERPASS_DIFF_URL=http://download.openstreetmap.fr/replication/europe/monaco/minute \
  -e OVERPASS_RULES_LOAD=10 \
  -v overpass-data:/db \
  -p 12345:80 \
  -i -t \
  --name overpass_monaco wiktorn/overpass-api
image Did you find any solutions ?

no sadly not.
any other idea what to do?

@wiktorn
Copy link
Owner

wiktorn commented Nov 11, 2024

What filesystem do you use for storing the database? Does it support unix sockets? I wonder if double forward slashes do not make a difference here.

@pcace
Copy link
Author

pcace commented Nov 11, 2024 •
edited
Loading

Hi, i am running it on Ubuntu 22.04, fs is ext4

 docker --version
Docker version 27.3.1, build ce12230
docker-compose --version
docker-compose version 1.29.2, build unknown

@wiktorn
Copy link
Owner

wiktorn commented Nov 11, 2024

Just for test, can you try running:

docker exec -it <your overpass container name> /bin/bash
apt update && apt install netcat-openbsd
nc -lU /db/socket-test

If netcat shows no errors, then indeed, your /db filesystem supports unix domain sockets and I can't understand why socket is missing, although all processes started correctly. If it fails, it means that whatever the filesystem is you mounted at /db, it's not supporting unix domain sockets and you need to fix this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@pcace @wiktorn @BobLamarley