All configs gone after docker compose pull

[lkd70]

After running docker compose pull and starting up the container, all the prior configs are gone from db, including users. The database is seamingly wiped clean.

I have a backup of the previous state, so if you require any information from either the original or new state I can provide this.

Images:

REPOSITORY               TAG       IMAGE ID       CREATED        SIZE
zoeyvid/npmplus          latest    82e47e2b298e   12 days ago    246MB
crowdsecurity/crowdsec   latest    a11b3b2fee61   8 weeks ago    347MB
zoeyvid/npmplus          <none>    f06d6525d1a6   3 months ago   244MB
crowdsecurity/crowdsec   <none>    8b89fde39672   4 months ago   279MB
zoeyvid/npmplus          <none>    4ae49534842a   5 months ago   209MB

Log (seems related?):

npmplus   | [Global   ] › ℹ  info      Using Sqlite: /data/npmplus/database.sqlite
npmplus   | 2025/01/23 20:52:09 [error] 692#692: *1 connect() failed (111: Connection refused) while connecting to upstream, client: 10.0.0.201, server: _, request: "GET /api/users/me?expand=permissions HTTP/2.0", upstream: "http://127.0.0.1:48681/users/me?expand=permissions", host: "10.0.0.100:81", referrer: "https://10.0.0.100:81/"
npmplus   | [Migrate  ] › ℹ  info      Current database version: none
npmplus   | [Migrate  ] › ℹ  info      [change_incoming_port_to_string] Migrating Up...
npmplus   | [Migrate  ] › ℹ  info      [change_incoming_port_to_string] stream Table altered
npmplus   | [Migrate  ] › ℹ  info      [regenerate_default_host] Migrating Up...

docker-compose.yml:

root@NPM:~# cat docker-compose.yml
services:
  npmplus:
    container_name: npmplus
    image: zoeyvid/npmplus
    restart: always
    network_mode: host
    volumes:
      - "/root/data:/data"
      - "/root/letsencrypt:/etc/letsencrypt"
      - "/root/goaccess/goaccess.conf:/goaccess/goaccess.conf"
      #- "/var/www:/var/www" # optional, if you want to use it as webserver for html/php
    environment:
      - "TZ=Europe/London"
      - "GOA=true"
      - "NGINX_404_REDIRECT=true"
      - "LOGROTATE=true"
      - "LOGROTATIONS=7"
      - "GOA_PORT=92"
      - "GOA_LISTEN_LOCALHOST=true"
  crowdsec:
    container_name: crowdsec
    image: crowdsecurity/crowdsec
    restart: always
    network_mode: bridge
    ports:
      - "127.0.0.1:7422:7422"
      - "127.0.0.1:8383:8383"
    environment:
      - "TZ=Europe/London"
      - "COLLECTIONS=ZoeyVid/npmplus"
    volumes:
      - "/opt/crowdsec/conf:/etc/crowdsec"
      - "/opt/crowdsec/data:/var/lib/crowdsec/data"
      - "/opt/npm/nginx:/opt/npm/nginx:ro"
      - "/var/run/docker.sock:/var/run/docker.sock:ro"

[Zoey2936]

can you restore from the old backup, then redeploy and send me the full log please?

[Zoey2936]

it looks like it simply does not copy to files for no reason

[Zoey2936]

you can temporary move theese file which got removed to the cortrect place yourself, but I don't see why it should not move them

[Zoey2936]

do you maybe have a file localted and named like this /root/data/database.sqlite?

[Zoey2936]

yes found in logs:

npmplus   | renamed '/data/database.sqlite' -> '/data/npmplus/database.sqlite'
npmplus   | renamed '/data/keys.json' -> '/data/npmplus/keys.json'

theese file should not exist and copied before migration, this is why migration breaks, not sure why they exist

[lkd70]

I'm unsure either, I was already on NPMPlus so unless there's a migration required to a newer version of NPMPlus I know nothing about?

[Zoey2936]

if you delete theese two files (not thoose in the etc folder) then the migration should work, I have no idea why they exist, but they are breaking the migration, so if you remove them it should work

[lkd70]

Thank you, that's worked. I'm now on 2.12.2+eea4015 with all my data after deleting these files!
Appreciate the quick and in-depth assistance.

[Zoey2936]

Small other thing for your compose file:
"/root/letsencrypt:/etc/letsencrypt" can be removed
"/root/goaccess/goaccess.conf:/goaccess/goaccess.conf" does nothing by default
"/opt/npm/nginx:/opt/npm/nginx:ro" should be - "/root/data/nginx:/opt/npm/nginx:ro"
"127.0.0.1:8383:8383" did you made sure that crowdsec also listens on port 8383 inside the container?