Selfhosted

60664 readers

1070 users here now

A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.

Rules:

Detailed Rules Post

Be civil.
No spam.
Posts are to be related to self-hosting.
Don't duplicate the full text of your blog or readme if you're providing a link.
Submission headline should match the article title.
No trolling.
Promotion posts require active participation, with an account that is at least 30 days old. F/LOSS without a paywall has exceptions, with requirements. See the rules link for details. Tags [CBH] or [AIP] are required, see the links in Rule 8 for details.
AI-related discussions and AI-involved promotional posts have additional requirements for tagging, as noted in Rule 7 and the AI & Promotional Post Expanded Rules post, and find example disclosures here.

Resources:

selfh.st Newsletter and index of selfhosted software and apps
awesome-selfhosted software
awesome-sysadmin resources
Self-Hosted Podcast from Jupiter Broadcasting

Any issues on the community? Report it using the report flag.

Questions? DM the mods!

founded 3 years ago

MODERATORS

curbstickle@anarchist.nexus

curbstickle_lw@lemmy.world

Immich android re-uploads files after docker restart (feddit.uk)

submitted 2 years ago by anytimesoon@feddit.uk to c/selfhosted@lemmy.world

18 comments fedilink hide all child comments

Hello,

I've noticed that when I restart my docker compose stack, the app seems to think that the server doesn't have copies of the latest files and re-uploads them.

The files can be seen in the filesystem of the host, but not through the web interface until they have been re-uploaded. The app uploads duplicates of all the files, at which point the web can see them again, and the fs has duplicates of everything.

This happens when I restart the stack, no upgrades to the system, just docker compose down and docker compose up -d

My set up is using an unmodified compose file from the docs. Any ideas what I could be doing wrong?

you are viewing a single comment's thread
view the rest of the comments

[–] Lem453@lemmy.ca 3 points 2 years ago* (last edited 2 years ago) (1 children)

There is an issue with your database persistence. The file is being uploaded but it's not being recorded in your database for some reason.

Describe in detail what your hardware and software setup is, particularly the storage and OS.

You can probably check this by trying to upload something and then checking the database files to see the last modified date.

[–] anytimesoon@feddit.uk 1 points 2 years ago (1 children)

I haven't had time to look into this, but I think this might be the right track. Is it possible for docker to get volumes mixed up? Like, could there be a duplicate dB volume and when the stack gets restarted, docker picks one or the other?

To answer your question, I'm running docker 26.1.1 on Ubuntu server 22.04.4 LTS

The system is on an ssd and the storage is a three disk raid5

[–] MangoPenguin@lemmy.blahaj.zone 1 points 2 years ago* (last edited 2 years ago) (1 children)

Like, could there be a duplicate dB volume and when the stack gets restarted, docker picks one or the other?

I'm not sure that is possible. Once a service has a volume defined it'll use that unless you manually change it.

But if you don't have a volume defined, data won't persist when the service is updated.

If you're just using the compose stack given by Immich, then everything should be set up properly though.

[–] anytimesoon@feddit.uk 1 points 2 years ago (1 children)

The volume is defined like this at the end of the compose file

database:
    container_name: immich_postgres
    image: registry.hub.docker.com/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
    volumes:
      - pgdata:/var/lib/postgresql/data
    restart: always

volumes:
  pgdata:
  model-cache:

[–] MangoPenguin@lemmy.blahaj.zone 1 points 2 years ago (2 children)

Yeah that looks fine, odd.

I assume this is a pretty normal install of Ubuntu, and /var/lib/docker hasn't been messed with at all?

[–] anytimesoon@feddit.uk 1 points 2 years ago* (last edited 2 years ago)

That's correct. Ubuntu is basically just a platform to run docker, haven't really touched it. Docker is the same. Just using it to run my containers. Haven't ventured at all into /var/lib/docker

The weird thing is that it's intermittent. It's only happened twice since I started using immich. I've been restarting the containers repeatedly for a few days now and it hasnt happened again.

[–] anytimesoon@feddit.uk 1 points 2 years ago* (last edited 2 years ago)

It's really weird. I think there are somehow two database volumes on my system.

The reason I think this is because:

I am the only user
there is only one user in the user table
there are two folders in the upload folders. Both have a uuid as their name and one of the uuids matches with the user id in the database
the user_token table has tokens no tokens from before this happened to me a couple days ago

So, where did this other user come from? Why have none of my log ins been tracked in the database before the incident?