Problem nach update heute nacht

grefabu 2020-09-02 07:02:54 UTC #1

Moin,

heute morgen gab es die Meldung 504.

ein Blick in die Docker logs:

[quote]
:9000", host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:27:16 [error] 21#21: *12330 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “GET /egroupware/api/anon_images.php?src=peiker+holding+logo.png&1510918003 HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: “glpi.peiker-holding.de”, referrer: "https://glpi.peiker-holding.de/egroupware/login.php?cd=5"
egroupware-nginx | 2020/09/02 06:29:49 [error] 21#21: *12335 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “OPTIONS /egroupware/webdav.php/home HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:31:47 [error] 21#21: *12337 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “OPTIONS /egroupware/webdav.php/home HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Abrechnung%20Leistung%20HGL/Abrechnung%20diverse HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Abrechnung%20Leistung%20HGL/Abrechnung%20diverse HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Dienstleistungsvertrag%20-%20Pferdemiete/2.1.%20Vertr%C3%A4ge%20Pferdemietvertrag HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Dienstleistungsvertrag%20-%20Pferdemiete/2.1.%20Vertr%C3%A4ge%20Pferdemietvertrag HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Vorlagen_Vertr%C3%A4ge_Preislisten_etc/1.1.%20Blanko%20Vorlagen%20Vertr%C3%A4ge%20etc HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Vorlagen_Vertr%C3%A4ge_Preislisten_etc/1.1.%20Blanko%20Vorlagen%20Vertr%C3%A4ge%20etc HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Einstellerunterlagen/1.1%20Einstellervertr%C3%A4ge_ab_03_2020 HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:40:05 [error] 21#21: *12339 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/home/HGL/Einstellerunterlagen/1.1%20Einstellervertr%C3%A4ge_ab_03_2020 HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:48:11 [error] 21#21: *12348 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “OPTIONS /egroupware/webdav.php HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:50:54 [error] 21#21: *12351 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “GET /egroupware/index.php?cd=yes HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:52:59 [error] 21#21: *12353 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:00 [error] 21#21: *12355 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/PU%20ADDRESSBUCH/addressbook/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:04 [error] 21#21: *12357 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “OPTIONS /egroupware/webdav.php/home HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12359 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/PU%20ADDRESSBUCH/addressbook/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12361 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12361 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12359 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/PU%20ADDRESSBUCH/addressbook/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12361 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:07 [error] 21#21: *12359 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/groupdav.php/PU%20ADDRESSBUCH/addressbook/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:12 [error] 21#21: *12367 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:14 [error] 21#21: *12367 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:53:18 [error] 21#21: *12367 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “PROPFIND /egroupware/webdav.php/ HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:54:34 [error] 21#21: *12371 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “GET /egroupware/index.php HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-nginx | 2020/09/02 06:54:54 [error] 21#21: *12374 connect() failed (111: Connection refused) while connecting to upstream, client: 172.20.0.1, server: _, request: “GET /egroupware/index.php HTTP/1.1”, upstream: “fastcgi://172.20.0.4:9000”, host: "glpi.peiker-holding.de"
egroupware-db exited with code 0[/quote]

Das Problem konnte ich mit einem:

root@glpi:/etc/egroupware-docker# docker-compose down
root@glpi:/etc/egroupware-docker# docker-compose up
Creating network “egroupware-docker_default” with the default driver
Creating egroupware-watchtower … done
Creating egroupware-db … done
Creating egroupware … done
Creating egroupware-push … done
Creating egroupware-nginx … done
Attaching to egroupware-watchtower, egroupware-db, egroupware, egroupware-push, egroupware-nginx
egroupware-watchtower | time=“2020-09-02T06:56:46Z” level=info msg="Starting Watchtower and scheduling first run: 2020-09-03 04:00:00 +0000 UTC"
egroupware-db exited with code 0
egroupware-push | INFO: Supervisord configuration files copied from folder ‘/etc/supervisor/service.d/’.
egroupware-push | 2020-09-02 06:56:48,202 INFO Included extra file “/etc/supervisor/conf.d/swoole.conf” during parsing
egroupware-push | 2020-09-02 06:56:48,204 INFO Set uid to user 0 succeeded
egroupware-push | 2020-09-02 06:56:48,217 INFO RPC interface ‘supervisor’ initialized
egroupware-push | 2020-09-02 06:56:48,219 CRIT Server ‘unix_http_server’ running without any HTTP authentication checking
egroupware-push | 2020-09-02 06:56:48,219 INFO supervisord started with pid 13
egroupware-nginx | /docker-entrypoint.sh: /docker-entrypoint.d/ is not empty, will attempt to perform configuration
egroupware-nginx | /docker-entrypoint.sh: Looking for shell scripts in /docker-entrypoint.d/
egroupware-nginx | /docker-entrypoint.sh: Launching /docker-entrypoint.d/10-listen-on-ipv6-by-default.sh
egroupware-nginx | 10-listen-on-ipv6-by-default.sh: error: can not modify /etc/nginx/conf.d/default.conf (read-only file system?)
egroupware-nginx | /docker-entrypoint.sh: Launching /docker-entrypoint.d/20-envsubst-on-templates.sh
egroupware-nginx | /docker-entrypoint.sh: Configuration complete; ready for start up
egroupware-push | 2020-09-02 06:56:49,221 INFO spawned: ‘swoole’ with pid 16
egroupware-push | 2020-09-02 06:56:50,223 INFO success: swoole entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
egroupware | Fix APC(u) configuration, set apc.shm_size=128M in /etc/php/7.3/cli/conf.d/20-apcu.ini
egroupware |
egroupware | EGroupware successful updated
egroupware | * Starting periodic command scheduler cron
egroupware | …done.
egroupware |
egroupware | EGroupware successful updated
egroupware |
egroupware | EGroupware successful updated
egroupware |
egroupware | EGroupware successful updated
egroupware | [02-Sep-2020 06:56:54] NOTICE: fpm is running, pid 1
egroupware | [02-Sep-2020 06:56:54] NOTICE: ready to handle connections
egroupware | [02-Sep-2020 06:56:54] NOTICE: systemd monitor interval set to 10000ms

Scheinbar erst mal in Ordnung bringen.

EGroupware nach Update auf die Version 20-1-20200901 nicht mehr erreichbar / Neustart des Docker-Daemons notwendig

grefabu 2020-10-06 08:31:19 UTC #2

Wie kann ich verhindern, das der Watchguard dienst Egroupware automatisch aktualisiert?

Beim letzten Maintenance Release hatte ich nähmlich auch einen Hänger.
Da ich zwei Wochen in den Urlaub gehe, würde ich den Automatismus gerne ausschalten,…

RalfBecker 2020-10-06 08:53:43 UTC #3

Das Problem ist mit dem Maintenance Update von heute Nacht behoben:

github.com

EGroupware/build.opensuse.org/blob/master/server:eGroupWare/egroupware-docker-20.1/egroupware-docker/egroupware-nginx.conf#L8


# stuff for http block
client_max_body_size 1g;
# fix error: upstream sent too big header while reading response header from upstream
fastcgi_buffers 16 16k;
fastcgi_buffer_size 32k;


server {
	# set Docker's resolver so Nginx can detect changed IP's of containers
	# https://github.com/containrrr/watchtower/issues/186
	resolver 127.0.0.11 valid=60s;
	# services need to be set as variables for Nginx to resolve them again
	set $push push;
	set $egroupware egroupware;


	access_log off;


	listen 80 default_server;

Die geänderte Nginx Konfig sorgt dafür, das Nginx die IP Adressen der Container periodisch neu abfrägt, damit das nicht mehr passieren kann.

Ansonsten kannst Du, wie hier schon ein paarmal beschrieben, in der docker-compose.override.yml den Watchtower z.B. eine Option mitgeben, dass er dir nur noch eine Mail sendet, wenn es ein neues Update gibt, es aber nicht mehr automatisch einspielt.

https://containrrr.dev/watchtower/arguments/#without_updating_containers

Ralf

StefanU 2020-10-06 09:05:56 UTC #4

Hi Gregor.

Die von @RalfBecker Ralf angesprochene Lösung ist die eleganteste. Da müssen wir mal noch dokumentieren…
Darüber darfst du natürlich die Update-Pakete nicht automatisch einspielen.

Ansonsten kannst du z.B. auch die Version festnageln:

Stefan