Admintagebuch - Dokumentation der Admintätigkeiten

descilla · 19. April 2017 um 08:58

Multi-Tunneldigger nun auch auf parad0x und des1 aktiviert.

descilla · 19. April 2017 um 20:27

@tsued schreibenden Zugriff auf ansible-ffms und Ansible-Freifunk-Gateway gegeben.

tsued · 19. April 2017 um 21:29

template für die “nodesmappage” und die firmwareseite nach github gepusht und ausgerollt: Karte und Firmware

MPW · 19. April 2017 um 21:45

@Fungur und ich haben heute die neuen Ansible-Rollen für’s DNS fertiggestellt, in den Master überführt und ausgerollt.

freifunk-muensterland.net ist somit jetzt live!

MPW · 23. April 2017 um 08:19

Kea ist auf Remü-09 abgeschmiert. Hab den Dienst neu gestartet:

root@remue-09 ~ # systemctl status kea-dhcp4.service
● kea-dhcp4.service - Kea DHCPv4 Server
   Loaded: loaded (/lib/systemd/system/kea-dhcp4.service; enabled)
   Active: failed (Result: exit-code) since Sun 2017-04-23 03:42:09 CEST; 6h ago
     Docs: man:kea-dhcp4(8)
  Process: 6730 ExecStart=/usr/local/sbin/kea-dhcp4 -c /etc/kea/kea.conf (code=exited, status=1/FAILURE)
 Main PID: 6730 (code=exited, status=1/FAILURE)

Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.786 INFO  [kea-dhcp4.commands/673...ock
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.787 INFO  [kea-dhcp4.dhcp4/6730] ...led
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.787 INFO  [kea-dhcp4.dhcpsrv/6730...kea
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.870 ERROR [kea-dhcp4.dhcp4/6730] ... up
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: FATAL:  the database system is starting up
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.870 ERROR [kea-dhcp4.dhcp4/6730] ... up
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: FATAL:  the database system is starting up
Apr 23 03:42:09 remue-09 kea-dhcp4[6730]: 2017-04-23 03:42:09.871 INFO  [kea-dhcp4.commands/673...ock
Apr 23 03:42:09 remue-09 systemd[1]: kea-dhcp4.service: main process exited, code=exited, stat...LURE
Apr 23 03:42:09 remue-09 systemd[1]: Unit kea-dhcp4.service entered failed state.
Hint: Some lines were ellipsized, use -l to show in full.
root@remue-09 ~ # systemctl restart kea-dhcp4.service
root@remue-09 ~ # systemctl status kea-dhcp4.service
● kea-dhcp4.service - Kea DHCPv4 Server
   Loaded: loaded (/lib/systemd/system/kea-dhcp4.service; enabled)
   Active: active (running) since Sun 2017-04-23 10:17:52 CEST; 1s ago
     Docs: man:kea-dhcp4(8)
 Main PID: 27601 (kea-dhcp4)
   CGroup: /system.slice/kea-dhcp4.service
           └─27601 /usr/local/sbin/kea-dhcp4 -c /etc/kea/kea.conf

Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.028 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.028 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.028 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.028 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.029 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.029 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.029 INFO  [kea-dhcp4.dhcp4/27601...800
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.030 INFO  [kea-dhcp4.commands/27...ock
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.030 INFO  [kea-dhcp4.dhcp4/27601...led
Apr 23 10:17:53 remue-09 kea-dhcp4[27601]: 2017-04-23 10:17:53.030 INFO  [kea-dhcp4.dhcpsrv/276...kea
Hint: Some lines were ellipsized, use -l to show in full.

descilla · 24. April 2017 um 13:44

bind9 hat sich auf des1 auf die nase gelegt, schnell mal neu gestartet:

root@des1 ~ # systemctl status bind9.service 
● bind9.service - BIND Domain Name Server
   Loaded: loaded (/lib/systemd/system/bind9.service; enabled)
  Drop-In: /run/systemd/generator/bind9.service.d
           └─50-insserv.conf-$named.conf
   Active: failed (Result: exit-code) since Mon 2017-04-24 15:36:10 CEST; 5min ago
     Docs: man:named(8)
  Process: 24487 ExecStop=/usr/sbin/rndc stop (code=exited, status=1/FAILURE)
  Process: 8539 ExecStart=/usr/sbin/named -f -u bind (code=killed, signal=ABRT)
 Main PID: 8539 (code=killed, signal=ABRT)

Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 102.100.IN-ADDR.ARPA
Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 103.100.IN-ADDR.ARPA
Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 104.100.IN-ADDR.ARPA
Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 105.100.IN-ADDR.ARPA
Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 106.100.IN-ADDR.ARPA
Apr 24 03:42:13 des1 named[8539]: automatic empty zone: view external: 107.100.IN-ADDR.ARPA
Apr 24 15:36:10 des1 systemd[1]: bind9.service: main process exited, code=killed, status=6/ABRT
Apr 24 15:36:10 des1 rndc[24487]: rndc: connect failed: 127.0.0.1#953: connection refused
Apr 24 15:36:10 des1 systemd[1]: bind9.service: control process exited, code=exited status=1
Apr 24 15:36:10 des1 systemd[1]: Unit bind9.service entered failed state.
root@des1 ~ # systemctl start bind9.service 
root@des1 ~ # systemctl status bind9.service
● bind9.service - BIND Domain Name Server
   Loaded: loaded (/lib/systemd/system/bind9.service; enabled)
  Drop-In: /run/systemd/generator/bind9.service.d
           └─50-insserv.conf-$named.conf
   Active: active (running) since Mon 2017-04-24 15:42:13 CEST; 4s ago
     Docs: man:named(8)
  Process: 24487 ExecStop=/usr/sbin/rndc stop (code=exited, status=1/FAILURE)
 Main PID: 25600 (named)
   CGroup: /system.slice/bind9.service
           └─25600 /usr/sbin/named -f -u bind

Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 85.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 86.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 87.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 88.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 89.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 90.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: automatic empty zone: view domaene-29: 91.100.IN-ADDR.ARPA
Apr 24 15:42:13 des1 named[25600]: using built-in root key for view domaene-30
Apr 24 15:42:13 des1 named[25600]: using built-in root key for view domaene-31
Apr 24 15:42:13 des1 named[25600]: using built-in root key for view external

kgbvax · 24. April 2017 um 18:34

Warum hat systemd den nicht neu gestartet?

MPW · 24. April 2017 um 19:00

Sehr gute Frage. Tut es das auch nach Neustarts? Kann man das konfigurieren?

descilla · 24. April 2017 um 20:16

Jap, bei tunneldigger ist das z. B. im service file konfiguriert:

github.com

FreiFunkMuenster/Ansible-Freifunk-Gateway/blob/master/gateways_l2tp/files/tunneldigger@.service#L9


      
          [Unit]
          Description=tunneldigger tunnelling network daemon using l2tpv3 for domain %i
          After=network.target auditd.service
          
          [Service]
          Type=simple
          ExecStart=/srv/tunneldigger/bin/python /srv/tunneldigger/broker/l2tp_broker.py /srv/tunneldigger/broker/l2tp_broker_domain%i.cfg
          KillMode=process
          Restart=on-failure
          
          [Install]
          WantedBy=multi-user.target

Ob man das auch global konfigurieren kann, weiß ich nicht, aber das will man auch nicht.

MPW · 24. April 2017 um 20:24

Aber für Bind und Kea wäre das ganz cool. Ich wäre dafür, das ins
Ansible aufzunehmen.

corny456 · 26. April 2017 um 06:34

ca 8.00 Uhr gestern Morgen ist Nightbounce ausgefallen und auch nicht mehr per SSH erreichbar. @kgbvax
Frage für heute Abend: Warum ist uns das nicht aufgefallen und was können wir tun damit es uns beim nächsten mal auffällt?

Heute morgen haben sich dann dazu noch Remue-09 und Des2 verabschiedet. Remue-09 konnte ich durch einen Reset wiederbeleben (Hing mal wieder an den Interfaces fest…) Des2 müsste sich @descilla mal ansehen und ggf. das Knöppchen drücken…

Sollten heute Abend mal analysieren was da Passiert ist…

descilla · 26. April 2017 um 09:14

3 Beiträge wurden in ein neues Thema verschoben: Alerting falls GW gar nicht mehr erreichbar

kgbvax · 26. April 2017 um 08:12

Nighbounce um ~9 Uhr rebooted. Dann Meldung das der ins Traffic Limit gelaufen ist.
Dieses aufgehoben gegen Aufpreis.

MPW · 26. April 2017 um 22:50

Skript gebaut, was Knoten-DNS vom Kartenserver zieht. Dieses wird vom Cron alle drei Minuten ausgeführt. Liegt im Ansible und ist ausgerollt.

Auf freifunk-muensterland.de include subdomains für force https entfernt.

corny456 · 27. April 2017 um 06:37

Parad0x hat den Auto Reboot zwar geschaft lief aber mit einer auf 20 Festgenagelten Load und nahm keine Verbindungen an. Reboot --> Tot. @Parad0x kannst du bei gelegenheit mal gucken was die Konsole sagt?

Ziemlich zeitgleich hat auch Des1 die Segel gestrichen. Von jetzt auf Gleich keinen Durchsatz mehr und Load wuchs bis zum Reset auf ca 110 an.

Apr 27 03:46:56 des1 bird6: ibgp_parad0x: Received: Administrative shutdown
Apr 27 03:46:56 des1 bird: ibgp_parad0x: Received: Administrative shutdown
Apr 27 03:48:05 des1 kernel: [153798.667507] BUG: scheduling while atomic: iptables/7556/0x00000100
Apr 27 03:48:05 des1 kernel: [153798.668069] Modules linked in: binfmt_misc ip_gre ip_tunnel gre ebtable_filter ebtables batman_adv bridge stp llc libcrc32c crc32c_generic kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel cirrus evdev ppdev ttm joydev drm_kms_helper acpi_cpufreq pcspkr serio_raw drm tpm_tis tpm_tis_core parport_pc tpm virtio_balloon parport i2c_piix4 button ip6table_mangle ip6table_filter ip6_tables xt_TCPMSS xt_tcpmss xt_tcpudp xt_mark iptable_mangle xt_nat iptable_nat nf_nat_ipv4 nf_nat iptable_filter ip_tables x_tables l2tp_eth l2tp_netlink l2tp_core ip6_udp_tunnel udp_tunnel nf_conntrack_netlink nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache dm_mod hid_generic usbhid hid ata_generic virtio_net virtio_blk crc32c_intel ata_piix libata aesni_intel
Apr 27 03:48:05 des1 kernel: [153798.668094]  uhci_hcd ehci_pci scsi_mod aes_x86_64 glue_helper lrw gf128mul ehci_hcd ablk_helper cryptd usbcore usb_common psmouse virtio_pci virtio_ring floppy virtio
Apr 27 03:48:05 des1 kernel: [153798.668101] CPU: 3 PID: 7556 Comm: iptables Tainted: G        W       4.9.0-0.bpo.2-amd64 #1 Debian 4.9.13-1~bpo8+1
Apr 27 03:48:05 des1 kernel: [153798.668102] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
Apr 27 03:48:05 des1 kernel: [153798.668103]  0000000000000000 ffffffffbc329cd5 ffff9069ffd98700 ffff9069ffd83d30
Apr 27 03:48:05 des1 kernel: [153798.668105]  ffffffffbc09e263 ffffffffbc5f68d7 ffff9069ffd83d40 ffff90696ea00800
Apr 27 03:48:05 des1 kernel: [153798.668106]  000000007683027d ffffffffbcce1f40 ffff9068f60920c0 ffff9069ffd83e90
Apr 27 03:48:05 des1 kernel: [153798.668107] Call Trace:
Apr 27 03:48:05 des1 kernel: [153798.668108]  <IRQ>
Apr 27 03:48:05 des1 kernel: [153798.668113]  [<ffffffffbc329cd5>] ? dump_stack+0x5c/0x77
Apr 27 03:48:05 des1 kernel: [153798.668115]  [<ffffffffbc09e263>] ? __schedule_bug+0x53/0x70
Apr 27 03:48:05 des1 kernel: [153798.668117]  [<ffffffffbc5f68d7>] ? __schedule+0x487/0x6d0
Apr 27 03:48:05 des1 kernel: [153798.668118]  [<ffffffffbc5f6b52>] ? schedule+0x32/0x80
Apr 27 03:48:05 des1 kernel: [153798.668119]  [<ffffffffbc5fa089>] ? schedule_timeout+0x249/0x300
Apr 27 03:48:05 des1 kernel: [153798.668121]  [<ffffffffbc5a2fe0>] ? ip6_fragment+0x9e0/0x9e0
Apr 27 03:48:05 des1 kernel: [153798.668122]  [<ffffffffbc5f756a>] ? wait_for_completion+0xfa/0x130
Apr 27 03:48:05 des1 kernel: [153798.668123]  [<ffffffffbc0a2b30>] ? wake_up_q+0x60/0x60
Apr 27 03:48:05 des1 kernel: [153798.668126]  [<ffffffffbc0dca8d>] ? __wait_rcu_gp+0xbd/0xe0
Apr 27 03:48:05 des1 kernel: [153798.668127]  [<ffffffffbc0df3ee>] ? synchronize_sched+0x6e/0x80
Apr 27 03:48:05 des1 kernel: [153798.668128]  [<ffffffffbc0df920>] ? call_rcu_bh+0x20/0x20
Apr 27 03:48:05 des1 kernel: [153798.668130]  [<ffffffffbc0dc9c0>] ? trace_raw_output_rcu_utilization+0x60/0x60
Apr 27 03:48:05 des1 kernel: [153798.668132]  [<ffffffffc02a8e18>] ? l2tp_tunnel_closeall+0x98/0x140 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.668133]  [<ffffffffc02a9c02>] ? l2tp_tunnel_destruct+0xc2/0x180 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.668135]  [<ffffffffbc4dc0b1>] ? __sk_destruct+0x21/0x140
Apr 27 03:48:05 des1 kernel: [153798.668136]  [<ffffffffbc0dfb43>] ? rcu_process_callbacks+0x203/0x5c0
Apr 27 03:48:05 des1 kernel: [153798.668138]  [<ffffffffbc5fdf26>] ? __do_softirq+0x106/0x292
Apr 27 03:48:05 des1 kernel: [153798.668140]  [<ffffffffbc07db28>] ? irq_exit+0x98/0xa0
Apr 27 03:48:05 des1 kernel: [153798.668141]  [<ffffffffbc5fdd2e>] ? smp_apic_timer_interrupt+0x3e/0x50
Apr 27 03:48:05 des1 kernel: [153798.668142]  [<ffffffffbc5fd042>] ? apic_timer_interrupt+0x82/0x90
Apr 27 03:48:05 des1 kernel: [153798.668142]  <EOI>
Apr 27 03:48:05 des1 kernel: [153798.668143]  [<ffffffffbc5fafd1>] ? _raw_spin_unlock_irqrestore+0x11/0x20
Apr 27 03:48:05 des1 kernel: [153798.668145]  [<ffffffffbc1a5264>] ? pcpu_alloc+0x2c4/0x630
Apr 27 03:48:05 des1 kernel: [153798.668146]  [<ffffffffc02ce469>] ? translate_table+0x459/0x820 [ip_tables]
Apr 27 03:48:05 des1 kernel: [153798.668149]  [<ffffffffc02cfdf4>] ? do_ipt_set_ctl+0x114/0x1b9 [ip_tables]
Apr 27 03:48:05 des1 kernel: [153798.668150]  [<ffffffffbc530caf>] ? nf_setsockopt+0x3f/0x60
Apr 27 03:48:05 des1 kernel: [153798.668152]  [<ffffffffbc53f28f>] ? ip_setsockopt+0x6f/0x90
Apr 27 03:48:05 des1 kernel: [153798.668153]  [<ffffffffbc4d99bc>] ? SyS_setsockopt+0x7c/0xe0
Apr 27 03:48:05 des1 kernel: [153798.668154]  [<ffffffffbc5fb3fb>] ? system_call_fast_compare_end+0xc/0x9b
Apr 27 03:48:05 des1 kernel: [153798.683443] ------------[ cut here ]------------
Apr 27 03:48:05 des1 kernel: [153798.683448] WARNING: CPU: 3 PID: 0 at /home/zumbi/linux-4.9.13/kernel/rcu/tree.c:2819 rcu_process_callbacks+0x59b/0x5c0
Apr 27 03:48:05 des1 kernel: [153798.683448] Modules linked in: binfmt_misc ip_gre ip_tunnel gre ebtable_filter ebtables batman_adv bridge stp llc libcrc32c crc32c_generic kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel cirrus evdev ppdev ttm joydev drm_kms_helper acpi_cpufreq pcspkr serio_raw drm tpm_tis tpm_tis_core parport_pc tpm virtio_balloon parport i2c_piix4 button ip6table_mangle ip6table_filter ip6_tables xt_TCPMSS xt_tcpmss xt_tcpudp xt_mark iptable_mangle xt_nat iptable_nat nf_nat_ipv4 nf_nat iptable_filter ip_tables x_tables l2tp_eth l2tp_netlink l2tp_core ip6_udp_tunnel udp_tunnel nf_conntrack_netlink nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache dm_mod hid_generic usbhid hid ata_generic virtio_net virtio_blk crc32c_intel ata_piix libata aesni_intel
Apr 27 03:48:05 des1 kernel: [153798.683472]  uhci_hcd ehci_pci scsi_mod aes_x86_64 glue_helper lrw gf128mul ehci_hcd ablk_helper cryptd usbcore usb_common psmouse virtio_pci virtio_ring floppy virtio
Apr 27 03:48:05 des1 kernel: [153798.683478] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G        W       4.9.0-0.bpo.2-amd64 #1 Debian 4.9.13-1~bpo8+1
Apr 27 03:48:05 des1 kernel: [153798.683478] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
Apr 27 03:48:05 des1 kernel: [153798.683480]  0000000000000000 ffffffffbc329cd5 0000000000000000 0000000000000000
Apr 27 03:48:05 des1 kernel: [153798.683481]  ffffffffbc0778a4 ffffffffbcc4e280 ffff9069ffd994b8 0000000000000246
Apr 27 03:48:05 des1 kernel: [153798.683482]  0000000000000001 0000000000000000 ffff9069ffd99480 ffffffffbc0dfedb
Apr 27 03:48:05 des1 kernel: [153798.683484] Call Trace:
Apr 27 03:48:05 des1 kernel: [153798.683484] Call Trace:
Apr 27 03:48:05 des1 kernel: [153798.683487]  [<ffffffffbc329cd5>] ? dump_stack+0x5c/0x77
Apr 27 03:48:05 des1 kernel: [153798.683489]  [<ffffffffbc0778a4>] ? __warn+0xc4/0xe0
Apr 27 03:48:05 des1 kernel: [153798.683490]  [<ffffffffbc0dfedb>] ? rcu_process_callbacks+0x59b/0x5c0
Apr 27 03:48:05 des1 kernel: [153798.683492]  [<ffffffffbc5fdf26>] ? __do_softirq+0x106/0x292
Apr 27 03:48:05 des1 kernel: [153798.683494]  [<ffffffffbc07db28>] ? irq_exit+0x98/0xa0
Apr 27 03:48:05 des1 kernel: [153798.683495]  [<ffffffffbc5fdd2e>] ? smp_apic_timer_interrupt+0x3e/0x50
Apr 27 03:48:05 des1 kernel: [153798.683496]  [<ffffffffbc5fd042>] ? apic_timer_interrupt+0x82/0x90
Apr 27 03:48:05 des1 kernel: [153798.683498]  [<ffffffffbc5fa970>] ? __cpuidle_text_start+0x8/0x8
Apr 27 03:48:05 des1 kernel: [153798.683499]  [<ffffffffbc5fac62>] ? native_safe_halt+0x2/0x10
Apr 27 03:48:05 des1 kernel: [153798.683500]  [<ffffffffbc5fa988>] ? default_idle+0x18/0xd0
Apr 27 03:48:05 des1 kernel: [153798.683501]  [<ffffffffbc0bc040>] ? cpu_startup_entry+0x1f0/0x260
Apr 27 03:48:05 des1 kernel: [153798.683504]  [<ffffffffbc04846d>] ? start_secondary+0x14d/0x190
Apr 27 03:48:05 des1 kernel: [153798.683505] ---[ end trace 3cbbae5c7f1944d0 ]---
Apr 27 03:48:05 des1 kernel: [153798.707523] BUG: unable to handle kernel NULL pointer dereference at 0000000000000080
Apr 27 03:48:05 des1 kernel: [153798.708443] IP: [<ffffffffc02a8c8f>] l2tp_session_free+0x3f/0xc0 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.709199] PGD b94a7067
Apr 27 03:48:05 des1 kernel: [153798.709494] PUD b94a6067
Apr 27 03:48:05 des1 kernel: [153798.709815] PMD 0
Apr 27 03:48:05 des1 kernel: [153798.709888]
Apr 27 03:48:05 des1 kernel: [153798.710092] Oops: 0002 [#1] SMP
Apr 27 03:48:05 des1 kernel: [153798.710425] Modules linked in: binfmt_misc ip_gre ip_tunnel gre ebtable_filter ebtables batman_adv bridge stp llc libcrc32c crc32c_generic kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel cirrus evdev ppdev ttm joydev drm_kms_helper acpi_cpufreq pcspkr serio_raw drm tpm_tis tpm_tis_core parport_pc tpm virtio_balloon parport i2c_piix4 button ip6table_mangle ip6table_filter ip6_tables xt_TCPMSS xt_tcpmss xt_tcpudp xt_mark iptable_mangle xt_nat iptable_nat nf_nat_ipv4 nf_nat iptable_filter ip_tables x_tables l2tp_eth l2tp_netlink l2tp_core ip6_udp_tunnel udp_tunnel nf_conntrack_netlink nfnetlink nf_conntrack_ipv4 nf_defrag_ipv4 nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache dm_mod hid_generic usbhid hid ata_generic virtio_net virtio_blk crc32c_intel ata_piix libata aesni_intel
Apr 27 03:48:05 des1 kernel: [153798.718771]  uhci_hcd ehci_pci scsi_mod aes_x86_64 glue_helper lrw gf128mul ehci_hcd ablk_helper cryptd usbcore usb_common psmouse virtio_pci virtio_ring floppy virtio
Apr 27 03:48:05 des1 kernel: [153798.720291] CPU: 3 PID: 7556 Comm: iptables Tainted: G        W       4.9.0-0.bpo.2-amd64 #1 Debian 4.9.13-1~bpo8+1
Apr 27 03:48:05 des1 kernel: [153798.721257] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
Apr 27 03:48:05 des1 kernel: [153798.722092] task: ffff9068f60920c0 task.stack: ffffa00a02c18000
Apr 27 03:48:05 des1 kernel: [153798.722685] RIP: 0010:[<ffffffffc02a8c8f>]  [<ffffffffc02a8c8f>] l2tp_session_free+0x3f/0xc0 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.723601] RSP: 0018:ffff9069ffd83ea8  EFLAGS: 00010202
Apr 27 03:48:05 des1 kernel: [153798.724087] RAX: 0000000000000001 RBX: ffff90694bc12800 RCX: 00000000000001e4
Apr 27 03:48:05 des1 kernel: [153798.724858] RDX: 00000000000001e5 RSI: ffff90694d63a360 RDI: 0000000000000000
Apr 27 03:48:05 des1 kernel: [153798.725558] RBP: ffff90696b76f600 R08: 0000000000000000 R09: 0000000000000000
Apr 27 03:48:05 des1 kernel: [153798.726243] R10: 0000000000001ec0 R11: 000000000001fe69 R12: ffff90696b76f618
Apr 27 03:48:05 des1 kernel: [153798.726907] R13: ffff90696b76f650 R14: ffff90696b76f6a0 R15: ffff9069ffd99480
Apr 27 03:48:05 des1 kernel: [153798.727564] FS:  00007fe4c1337700(0000) GS:ffff9069ffd80000(0000) knlGS:0000000000000000
Apr 27 03:48:05 des1 kernel: [153798.728308] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 27 03:48:05 des1 kernel: [153798.728828] CR2: 0000000000000080 CR3: 000000008bf44000 CR4: 00000000001406e0
Apr 27 03:48:05 des1 kernel: [153798.729478] Stack:
Apr 27 03:48:05 des1 kernel: [153798.729750]  ffff90694bc12870 ffff90694bc12800 ffffffffc02a8e7e ffff90696b76f600
Apr 27 03:48:05 des1 kernel: [153798.730493]  ffff9069f8678400 ffff9069f5d0e010 0000000000000004 ffff906962cc4f00
Apr 27 03:48:05 des1 kernel: [153798.731198]  ffffffffc02a9c02 ffff9069f86786a8 ffff9069f8678400 000000000000000a
Apr 27 03:48:05 des1 kernel: [153798.731914] Call Trace:
Apr 27 03:48:05 des1 kernel: [153798.732148]  <IRQ>
Apr 27 03:48:05 des1 kernel: [153798.732337]  [<ffffffffc02a8e7e>] ? l2tp_tunnel_closeall+0xfe/0x140 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.732992]  [<ffffffffc02a9c02>] ? l2tp_tunnel_destruct+0xc2/0x180 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.733647]  [<ffffffffbc4dc0b1>] ? __sk_destruct+0x21/0x140
Apr 27 03:48:05 des1 kernel: [153798.734162]  [<ffffffffbc0dfb43>] ? rcu_process_callbacks+0x203/0x5c0
Apr 27 03:48:05 des1 kernel: [153798.734721]  [<ffffffffbc5fdf26>] ? __do_softirq+0x106/0x292
Apr 27 03:48:05 des1 kernel: [153798.735214]  [<ffffffffbc07db28>] ? irq_exit+0x98/0xa0
Apr 27 03:48:05 des1 kernel: [153798.735661]  [<ffffffffbc5fdd2e>] ? smp_apic_timer_interrupt+0x3e/0x50
Apr 27 03:48:05 des1 kernel: [153798.736223]  [<ffffffffbc5fd042>] ? apic_timer_interrupt+0x82/0x90
Apr 27 03:48:05 des1 kernel: [153798.736759]  <EOI>
Apr 27 03:48:05 des1 kernel: [153798.736942]  [<ffffffffbc5fafd1>] ? _raw_spin_unlock_irqrestore+0x11/0x20
Apr 27 03:48:05 des1 kernel: [153798.737579]  [<ffffffffbc1a5264>] ? pcpu_alloc+0x2c4/0x630
Apr 27 03:48:05 des1 kernel: [153798.738087]  [<ffffffffc02ce469>] ? translate_table+0x459/0x820 [ip_tables]
Apr 27 03:48:05 des1 kernel: [153798.738698]  [<ffffffffc02cfdf4>] ? do_ipt_set_ctl+0x114/0x1b9 [ip_tables]
Apr 27 03:48:05 des1 kernel: [153798.739330]  [<ffffffffbc530caf>] ? nf_setsockopt+0x3f/0x60
Apr 27 03:48:05 des1 kernel: [153798.739823]  [<ffffffffbc53f28f>] ? ip_setsockopt+0x6f/0x90
Apr 27 03:48:05 des1 kernel: [153798.740309]  [<ffffffffbc4d99bc>] ? SyS_setsockopt+0x7c/0xe0
Apr 27 03:48:05 des1 kernel: [153798.740802]  [<ffffffffbc5fb3fb>] ? system_call_fast_compare_end+0xc/0x9b
Apr 27 03:48:05 des1 kernel: [153798.741401] Code: 85 86 00 00 00 48 85 ed 48 89 fb 74 38 81 7d 00 da 4d 11 42 75 77 8b 47 10 85 c0 74 07 f0 ff 0d 08 4e 00 00 48 8b bd 48 01 00 00 <f0> ff 8f 80 00 00 00 74 1b 48 c7 43 08 00 00 00 00 f0 ff 8d 28
Apr 27 03:48:05 des1 kernel: [153798.743888] RIP  [<ffffffffc02a8c8f>] l2tp_session_free+0x3f/0xc0 [l2tp_core]
Apr 27 03:48:05 des1 kernel: [153798.744557]  RSP <ffff9069ffd83ea8>
Apr 27 03:48:05 des1 kernel: [153798.744865] CR2: 0000000000000080
Apr 27 03:48:05 des1 kernel: [153798.747023] ---[ end trace 3cbbae5c7f1944d1 ]---

MPW · 27. April 2017 um 08:36

Ich glaub, wir sollten die automatischen Neustarts wieder deaktivieren…

MPW · 30. April 2017 um 23:38

Des1 neu gestartet, ist abgestürzt.

void · 1. Mai 2017 um 18:46

Service VM und Webserver waren heute seit ca. 16:00 offline, da das Hostsystem auf dem die VMs liegen aus war.
Alle Dienste sind jetzt wieder online.

corny456 · 1. Mai 2017 um 18:48

Gegen 15:30 Des1 neu gestartet. War nicht mehr erreichbar.

corny456 · 1. Mai 2017 um 19:20

Graphite auf der Service VM neu gestartet.

● carbon-cache.service - Graphite Carbon Cache
   Loaded: loaded (/lib/systemd/system/carbon-cache.service; enabled)
   Active: failed (Result: signal) since Mo 2017-05-01 21:07:45 CEST; 9min ago
  Process: 13981 ExecStart=/var/lib/graphite/bin/carbon-cache.py --config=/var/lib/graphite/conf/carbon.conf --pidfile=/var/run/carbon-cache/carbon-cache.pid --logdir=/var/log/carbon/ start (code=exited, status=0/SUCCESS)
 Main PID: 14601 (code=killed, signal=KILL)

Mai 01 20:29:09 services systemd[1]: Starting Graphite Carbon Cache...
Mai 01 20:29:44 services carbon-cache.py[13981]: /usr/local/lib/python2.7/dist-packages/cffi/model.py:526: UserWarning: 'point_conversion_form_t' has no values explicitly d..., int/long)
Mai 01 20:29:44 services carbon-cache.py[13981]: % self._get_c_name())
Mai 01 20:29:50 services systemd[1]: Started Graphite Carbon Cache.
Mai 01 21:07:45 services systemd[1]: carbon-cache.service: main process exited, code=killed, status=9/KILL
Mai 01 21:07:45 services systemd[1]: Unit carbon-cache.service entered failed state.