10.2 Release - no core dump found after crash
Scott Otis
scott.otis at tandemcal.com
Thu Feb 11 23:32:52 UTC 2016
Been trying to get a FreeBSD VM server running on Azure on a "Standard DS" size VM (so I have access to SSD storage for PostgreSQL). The "Standard DS" series of VMs also have faster/newer CPUs than the original "Standard A" series of VMs. I am using the image of FreeBSD from here: https://vmdepot.msopentech.com/Vhd/Show?vhdId=56718&version=61117 . After setting up the VM it started rebooting every hour or so. Initially I thought this was an Azure issue and Azure was forcibly rebooting the VM because it wasn't getting health reports back. But I don't' believe this is the case anymore and I think FreeBSD is crashing. (Note: I have setup a FreeBSD VM with a "Standard A" series VM and that seems to be running fine - though it looks like it might have crashed after about 38 hours which is much better than crashing after 1 hour).
Here is the "last" log from the last two days:
[--redacted--] pts/2 [--redacted--] Fri Feb 5 21:10 still logged in
[--redacted--] pts/1 [--redacted--] Fri Feb 5 21:10 still logged in
[--redacted--] pts/0 [--redacted--] Fri Feb 5 20:58 - 21:10 (00:12)
boot time Fri Feb 5 20:53
[--redacted--] pts/1 [--redacted--] Fri Feb 5 04:59 - crash (15:54)
[--redacted--] pts/0 [--redacted--] Fri Feb 5 04:59 - 04:59 (00:00)
boot time Fri Feb 5 04:41
boot time Fri Feb 5 02:16
[--redacted--] pts/1 [--redacted--] Fri Feb 5 00:36 - crash (01:40)
[--redacted--] pts/0 [--redacted--] Fri Feb 5 00:36 - 00:36 (00:00)
boot time Fri Feb 5 00:29
shutdown time Thu Feb 4 09:33
boot time Thu Feb 4 08:47
[--redacted--] pts/0 [--redacted--] Thu Feb 4 07:25 - crash (01:21)
boot time Thu Feb 4 07:00
boot time Thu Feb 4 05:03
boot time Thu Feb 4 02:45
[--redacted--] pts/0 [--redacted--] Thu Feb 4 01:08 - crash (01:36)
boot time Thu Feb 4 00:58
There are boot times without previous shutdown times - and there is that "crash" text (which is why I'm thinking it is a crash).
I added this to /etc/rc.conf:
dumpdev="AUTO"
dumpdir="/var/crash"
Here is the info on the swapfile:
sudo swapinfo -h
Device 512-blocks Used Avail Capacity
/dev/gpt/swapfs 2097152 0B 1.0G 0%
Server has 3.5 GB of RAM.
Here is the boot log after a crash (says there are no core dumps found... any way to figure out why it is not dumping the core?):
-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/[H[J-\|/-\ [7;46H ``` `[8;46Hs` `.....---.......--.``` -/[9;46H+o .--` /y:` +.[10;46H yo`:. :o `+-[11;46H y/ -/` -o/[12;46H .- ::/sy+:.[13;46H / `-- /[14;46H`: :`[15;46H`: :`[16;46H / /[17;46H .- -.[18;46H -- -.[19;46H `:` `:`[20;46H .-- `--.[21;46H .---.....----.|/-\ [1;2H ______ ____ _____ _____ [2;2H| ____| | _ \ / ____| __ \ [3;2H| |___ _ __ ___ ___ | |_) | (___ | | | |[4;2H| ___| '__/ _ \/ _ \| _ < \___ \| | | |[5;2H| | | | | __/ __/| |_) |____) | |__| |[6;2H| | | | | | || | | |[7;2H|_| |_| \___|\___||____/|_____/|_____/ [10;2H|[11;2H|[12;2H|[13;2H|[14;2H|[15;2H|[16;2H|[17;2H|[18;2H|[19;2H|[20;2H|[21;2H|[10;44H|[11;44H|[12;44H|[13;44H|[14;44H|[15;44H|[16;44H|[17;44H|[18;44H|[19;44H|[20;44H|[21;44H|[9;3H=========================================[22;3H=========================================[9;2H+[22;2H+[9;44H+[22;44H+[25;0H|/-\|/-\|/-\|/[9;15HWelcome to FreeBSD[11;5H1 [11;6H.[11;8HBoot Multi User [Enter][12;5H2 [12;6H.[12;8HBoot [S]ingle User[13;5H3 [13;6H.[13;8H[Esc]ape to loader prompt[14;5H4 [14;6H.[14;8HReboot[16;5HOptions:[17;5H5 [17;6H.[17;8H[K]ernel: kernel (1 of 2)[18;5H6 [18;6H.[18;8HConfigure Boot [O]ptions...[25;0H[23;4HAutoboot in 9 seconds. [Space] to pause[25;0H[23;4HAutoboot in 8 seconds. [Space] to pause[25;0H[23;4HAutoboot in 7 seconds. [Space] to pause[25;0H[23;4HAutoboot in 6 seconds. [Space] to pause[25;0H[23;4HAutoboot in 5 seconds. [Space] to pause[25;0H[23;4HAutoboot in 4 seconds. [Space] to pause[25;0H[23;4HAutoboot in 3 seconds. [Space] to pause[25;0H[23;4HAutoboot in 2 seconds. [Space] to pause[25;0H[23;4HAutoboot in 1 seconds. [Space] to pause[25;0H[23;4H [25;0H-\|/-\|/-\|/-\|/-\|/-\|/-\|//boot/kernel/kernel text=0xfc8de8 -\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|/-\|data=0x1283b0+0x207880 /-\|/-\|/-syms=[0x8+0x145350\|/-\|/-\|+0x8+0x15fe20/-\|/-\|/-\]
Booting...
|/-\|/Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015
root at releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz (1109.29-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x206d7 Family=0x6 Model=0x2d Stepping=7
Features=0xf83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS>
Features2=0x9e982203<SSE3,PCLMULQDQ,SSSE3,CX16,SSE4.1,SSE4.2,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,HV>
AMD Features=0x20100800<SYSCALL,NX,LM>
AMD Features2=0x1<LAHF>
XSAVE Features=0x1<XSAVEOPT>
Hypervisor: Origin = "Microsoft Hv"
real memory = 3758096384 (3584 MB)
avail memory = 3515142144 (3352 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <VRTUAL MICROSFT>
random device not loaded; using insecure entropy
ioapic0: Changing APIC ID to 0
ioapic0 <Version 1.1> irqs 0-23 on motherboard
random: <Software, Yarrow> initialized
kbd1 at kbdmux0
vmbus0: <Vmbus Devices> on motherboard
acpi0: <VRTUAL MICROSFT> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0
ata0: <Hyper-V ATA storage disengage driver> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
pci0: <bridge> at device 7.3 (no driver attached)
vgapci0: <VGA-compatible display> mem 0xf8000000-0xfbffffff irq 11 at device 8.0 on pci0
vgapci0: Boot video device
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (115200,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcbfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
Timecounters tick every 1.000 msec
random: unblocking device.
Timecounter "TSC" frequency 1109287570 Hz quality 800
Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000
storvsc0 on vmbus0
storvsc1 on vmbus0
hyperv-utils0 on vmbus0
hyperv-utils0: Hyper-V Service attaching: Hyper-V Heartbeat Service
hyperv-utils1 on vmbus0
hyperv-utils1: Hyper-V Service attaching: Hyper-V KVP Service
da0 at blkvsc0 bus 0 scbus1 target 0 lun 0
hyperv-utils2 on vmbus0
hyperv-utils2: Hyper-V Service attaching: Hyper-V Shutdown Service
da0: <Msft Virtual Disk 1.0> Fixed Direct Access SPC-2 SCSI device
hyperv-utils3 on vmbus0
hyperv-utils3: Hyper-V Service attaching: Hyper-V Time Synch Service
da0: 300.000MB/s transfers
hn0: <Synthetic Network Interface> on vmbus0
da0: Command Queueing enabled
da0: 21505MB (44042240 512 byte sectors: 255H 63S/T 2741C)
da1 at blkvsc1 bus 0 scbus2 target 1 lun 0
da1: <Msft Virtual Disk 1.0> Fixed Direct Access SPC-2 SCSI device
da1: 300.000MB/s transfershn0: unknown status 1073872902 received
hn0: unknown status 1073872902 received
hn0: hv send offload request succeeded
da1: Command Queueing enabled
hn0: Using defaults for TSO: 65518/35/2048
hn0: Ethernet address: 00:0d:3a:31:0d:fc
storvsc2 on vmbus0
da1: 7168MB (14680064 512 byte sectors: 255H 63S/T 913C)
storvsc3 on vmbus0
Trying to mount root from ufs:/dev/gpt/rootfs [rw]...
WARNING: / was not properly dismounted
Setting hostuuid: 253d30c5-d221-8548-b887-f87baa231b2d.
Setting hostid: 0xd995724c.
Entropy harvesting: interrupts ethernet point_to_point swi.
Starting file system checks:
** SU+J Recovering /dev/gpt/rootfs
** Reading 33554432 byte journal from inode 8.
** Biilding recovery table.
** Resolving unreferenced inode list.
** Processing journal entries.
** 1 journal records in 512 bytes for 6.25% utilization
** Freed 1 inodes (0 dirs) 0 blocks, and 0 frags.
***** FILE SYSTEM MARKED CLEAN *****
Mounting local file systems:.
Writing entropy file:.
Setting hostname: [--redacted--]
hn0: link state changed to UP
Starting dhclient.
DHCPDISCOVER on hn0 to 255.255.255.255 port 67 interval 7
DHCPOFFER from 168.63.129.16
unknown dhcp option value 0xf5
DHCPREQUEST on hn0 to 255.255.255.255 port 67
DHCPACK from 168.63.129.16
unknown dhcp option value 0xf5
bound to 10.0.2.5 -- renewal in -1 seconds.
Starting Network: lo0 hn0.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
hn0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=31b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,TSO4,TSO6>
ether 00:0d:3a:31:0d:fc
inet 10.0.2.5 netmask 0xffffff00 broadcast 10.0.2.255
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting devd.
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib
32-bit compatibility ldconfig path: /usr/lib32
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
Clearing /tmp (X related).
Updating motd:.
Mounting late file systems:.
Performing sanity check on sshd configuration.
Any help would be appreciated!
Scott Otis
CTO & Co-Founder
Tandem
www.tandemcal.com<http://www.tandemcal.com/>
More information about the freebsd-stable
mailing list