Can't create/write to file '/tmp/ on CentOs

[gjessing]

Hello
I have a huge issue on this error on mysql.
Can't create/write to file '/tmp/#sql
the full error message is
Can't create/write to file '/tmp/#sql_4761_0.MYI' (Errcode: 30)

[Irithori]

What is the output of:

ls -lad /tmp
df -h

Also try if it is writeable:

touch /tmp/delete_me
ls -la /tmp/delete_me

[gjessing]

ls -lad /tmp gives drwxrwxrwt 6 root root 4096 Jul 1 11:27 /tmp
df -h

Filesystem Size Used Avail Use% Mounted on
/dev/sda2 220G 13G 196G 7% /
/dev/sda3 2.0G 36M 1.9G 2% /tmp
/dev/sda1 99M 23M 72M 24% /boot
tmpfs 1013M 0 1013M 0% /dev/shm

touch /tmp/delete_me gives
touch: cannot touch `/tmp/delete_me': Read-only file system


[root@hosted-by ~]# ls -la /tmp/delete_me
ls: /tmp/delete_me: No such file or directory

yestaday i did a install of 'rkhunter' - 'can that be the reason.?

[Irithori]

yestaday i did a install of 'rkhunter' - 'can that be the reason.?

No

touch /tmp/delete_me gives
touch: cannot touch `/tmp/delete_me': Read-only file system

This could point to a broken disk or a corrupt filesystem.

Are there errors about a broken sda in the raidcontroller (if available) view/log or via these commands?

mount |grep tmp
dmesg
tail -f /var/log/messages

If the disk is ok, you can try to fsck /dev/sda3.
To do this, you need to unmount /tmp and use the appropiate fsck for the filesystem used (ext3/ext4/xfs/etc).
If unmount fails, you could boot a livecd and execute fsck from there.

[gjessing]

Hi Irithori
iam so glad you is taking the time for me - trust me it means a lot to me -

i did the mout | grep tmp and here is the result

it is a bit long :O

root@hosted-by ~]# mount | grep tmp
/dev/sda3 on /tmp type ext3 (rw)
tmpfs on /dev/shm type tmpfs (rw)
[root@hosted-by ~]# dmesg
Linux version 2.6.18-238.12.1.el5 (mockbuild@builder10.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Tue May 31 13:23:01 EDT 2011
BIOS-provided physical RAM map:
BIOS-e820: 0000000000010000 - 000000000009cc00 (usable)
BIOS-e820: 000000000009cc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000cc000 - 00000000000d4000 (reserved)
BIOS-e820: 00000000000dc000 - 00000000000e0000 (reserved)
BIOS-e820: 00000000000e4000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 000000007fea0000 (usable)
BIOS-e820: 000000007fea0000 - 000000007feab000 (ACPI data)
BIOS-e820: 000000007feab000 - 000000007feac000 (ACPI NVS)
BIOS-e820: 000000007feac000 - 0000000080000000 (reserved)
BIOS-e820: 00000000f0000000 - 00000000f8000000 (reserved)
BIOS-e820: 00000000fec00000 - 00000000fec10000 (reserved)
BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
BIOS-e820: 00000000ff000000 - 0000000100000000 (reserved)
1150MB HIGHMEM available.
896MB LOWMEM available.
found SMP MP-table at 000f74f0
Memory for crash kernel (0x0 to 0x0) notwithin permissible range
disabling kdump
Using x86 segment limits to approximate NX protection
On node 0 totalpages: 523936
DMA zone: 4096 pages, LIFO batch:0
Normal zone: 225280 pages, LIFO batch:31
HighMem zone: 294560 pages, LIFO batch:31
DMI present.
Using APIC driver default
ACPI: RSDP (v002 HP ) @ 0x000f74c0
ACPI: XSDT (v001 HP ProLiant 0x06040000 LTP 0x00000000) @ 0x7fea4020
ACPI: FADT (v003 HP ProLiant 0x06040000 PTL 0x00000002) @ 0x7feaa857
ACPI: SPMI (v005 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaa94b
ACPI: EINJ (v001 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaa98b
ACPI: HEST (v001 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaab3b
ACPI: BERT (v001 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaab63
ACPI: SSDT (v001 HP ProLiant 0x06040000 INTL 0x20050624) @ 0x7feaab93
ACPI: ERST (v001 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaac74
ACPI: MCFG (v001 HP ProLiant 0x06040000 LTP 0x00000000) @ 0x7feaaee4
ACPI: MADT (v001 HP ProLiant 0x06040000 LTP 0x00000000) @ 0x7feaaf20
ACPI: BOOT (v001 HP ProLiant 0x06040000 LTP 0x00000001) @ 0x7feaaf88
ACPI: SPCR (v001 HP ProLiant 0x06040000 PTL 0x00000001) @ 0x7feaafb0
ACPI: SSDT (v001 HP Cpu0Tst 0x00003000 INTL 0x2005022 @ 0x7fea555f
ACPI: SSDT (v001 HP Cpu1Tst 0x00003000 INTL 0x2005022 @ 0x7fea54b9
ACPI: SSDT (v001 HP CpuPm 0x00003000 INTL 0x2005022 @ 0x7fea40b4
ACPI: DSDT (v001 HP ProLiant 0x06040000 MSFT 0x0100000e) @ 0x00000000
ACPI: PM-Timer IO Port: 0x1008
ACPI: Local APIC address 0xfee00000
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
Processor #0 6:15 APIC version 20
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
Processor #1 6:15 APIC version 20
ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
ACPI: IRQ0 used by override.
ACPI: IRQ2 used by override.
ACPI: IRQ9 used by override.
Enabling APIC mode: Flat. Using 1 I/O APICs
Using ACPI (MADT) for SMP configuration information
Allocating PCI resources starting at 88000000 (gap: 80000000:70000000)
Detected 1800.113 MHz processor.
Built 1 zonelists. Total pages: 523936
Kernel command line: ro root=LABEL=/
mapped APIC to ffffd000 (fee00000)
mapped IOAPIC to ffffc000 (fec00000)
Enabling fast FPU save and restore... done.
Enabling unmasked SIMD FPU exception support... done.
Initializing CPU#0
CPU 0 irqstacks, hard=c076c000 soft=c074c000
PID hash table entries: 4096 (order: 12, 16384 bytes)
Console: colour VGA+ 80x25
Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
Memory: 2069948k/2095744k available (2190k kernel code, 24460k reserved, 911k data, 228k init, 1178240k highmem)
Checking if this processor honours the WP bit even in supervisor mode... Ok.
Calibrating delay loop (skipped), value calculated using timer frequency.. 3600.22 BogoMIPS (lpj=1800113)
Security Framework v1.0.0 initialized
SELinux: Initializing.
SELinux: Starting in permissive mode
selinux_register_security: Registering secondary module capability
Capability LSM initialized as secondary
Mount-cache hash table entries: 512
CPU: After generic identify, caps: bfebfbff 20100000 00000000 00000000 0000e39d 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20100000 00000000 00000000 0000e39d 00000000 00000001
monitor/mwait feature present.
using mwait in idle threads.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
CPU: After all inits, caps: bfebf3ff 20100000 00000000 00000940 0000e39d 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#0.
Checking 'hlt' instruction... OK.
SMP alternatives: switching to UP code
ACPI: Core revision 20060707
CPU0: Intel(R) Pentium(R) Dual CPU E2160 @ 1.80GHz stepping 0d
SMP alternatives: switching to SMP code
Booting processor 1/1 eip 11000
CPU 1 irqstacks, hard=c076d000 soft=c074d000
Initializing CPU#1
Calibrating delay using timer specific routine.. 3599.49 BogoMIPS (lpj=179974
CPU: After generic identify, caps: bfebfbff 20100000 00000000 00000000 0000e39d 00000000 00000001
CPU: After vendor identify, caps: bfebfbff 20100000 00000000 00000000 0000e39d 00000000 00000001
monitor/mwait feature present.
CPU: L1 I cache: 32K, L1 D cache: 32K
CPU: L2 cache: 1024K
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 1
CPU: After all inits, caps: bfebf3ff 20100000 00000000 00000940 0000e39d 00000000 00000001
Intel machine check architecture supported.
Intel machine check reporting enabled on CPU#1.
CPU1: Intel(R) Pentium(R) Dual CPU E2160 @ 1.80GHz stepping 0d
Total of 2 processors activated (7199.72 BogoMIPS).
ENABLING IO-APIC IRQs
..TIMER: vector=0x31 apic1=0 pin1=2 apic2=-1 pin2=-1
Using local APIC timer interrupts.
checking TSC synchronization across 2 CPUs: passed.
Brought up 2 CPUs
sizeof(vma)=84 bytes
sizeof(page)=32 bytes
sizeof(inode)=340 bytes
sizeof(dentry)=136 bytes
sizeof(ext3inode)=492 bytes
sizeof(buffer_head)=52 bytes
sizeof(skbuff)=176 bytes
migration_cost=17
checking if image is initramfs... it is
Freeing initrd memory: 2618k freed
NET: Registered protocol family 16
ACPI: bus type pci registered
PCI: Using MMCONFIG
Setting up standard PCI resources
ACPI: Interpreter enabled
ACPI: Using IOAPIC for interrupt routing
ACPI: No dock devices found.
ACPI: PCI Root Bridge [PCI0] (0000:00)
PCI: Transparent bridge - 0000:00:1e.0
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PEG1._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP1._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP5._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.EXP6._PRT]
ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCIB._PRT]
ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 *5 6 7 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKC] (IRQs *3 4 5 6 7 10 11 12 14 15)
ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled.
Linux Plug and Play Support v0.97 (c) Adam Belay
pnp: PnP ACPI init
pnp: PnP ACPI: found 10 devices
usbcore: registered new driver usbfs
usbcore: registered new driver hub
PCI: Using ACPI for IRQ routing
PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
NetLabel: Initializing
NetLabel: domain hash size = 128
NetLabel: protocols = UNLABELED CIPSOv4
NetLabel: unlabeled traffic allowed by default
pnp: 00:01: iomem range 0xf0000000-0xf7ffffff could not be reserved
pnp: 00:01: iomem range 0xfe000000-0xff7fffff could not be reserved
PCI: Bridge: 0000:00:01.0
IO window: 2000-0000
MEM window: ec100000-00000000
PREFETCH window 0x0000000088000000-0x00000000881fffff
PCI: Bridge: 0000:00:1c.0
IO window: 3000-0000
MEM window: ec200000-00000000
PREFETCH window 0x0000000088200000-0x00000000882fffff
PCI: Bridge: 0000:00:1c.4
IO window: disabled.
MEM window: ec300000-00000000
PREFETCH window 0x00000000ee000000-0x00000000eeffffff
PCI: Bridge: 0000:00:1c.5
IO window: disabled.
MEM window: ed000000-00000000
PREFETCH window: disabled.
PCI: Bridge: 0000:00:1e.0
IO window: disabled.
MEM window: disabled.
PREFETCH window: disabled.
ACPI: PCI Interrupt 0000:00:01.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:01.0 to 64
ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1c.0 to 64
ACPI: PCI Interrupt 0000:00:1c.4[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1c.4 to 64
ACPI: PCI Interrupt 0000:00:1c.5[B] -> GSI 17 (level, low) -> IRQ 177
PCI: Setting latency timer of device 0000:00:1c.5 to 64
PCI: Setting latency timer of device 0000:00:1e.0 to 64
NET: Registered protocol family 2
IP route cache hash table entries: 32768 (order: 5, 131072 bytes)
TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
TCP: Hash tables configured (established 131072 bind 65536)
TCP reno registered
Simple Boot Flag at 0x44 set to 0x1
apm: BIOS not found.
audit: initializing netlink socket (disabled)
type=2000 audit(1309519554.777:1): initialized
highmem bounce pool size: 64 pages
Total HugeTLB memory allocated, 0
VFS: Disk quotas dquot_6.5.1
Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
SELinux: Registering netfilter hooks
Initializing Cryptographic API
alg: No test for crc32c (crc32c-generic)
ksign: Installing public key data
Loading keyring
- Added public key 95732D6B52470C6F
- User ID: CentOS (Kernel Module GPG key)
io scheduler noop registered
io scheduler anticipatory registered
io scheduler deadline registered
io scheduler cfq registered (default)
Boot video device is 0000:0d:00.0
PCI: Setting latency timer of device 0000:00:01.0 to 64
PCI: Setting latency timer of device 0000:00:1c.0 to 64
PCI: Setting latency timer of device 0000:00:1c.4 to 64
PCI: Setting latency timer of device 0000:00:1c.5 to 64
pci_hotplug: PCI Hot Plug PCI Core version: 0.5
ACPI (exconfig-0456): Dynamic SSDT Load - OemId [HP ] OemTableId [ Cpu0Ist] [20060707]
ACPI: Processor [CPU0] (supports 8 throttling states)
ACPI (exconfig-0456): Dynamic SSDT Load - OemId [HP ] OemTableId [ Cpu1Ist] [20060707]
ACPI: Processor [CPU1] (supports 8 throttling states)
Real Time Clock Driver v1.12ac
Non-volatile memory driver v1.2
Linux agpgart interface v0.101 (c) Dave Jones
Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
00:07: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
brd: module loaded
Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Probing IDE interface ide0...
Probing IDE interface ide1...
ide-floppy driver 0.99.newide
usbcore: registered new driver hiddev
usbcore: registered new driver usbhid
drivers/usb/input/hid-core.c: v2.6:USB HID core driver
PNP: No PS/2 controller found. Probing ports directly.
serio: i8042 KBD port at 0x60,0x64 irq 1
mice: PS/2 mouse device common for all mice
md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
md: bitmap version 4.39
TCP bic registered
Initializing IPsec netlink socket
NET: Registered protocol family 1
NET: Registered protocol family 17
Using IPI No-Shortcut mode
Time: acpi_pm clocksource has been installed.
ACPI: (supports S0 S1 S4 S5)
Initalizing network drop monitor service
Freeing unused kernel memory: 228k freed
Write protecting the kernel read-only data: 413k
ACPI: PCI Interrupt 0000:00:1a.7[C] -> GSI 18 (level, low) -> IRQ 225
PCI: Setting latency timer of device 0000:00:1a.7 to 64
ehci_hcd 0000:00:1a.7: EHCI Host Controller
ehci_hcd 0000:00:1a.7: new USB bus registered, assigned bus number 1
ehci_hcd 0000:00:1a.7: debug port 1
PCI: cache line size of 32 is not supported by device 0000:00:1a.7
ehci_hcd 0000:00:1a.7: irq 225, io mem 0xec000000
ehci_hcd 0000:00:1a.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb1: configuration #1 chosen from 1 choice
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 6 ports detected
ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1d.7 to 64
ehci_hcd 0000:00:1d.7: EHCI Host Controller
ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 2
ehci_hcd 0000:00:1d.7: debug port 1
PCI: cache line size of 32 is not supported by device 0000:00:1d.7
ehci_hcd 0000:00:1d.7: irq 169, io mem 0xec000400
ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
usb usb2: configuration #1 chosen from 1 choice
hub 2-0:1.0: USB hub found
hub 2-0:1.0: 6 ports detected
ohci_hcd: 2005 April 22 USB 1.1 'Open' Host Controller (OHCI) Driver (PCI)
USB Universal Host Controller Interface driver v3.0
ACPI: PCI Interrupt 0000:00:1a.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1a.0 to 64
uhci_hcd 0000:00:1a.0: UHCI Host Controller
uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
uhci_hcd 0000:00:1a.0: irq 169, io base 0x00001820
usb usb3: configuration #1 chosen from 1 choice
hub 3-0:1.0: USB hub found
hub 3-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1a.1[B] -> GSI 17 (level, low) -> IRQ 177
PCI: Setting latency timer of device 0000:00:1a.1 to 64
uhci_hcd 0000:00:1a.1: UHCI Host Controller
uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
uhci_hcd 0000:00:1a.1: irq 177, io base 0x00001840
usb usb4: configuration #1 chosen from 1 choice
hub 4-0:1.0: USB hub found
hub 4-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1a.2[C] -> GSI 18 (level, low) -> IRQ 225
PCI: Setting latency timer of device 0000:00:1a.2 to 64
uhci_hcd 0000:00:1a.2: UHCI Host Controller
uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
uhci_hcd 0000:00:1a.2: irq 225, io base 0x00001860
usb usb5: configuration #1 chosen from 1 choice
hub 5-0:1.0: USB hub found
hub 5-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:00:1d.0 to 64
uhci_hcd 0000:00:1d.0: UHCI Host Controller
uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
uhci_hcd 0000:00:1d.0: irq 169, io base 0x00001880
usb usb6: configuration #1 chosen from 1 choice
hub 6-0:1.0: USB hub found
hub 6-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.1[B] -> GSI 17 (level, low) -> IRQ 177
PCI: Setting latency timer of device 0000:00:1d.1 to 64
uhci_hcd 0000:00:1d.1: UHCI Host Controller
uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
uhci_hcd 0000:00:1d.1: irq 177, io base 0x000018a0
usb usb7: configuration #1 chosen from 1 choice
hub 7-0:1.0: USB hub found
hub 7-0:1.0: 2 ports detected
ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 18 (level, low) -> IRQ 225
PCI: Setting latency timer of device 0000:00:1d.2 to 64
uhci_hcd 0000:00:1d.2: UHCI Host Controller
uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
uhci_hcd 0000:00:1d.2: irq 225, io base 0x000018c0
usb usb8: configuration #1 chosen from 1 choice
hub 8-0:1.0: USB hub found
hub 8-0:1.0: 2 ports detected
usb 6-2: new full speed USB device using uhci_hcd and address 2
SCSI subsystem initialized
Fusion MPT base driver 3.04.15rh
Copyright (c) 1999-2008 LSI Corporation
Fusion MPT SAS Host driver 3.04.15rh
ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 169
mptbase: ioc0: Initiating bringup
usb 6-2: configuration #1 chosen from 1 choice
input: ServerEngines SE USB Device as /class/input/input0
input: USB HID v1.11 Keyboard [ServerEngines SE USB Device] on usb-0000:00:1d.0-2
input: ServerEngines SE USB Device as /class/input/input1
input: USB HID v1.11 Mouse [ServerEngines SE USB Device] on usb-0000:00:1d.0-2
ioc0: LSISAS1068E B3: Capabilities={Initiator}
PCI: Setting latency timer of device 0000:01:00.0 to 64
scsi0 : ioc0: LSISAS1068E B3, FwRev=01172800h, Ports=1, MaxQ=163, IRQ=169
mptsas: ioc0: attaching sata device: fw_channel 0, fw_id 1, phy 0, sas_addr 0x1221000000000000
Vendor: ATA Model: GB0250EAFJF Rev: HPG6
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
sda: Write Protect is off
sda: Mode Sense: 73 00 00 08
SCSI device sda: drive cache: write through
SCSI device sda: 488397168 512-byte hdwr sectors (250059 MB)
sda: Write Protect is off
sda: Mode Sense: 73 00 00 08
SCSI device sda: drive cache: write through
sda: sda1 sda2 sda3 sda4 < sda5 >
sd 0:0:0:0: Attached scsi disk sda
mptsas: ioc0: attaching sata device: fw_channel 0, fw_id 2, phy 1, sas_addr 0x1221000001000000
Vendor: ATA Model: GB0250EAFJF Rev: HPG6
Type: Direct-Access ANSI SCSI revision: 05
SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
sdb: Write Protect is off
sdb: Mode Sense: 73 00 00 08
SCSI device sdb: drive cache: write through
SCSI device sdb: 488397168 512-byte hdwr sectors (250059 MB)
sdb: Write Protect is off
sdb: Mode Sense: 73 00 00 08
SCSI device sdb: drive cache: write through
sdb:
sd 0:0:1:0: Attached scsi disk sdb
libata version 3.00 loaded.
ata_piix 0000:00:1f.2: version 2.12
ACPI: PCI Interrupt 0000:00:1f.2[B] -> GSI 17 (level, low) -> IRQ 177
ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
PCI: Setting latency timer of device 0000:00:1f.2 to 64
scsi1 : ata_piix
scsi2 : ata_piix
ata1: SATA max UDMA/133 cmd 0x1c50 ctl 0x1c44 bmdma 0x1c10 irq 177
ata2: SATA max UDMA/133 cmd 0x1c48 ctl 0x1c40 bmdma 0x1c18 irq 177
ata1: SATA link down (SStatus 0 SControl 300)
ata2: SATA link down (SStatus 0 SControl 300)
ACPI: PCI Interrupt 0000:00:1f.5[C] -> GSI 18 (level, low) -> IRQ 225
ata_piix 0000:00:1f.5: MAP [ P0 -- P1 -- ]
PCI: Setting latency timer of device 0000:00:1f.5 to 64
scsi3 : ata_piix
scsi4 : ata_piix
ata3: SATA max UDMA/133 cmd 0x1c68 ctl 0x1c5c bmdma 0x1c30 irq 225
ata4: SATA max UDMA/133 cmd 0x1c60 ctl 0x1c58 bmdma 0x1c38 irq 225
ata3: SATA link down (SStatus 0 SControl 300)
ata4: SATA link down (SStatus 0 SControl 300)
device-mapper: uevent: version 1.0.3
device-mapper: ioctl: 4.11.5-ioctl (2007-12-12) initialised: dm-devel@redhat.com
device-mapper: dm-raid45: initialized v0.2594l
EXT3-fs: INFO: recovery required on readonly filesystem.
EXT3-fs: write access will be enabled during recovery.
kjournald starting. Commit interval 5 seconds
EXT3-fs: sda2: orphan cleanup on readonly fs
ext3_orphan_cleanup: deleting unreferenced inode 5687631
ext3_orphan_cleanup: deleting unreferenced inode 5687628
ext3_orphan_cleanup: deleting unreferenced inode 5687643
ext3_orphan_cleanup: deleting unreferenced inode 5684176
ext3_orphan_cleanup: deleting unreferenced inode 5687630
ext3_orphan_cleanup: deleting unreferenced inode 5681741
ext3_orphan_cleanup: deleting unreferenced inode 7995603
ext3_orphan_cleanup: deleting unreferenced inode 5687224
ext3_orphan_cleanup: deleting unreferenced inode 6127883
ext3_orphan_cleanup: deleting unreferenced inode 7996535
ext3_orphan_cleanup: deleting unreferenced inode 5680448
ext3_orphan_cleanup: deleting unreferenced inode 7996276
ext3_orphan_cleanup: deleting unreferenced inode 5687629
ext3_orphan_cleanup: deleting unreferenced inode 7996534
ext3_orphan_cleanup: deleting unreferenced inode 7996533
ext3_orphan_cleanup: deleting unreferenced inode 5687507
ext3_orphan_cleanup: deleting unreferenced inode 5678782
ext3_orphan_cleanup: deleting unreferenced inode 7995607
ext3_orphan_cleanup: deleting unreferenced inode 5687633
ext3_orphan_cleanup: deleting unreferenced inode 5678609
ext3_orphan_cleanup: deleting unreferenced inode 5686102
ext3_orphan_cleanup: deleting unreferenced inode 5686867
ext3_orphan_cleanup: deleting unreferenced inode 7995682
ext3_orphan_cleanup: deleting unreferenced inode 7996531
ext3_orphan_cleanup: deleting unreferenced inode 7996298
ext3_orphan_cleanup: deleting unreferenced inode 7995590
ext3_orphan_cleanup: deleting unreferenced inode 7995472
ext3_orphan_cleanup: deleting unreferenced inode 7995448
ext3_orphan_cleanup: deleting unreferenced inode 7995444
ext3_orphan_cleanup: deleting unreferenced inode 5687612
ext3_orphan_cleanup: deleting unreferenced inode 5687609
ext3_orphan_cleanup: deleting unreferenced inode 5687608
ext3_orphan_cleanup: deleting unreferenced inode 5687607
ext3_orphan_cleanup: deleting unreferenced inode 5687606
ext3_orphan_cleanup: deleting unreferenced inode 5687605
ext3_orphan_cleanup: deleting unreferenced inode 5680419
ext3_orphan_cleanup: deleting unreferenced inode 7995438
ext3_orphan_cleanup: deleting unreferenced inode 7995446
ext3_orphan_cleanup: deleting unreferenced inode 7995418
ext3_orphan_cleanup: deleting unreferenced inode 7996519
ext3_orphan_cleanup: deleting unreferenced inode 7996516
ext3_orphan_cleanup: deleting unreferenced inode 7995420
ext3_orphan_cleanup: deleting unreferenced inode 5681580
ext3_orphan_cleanup: deleting unreferenced inode 7995422
ext3_orphan_cleanup: deleting unreferenced inode 5687750
ext3_orphan_cleanup: deleting unreferenced inode 5687601
ext3_orphan_cleanup: deleting unreferenced inode 5681587
ext3_orphan_cleanup: deleting unreferenced inode 7995432
ext3_orphan_cleanup: deleting unreferenced inode 7995414
ext3_orphan_cleanup: deleting unreferenced inode 7995407
ext3_orphan_cleanup: deleting unreferenced inode 5683667
ext3_orphan_cleanup: deleting unreferenced inode 5687623
ext3_orphan_cleanup: deleting unreferenced inode 5687622
ext3_orphan_cleanup: deleting unreferenced inode 5687624
ext3_orphan_cleanup: deleting unreferenced inode 5735294
ext3_orphan_cleanup: deleting unreferenced inode 7996537
ext3_orphan_cleanup: deleting unreferenced inode 7995442
ext3_orphan_cleanup: deleting unreferenced inode 7996532
ext3_orphan_cleanup: deleting unreferenced inode 7995440
ext3_orphan_cleanup: deleting unreferenced inode 7995431
ext3_orphan_cleanup: deleting unreferenced inode 7995429
ext3_orphan_cleanup: deleting unreferenced inode 7995688
ext3_orphan_cleanup: deleting unreferenced inode 7995424
ext3_orphan_cleanup: deleting unreferenced inode 7995430
ext3_orphan_cleanup: deleting unreferenced inode 7995615
ext3_orphan_cleanup: deleting unreferenced inode 7995409
ext3_orphan_cleanup: deleting unreferenced inode 7995395
ext3_orphan_cleanup: deleting unreferenced inode 5687395
ext3_orphan_cleanup: deleting unreferenced inode 5677578
ext3_orphan_cleanup: deleting unreferenced inode 5769632
ext3_orphan_cleanup: deleting unreferenced inode 5769630
ext3_orphan_cleanup: deleting unreferenced inode 5769600
ext3_orphan_cleanup: deleting unreferenced inode 5769598
ext3_orphan_cleanup: deleting unreferenced inode 5769438
ext3_orphan_cleanup: deleting unreferenced inode 5769412
ext3_orphan_cleanup: deleting unreferenced inode 5769410
ext3_orphan_cleanup: deleting unreferenced inode 5769382
ext3_orphan_cleanup: deleting unreferenced inode 5769902
ext3_orphan_cleanup: deleting unreferenced inode 56295464
ext3_orphan_cleanup: deleting unreferenced inode 5686099
ext3_orphan_cleanup: deleting unreferenced inode 5681461
ext3_orphan_cleanup: deleting unreferenced inode 5679162
ext3_orphan_cleanup: deleting unreferenced inode 5678355
ext3_orphan_cleanup: deleting unreferenced inode 5686170
ext3_orphan_cleanup: deleting unreferenced inode 5686168
ext3_orphan_cleanup: deleting unreferenced inode 7995477
ext3_orphan_cleanup: deleting unreferenced inode 5686095
ext3_orphan_cleanup: deleting unreferenced inode 5681459
ext3_orphan_cleanup: deleting unreferenced inode 5686113
ext3_orphan_cleanup: deleting unreferenced inode 5686112
ext3_orphan_cleanup: deleting unreferenced inode 56295674
ext3_orphan_cleanup: deleting unreferenced inode 5687564
ext3_orphan_cleanup: deleting unreferenced inode 43024387
ext3_orphan_cleanup: deleting unreferenced inode 56295554
ext3_orphan_cleanup: deleting unreferenced inode 5678492
ext3_orphan_cleanup: deleting unreferenced inode 5686163
ext3_orphan_cleanup: deleting unreferenced inode 5677269
ext3_orphan_cleanup: deleting unreferenced inode 5681215
ext3_orphan_cleanup: deleting unreferenced inode 5681213
ext3_orphan_cleanup: deleting unreferenced inode 5677678
ext3_orphan_cleanup: deleting unreferenced inode 7995482
ext3_orphan_cleanup: deleting unreferenced inode 7995480
ext3_orphan_cleanup: deleting unreferenced inode 5684385
ext3_orphan_cleanup: deleting unreferenced inode 5678474
ext3_orphan_cleanup: deleting unreferenced inode 5678472
ext3_orphan_cleanup: deleting unreferenced inode 5685931
ext3_orphan_cleanup: deleting unreferenced inode 5678266
ext3_orphan_cleanup: deleting unreferenced inode 5677681
ext3_orphan_cleanup: deleting unreferenced inode 5677671
ext3_orphan_cleanup: deleting unreferenced inode 7996525
ext3_orphan_cleanup: deleting unreferenced inode 7995447
ext3_orphan_cleanup: deleting unreferenced inode 5686164
ext3_orphan_cleanup: deleting unreferenced inode 5677384
ext3_orphan_cleanup: deleting unreferenced inode 7995464
ext3_orphan_cleanup: deleting unreferenced inode 7995616
ext3_orphan_cleanup: deleting unreferenced inode 7995614
ext3_orphan_cleanup: deleting unreferenced inode 5681557
ext3_orphan_cleanup: deleting unreferenced inode 5681571
ext3_orphan_cleanup: deleting unreferenced inode 7995601
ext3_orphan_cleanup: deleting unreferenced inode 5681561
ext3_orphan_cleanup: deleting unreferenced inode 5681573
ext3_orphan_cleanup: deleting unreferenced inode 7995441
ext3_orphan_cleanup: deleting unreferenced inode 7995469
ext3_orphan_cleanup: deleting unreferenced inode 5685930
ext3_orphan_cleanup: deleting unreferenced inode 7995425
ext3_orphan_cleanup: deleting unreferenced inode 5678899
ext3_orphan_cleanup: deleting unreferenced inode 5686087
ext3_orphan_cleanup: deleting unreferenced inode 7996280
ext3_orphan_cleanup: deleting unreferenced inode 7995484
ext3_orphan_cleanup: deleting unreferenced inode 5686166
ext3_orphan_cleanup: deleting unreferenced inode 7995419
ext3_orphan_cleanup: deleting unreferenced inode 7995462
ext3_orphan_cleanup: deleting unreferenced inode 7995458
ext3_orphan_cleanup: deleting unreferenced inode 7995621
ext3_orphan_cleanup: deleting unreferenced inode 7995619
ext3_orphan_cleanup: deleting unreferenced inode 7995465
ext3_orphan_cleanup: deleting unreferenced inode 5687453
ext3_orphan_cleanup: deleting unreferenced inode 5687452
ext3_orphan_cleanup: deleting unreferenced inode 7995456
ext3_orphan_cleanup: deleting unreferenced inode 7995475
ext3_orphan_cleanup: deleting unreferenced inode 5687454
ext3_orphan_cleanup: deleting unreferenced inode 5677483
ext3_orphan_cleanup: deleting unreferenced inode 5677546
ext3_orphan_cleanup: deleting unreferenced inode 5677128
ext3_orphan_cleanup: deleting unreferenced inode 5687455
ext3_orphan_cleanup: deleting unreferenced inode 5677262
ext3_orphan_cleanup: deleting unreferenced inode 7995443
ext3_orphan_cleanup: deleting unreferenced inode 5687398
ext3_orphan_cleanup: deleting unreferenced inode 5677431
ext3_orphan_cleanup: deleting unreferenced inode 5687396
ext3_orphan_cleanup: deleting unreferenced inode 5687394
ext3_orphan_cleanup: deleting unreferenced inode 5677162
ext3_orphan_cleanup: deleting unreferenced inode 7995439
ext3_orphan_cleanup: deleting unreferenced inode 5677161
ext3_orphan_cleanup: deleting unreferenced inode 7996511
ext3_orphan_cleanup: deleting unreferenced inode 7995421
ext3_orphan_cleanup: deleting unreferenced inode 7995423
ext3_orphan_cleanup: deleting unreferenced inode 7995471
ext3_orphan_cleanup: deleting unreferenced inode 5677389
ext3_orphan_cleanup: deleting unreferenced inode 5676975
ext3_orphan_cleanup: deleting unreferenced inode 7995474
ext3_orphan_cleanup: deleting unreferenced inode 7995415
ext3_orphan_cleanup: deleting unreferenced inode 7995408
EXT3-fs: sda2: 163 orphan inodes deleted
EXT3-fs: recovery complete.
EXT3-fs: mounted filesystem with ordered data mode.
SELinux: Disabled at runtime.
SELinux: Unregistering netfilter hooks
type=1404 audit(1309519598.714:2): selinux=0 auid=4294967295 ses=4294967295
tg3.c:v3.108 (February 17, 2010)
ACPI: PCI Interrupt 0000:0e:00.0[A] -> GSI 17 (level, low) -> IRQ 177
PCI: Setting latency timer of device 0000:0e:00.0 to 64
eth0: Tigon3 [partno(N/A) rev a200 PHY(5722/5756)] (PCI Express) 10/100/1000Base-T Ethernet 00:23:7d:aa:43:53
eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] WireSpeed[1] TSOcap[1]
eth0: dma_rwctrl[76180000] dma_mask[64-bit]
input: PC Speaker as /class/input/input2
EDAC MC: Ver: 2.0.1 May 31 2011
EDAC MC0: Giving out device to i3200_edac i3200: DEV 0000:00:00.0
PCI: Enabling device 0000:00:1f.3 (0001 -> 0003)
ACPI: PCI Interrupt 0000:00:1f.3[B] -> GSI 17 (level, low) -> IRQ 177
e1000e: Intel(R) PRO/1000 Network Driver - 1.2.7-k2
e1000e: Copyright (c) 1999 - 2010 Intel Corporation.
e1000e 0000:05:00.0: Disabling ASPM L1
ACPI: PCI Interrupt 0000:05:00.0[A] -> GSI 16 (level, low) -> IRQ 169
PCI: Setting latency timer of device 0000:05:00.0 to 64
eth1: (PCI Express:2.5GB/s:Width x1) 00:18:71:ec:d2:d0
eth1: Intel(R) PRO/1000 Network Connection
eth1: MAC: 1, PHY: 4, PBA No: d70413-003
sd 0:0:0:0: Attached scsi generic sg0 type 0
sd 0:0:1:0: Attached scsi generic sg1 type 0
floppy0: no floppy controllers found
work still pending
lp: driver loaded but no devices found
ACPI: Power Button (FF) [PWRF]
ACPI: Power Button (CM) [PWRB]
ACPI: Mapper loaded
dell-wmi: No known WMI GUID found
md: Autodetecting RAID arrays.
md: autorun ...
md: ... autorun DONE.
device-mapper: multipath: version 1.0.6 loaded
EXT3 FS on sda2, internal journal
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda3, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3 FS on sda1, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
Adding 4128664k swap on /dev/sda5. Priority:-1 extents:1 across:4128664k
IA-32 Microcode Update Driver: v1.14a <tigran@veritas.com>
microcode: CPU0 updated from revision 0xa1 to 0xa4, date = 10022010
microcode: CPU1 updated from revision 0xa1 to 0xa4, date = 10022010
Loading iSCSI transport class v2.0-871.
802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com>
All bugs added by David S. Miller <davem@redhat.com>
cxgb3i: tag itt 0x1fff, 13 bits, age 0xf, 4 bits.
iscsi: registered transport (cxgb3i)
NET: Registered protocol family 10
lo: Disabled Privacy Extensions
IPv6 over IPv4 tunneling driver
Broadcom NetXtreme II CNIC Driver cnic v2.1.2 (May 26, 2010)
Broadcom NetXtreme II iSCSI Driver bnx2i v2.1.3 (Aug 10, 2010)
iscsi: registered transport (bnx2i)
iscsi: registered transport (tcp)
iscsi: registered transport (iser)
iscsi: registered transport (be2iscsi)
ADDRCONF(NETDEV_UP): eth0: link is not ready
tg3: eth0: Link is up at 100 Mbps, full duplex.
tg3: eth0: Flow control is off for TX and off for RX.
ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Bluetooth: Core ver 2.10
NET: Registered protocol family 31
Bluetooth: HCI device and connection manager initialized
Bluetooth: HCI socket layer initialized
Bluetooth: L2CAP ver 2.8
Bluetooth: L2CAP socket layer initialized
Bluetooth: HIDP (Human Interface Emulation) ver 1.1
sd 0:0:0:0: SCSI error: return code = 0x08000002
sda: Current: sense key: Medium Error
Add. Sense: Unrecovered read error

Info fld=0x1c6e4b42
end_request: I/O error, dev sda, sector 476990274
EXT3-fs error (device sda3): read_inode_bitmap: Cannot read inode bitmap - block_group = 4, inode_bitmap = 131073
Aborting journal on device sda3.
EXT3-fs error (device sda3) in ext3_new_inode: IO failure
EXT3-fs error (device sda3) in ext3_mkdir: IO failure
__journal_remove_journal_head: freeing b_committed_data
ext3_abort called.
EXT3-fs error (device sda3): ext3_journal_start_sb: Detected aborted journal
Remounting filesystem read-only
[root@hosted-by ~]# tail -f /var/log/messages
Jul 3 17:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 17:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 18:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 18:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 19:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 19:57:45 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 20:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 20:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 21:27:45 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 21:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors

[Irithori]

end_request: I/O error, dev sda, sector 476990274
EXT3-fs error (device sda3): read_inode_bitmap: Cannot read inode bitmap - block_group = 4, inode_bitmap = 131073
Aborting journal on device sda3.
EXT3-fs error (device sda3) in ext3_new_inode: IO failure
EXT3-fs error (device sda3) in ext3_mkdir: IO failure
__journal_remove_journal_head: freeing b_committed_data
ext3_abort called.
EXT3-fs error (device sda3): ext3_journal_start_sb: Detected aborted journal
Remounting filesystem read-only
[root@hosted-by ~]# tail -f /var/log/messages
Jul 3 17:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 17:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 18:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 18:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 19:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 19:57:45 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 20:27:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 20:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 21:27:45 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors
Jul 3 21:57:44 hosted-by smartd[3038]: Device: /dev/sda, 5 Currently unreadable (pending) sectors

The harddisc sda has errors.
Backup your data *now*

Replace the disc,
reinstall the system,
restore from backup.

[gjessing]

Thanks for the ansvar - i will now take contakt to my host and ask him for the harddrive change

thanks again
All the best.
Søren - litle Denmark

[Irithori]

yw
Good luck with the restore.

Greetings from Munich

[gjessing]

Hi again
Finaly the provider did change the harddrive and install CentOS 5.5 (again)

But now my sites would load or how to explain it, they are loadet but the site is totaly blank.
I think it is the mod_rewrite

I did install mod_rewrite and some more modules, but maby it is my httpd.conf.?

I cannot add my httpd.conf (not allowed to post www or some ting )

[Irithori]

Do you still have the configs of the old system?
Maybe in a backup or revision control system (cvs,svn,git,..) or system/config management tool (cfengine,puppet,..)?

Because if the configs are the same and the data is the same, then it is more or less only a matter of adding some missing pieces to the system.
(which btw could be fully automated. And should, if you want to scale)

If the old configs are no longer available, then there are more variables.
- Start the daemons, look for errors/warnings in the logs
- fix them
- Test your site, look for errors/warnings in the logs
- fix these

As you can tell, this needs knowledge of both your system and your site.
Depending on the problems, a forum might not be the fastest way of solving this (There might be a lot of back and forth involved)
But we can try

Btw, you can post configs/logs/code/etc in CODE tags. That makes it easier to read and the text will not be mangled.
like this

example