Find the answer to your Linux question:
Results 1 to 3 of 3
Hello all, Not sure what I'm doing wrong here, but let me try to provide all the necessary information. I have a server running the latest version of debian, with ...
Enjoy an ad free experience by logging in. Not a member yet? Register.
  1. #1
    Just Joined!
    Join Date
    Dec 2008
    Posts
    2

    Raid 5 woes


    Hello all,

    Not sure what I'm doing wrong here, but let me try to provide all the necessary information.

    I have a server running the latest version of debian, with a 16 drive scsi array on the front. There is no hardware control for raids, so it must be done via software raid (mdadm). The drives are roughly 150gb each.

    The hardware appears to be fine.. I can create 4 4 drive raids, 2 8 drive raids, etc, I can make 1 large raid 1 drive. However, I want to make this into one large raid 5 array, which comes out to a little more than 2TB. When I try to tie them all together via mdadm it gets... crazy.

    .....
    Dec 22 17:14:32 sts kernel: disk 13, o:1, dev:sdn1
    Dec 22 17:14:32 sts kernel: disk 14, o:1, dev:sdo1
    Dec 22 17:14:32 sts kernel: disk 15, o:1, dev:sdp1
    Dec 22 17:14:32 sts kernel: md: syncing RAID array md0
    Dec 22 17:14:32 sts kernel: md: minimum _guaranteed_ reconstruction speed: 1000 KB/sec/disc.
    Dec 22 17:14:32 sts kernel: md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for reconstruction.
    Dec 22 17:14:32 sts kernel: md: using 128k window, over a total of 143661056 blocks.
    Dec 22 17:15:03 sts kernel: mptscsih: ioc1: attempting task abort! (sc=f77c7080)
    Dec 22 17:15:03 sts kernel: sd 1:0:2:0:
    Dec 22 17:15:03 sts kernel: command: Read(10): 28 00 00 00 03 47 00 00 f8 00
    Dec 22 17:15:05 sts kernel: mptbase: Initiating ioc1 recovery
    Dec 22 17:15:11 sts kernel: mptscsih: ioc1: task abort: SUCCESS (sc=f77c7080)
    Dec 22 17:15:12 sts kernel: target1:0:0: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:0: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:0: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:1: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:1: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:1: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:2: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:2: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:2: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:3: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:3: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:3: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:8: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:8: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:8: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:9: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:9: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:9: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:10: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:10: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:10: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:14 sts kernel: target1:0:11: Beginning Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:11: Ending Domain Validation
    Dec 22 17:15:14 sts kernel: target1:0:11: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:42 sts kernel: mptscsih: ioc0: attempting task abort! (sc=f77c7380)
    Dec 22 17:15:42 sts kernel: sd 0:0:1:0:
    Dec 22 17:15:42 sts kernel: command: Read(10): 28 00 00 00 08 47 00 00 f8 00
    Dec 22 17:15:44 sts kernel: mptbase: Initiating ioc0 recovery
    Dec 22 17:15:51 sts kernel: mptscsih: ioc0: task abort: SUCCESS (sc=f77c7380)
    Dec 22 17:15:52 sts kernel: target0:0:0: Beginning Domain Validation
    Dec 22 17:15:54 sts kernel: target0:0:0: Ending Domain Validation
    Dec 22 17:15:54 sts kernel: target0:0:0: FAST-160 WIDE SCSI 320.0 MB/s DT IU QAS RTI (6.25 ns, offset 127)
    Dec 22 17:15:54 sts kernel: target0:0:1: Beginning Domain Validation
    Dec 22 17:15:54 sts kernel: target0:0:1: Ending Domain Validation
    ......

    the domain validation will continue cycling thru, stopping at random drives, locking up for a few minutes on the apparent mptscsih error, then unlocking for a few seconds, only to do it again.

    I'm not sure but I'd heard rumors of a 2TB limit on devices. I'm not sure what the problem is exactly, but I know the drives are good, etc.. there are 16 in total, 150GB each scsi.

    Anybody have any ideas?

  2. #2
    Linux Guru coopstah13's Avatar
    Join Date
    Nov 2007
    Location
    NH, USA
    Posts
    3,149
    Size limits

    ext3 has a maximum size for both individual files and the entire filesystem. For the filesystem as a whole that limit is 231−1 blocks. Both limits are dependent on the block size of the filesystem; the following chart summarizes the limits[15]:
    Block size Max file size Max filesystem size
    1KiB 16GiB <2TiB
    2KiB 256GiB <4TiB
    4KiB 2TiB <8TiB
    8KiB[limits 1] 2TiB <16TiB
    from wikipedia
    did you try to create a file system on it?

  3. #3
    Just Joined!
    Join Date
    Dec 2008
    Posts
    2
    Quote Originally Posted by coopstah13 View Post
    from wikipedia
    did you try to create a file system on it?
    I can't, the above happens immediately after mdadm creates the array and it starts rebuilding itself.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •