RAID 5, RAID 6, anaa ZFS Multiple Drive Drop: Synology, QNAP, anaa TrueNAS Array a Asɛe a Wobɛsan Agye a Worensɛe Parity¶

Synology DiskStation, QNAP TS-series, TrueNAS somfo, anaa Linux a wobɛte mdadm storage server beep kɔ so bere a ɛrebɔ amanneɛ sɛ Volume Crashed, Pool Degraded / Faulted, anaa Multiple Drives Disconnected yɛ storage ntɛmpɛ a ɛho hia kɛse. Sɛ drive biako pɛ fi a RAID 5, Synology Nneɛma a Wɔde Afrafra RAID (SHR-1), anaa ZFS RAIDZ1 pool, array no tu mmirika a zero redundancy (degraded tebea), a wɔsan yɛ block ahorow a ayera wɔ nwansena mu denam disk biara a aka a wɔbɛkenkan no pɛpɛɛpɛ no so. Sɛ drive a ɛto so abien no kɔ offline nnɔnhwerew bi akyi, anaasɛ ɛtow Unrecoverable Read Error (URE) fã wɔ rebuild wɔ replacement disk so no, parity math no sɛe na storage pool no kɔ offline koraa. Adwumayɛfo a ehu aka wɔn taa sɛe terabytes a wobetumi asan anya wɔ sikani aduosia a edi hɔ no mu denam Fi ase a wɔbɛkyere so, asan ayɛ nhyehyɛe no ne mdadm --create, anaasɛ wɔhyɛ ma wɔsan kyekye ntɛm ara wɔ intanɛt so wɔ hardware a adi huammɔ so. Sɛ wo hardware RAID controller card no ankasa wui sen disk ahorow no a, dan kɔ RAID controller card wu, amannɔne nhyehyɛe import, ne nea enti a ɛnsɛ sɛ wohyɛ disk ahorow ase da; sɛ ankorankoro hard drive bi rebɔ anaasɛ ɛrepow sɛ ɛbɛbɔ akɔ soro a, hwɛ hard drive a entumi nyɛ adwuma yiye ne data a wɔsan nya anaasɛ NAS RAID array asɛe, draibɛ pii adi nkogu, ne ZFS/Btrfs sanba. Sɛ saa nneɛma a wɔkora so yi a entumi nyɛ adwuma yiye no ma ayaresabea aduruyɛ mu mfoniniyɛ nyɛ adwuma a (PACS), ntɛmpɛ a wɔde mena, anaa nkwa ahobammɔ ho nhyehyɛe, frɛ wo mpɔtam hɔ ntɛmpɛ nɔma (911 wɔ United States ne Canada no, . 112 wɔ Europa Aman Nkabom no nyinaa mu, . 999 wɔ United Kingdom) anaa hwɛ yɛn directory of nɔma ahorow a egye ntɛmpɛ.

Yɛ eyi mprempren¶

1. GYINA na MMƆ "Initialize," "Create Pool," "Repair," anaa run mdadm --create wɔ drive ahorow a wɔatow agu no so: Klik Initialize wɔ Synology DSM anaa QNAP QTS mu, anaasɛ ɛretu mmirika mdadm --create wɔ Linux mu no, kyerɛw superblocks foforo koraa na ofi ase zero parity stripes wɔ member disks nyinaa so. Mpɛn pii no, kar a wɔatow agu no da so ara kura mu 99.99% wo fael ahorow no mu a enni dɛm, a ne event counter nkutoo na ɛhyɛ no agyirae sɛ out-of-sync.
2. Power down NAS anaa server cleanly (anaasɛ twe power sɛ ɛreyɛ nnam rekyekye wɔ clicking drives) to freeze event counters: Sekan biara a array no tra intanɛt so wɔ fã bi asɛe tebea mu, operating system no ma superblock no yɛ kɛse Update Time ne Events counter wɔ disk ahorow a ɛda so wɔ hɔ no so bere a disk a wɔatow agu no tra nwini mu wɔ event nɔma dedaw bi so. Sɛ NAS rebɔ mmɔden sɛ wɔbɛsan asi afiri a wɔde yɛ adwuma wɔ drive a ɛwɔ sectors bɔne so a, sɛ wokɔ so kenkan saa drive no a, ebetumi ayi magnetic platter coating no afi hɔ (head crash).
3. Fa honam fam agyiraehyɛde anaa teyp (Bay 1, . Bay 2, . Bay 3, . Bay 4) ansa na wode tray biara akɔ mu: Bere a Linux mdadm, . LVM2, na ZFS track drive order by UUID wɔ partition superblock biara mu, hardware controllers dedaw ne manual dmsetup pon a wɔsan yɛ no hwehwɛ sɛ wɔyɛ honam fam slot nhyehyɛe pɛpɛɛpɛ (0, 1, 2, 3...).
4. Mmɔ mmɔden da sɛ wobɛsan anya ahoɔden, ahoɔden-assembly, anaa fsck tẽẽ wɔ mfitiase member drives no so; clone drive biara bit-for-bit de di dwuma ddrescue kan: Ansa na wobɛtu mmirika mdadm --assemble --force anaasɛ zpool import -F, fa member disk biara bata Linux adwumayɛbea bi ho denam SATA/SAS tẽẽ so (ɛnyɛ USB bridge a ne bo nyɛ den a ɛhintaw da SMART anaasɛ SCT ERC timeouts) na wɔde clone no ddrescue wɔ spare drive ahorow a ahoɔden wom anaa mfonini fael ahorow so.
5. Force-assemble cloned array no katee wɔ READ-ONLY mode (--readonly anaasɛ -o readonly=on): Bere a wɔreboaboa ano mdadm arrays a wɔn event counters no drifted wɔ bere koro mu multi-drive drop no, twam bere nyinaa --readonly (mdadm --assemble --force --readonly /dev/md0 ...). Wɔ akenkan nkutoo mode mu no, emu biara nni hɔ mdadm, . LVM2, . ext4, . Btrfs, na saa ara nso na ZFS betumi akyerɛw parity stripes so anaasɛ asan abɔ journal a ɛsɛe ade.
6. Copy wo data a ɛho hia sen biara no kɔ independent external backup drive so ntɛm ara bere a wɔde ahyɛ so akenkan nkutoo: Yi wo nkrataa, databases, virtual mfiri, ne mfonini ahorow no kɔ drive a ɛyɛ soronko mu kan, afei popa na sɔ disk ahorow no hwɛ fi mfiase.

--- .

Gyinaesi dua: multi-drive RAID ne ZFS pool ntɛmpɛ triage¶

Fa saa flowchart yi kyerɛ sɛ ebia wo array no huu amane wɔ logical timeout drop (TLER / ERC mismatch), nokware multi-disk bad-sector huammɔdi bere a wɔsan kyekye, anaa ZFS nkitahodi kuw (TXG) mfomso: .

flowchart TD
    Start["RAID 5 / RAID 6 / SHR / ZFS Pool no hwee ase Bere a 2+ Drives Tow"] --> StopIO["STOP Nyinaa Rebuilds & Power Down NAS Ntɛm ara"]
    StopIO --> Label["Fa Bay Nɔma (Bay 1 kosi Bay N) kyerɛw Drive Tray Biara ."]
    Label --> ConnectLinux["Fa Direct SATA / HBA so fa Member Drives bata Ubuntu Linux Rescue Host ho"]

    ConnectLinux --> CheckSmart["Hwɛ SMART & Metadata Akenkan-Nko: smartctl -a / mdadm --hwehwɛ mu / zdb -l"]
    CheckSmart --> PhysicalHealth{"So Drive Biara Rekliki, Pow sɛ Ɛbɛkyinkyin, Anaasɛ Ɛreto Offline wɔ dmesg mu?"}

    PhysicalHealth -->|"Yiw: Mfiri / Ti Di huammɔ wɔ 2+ Drives wɔ RAID 5 mu"| Cleanroom["GYAE Powering Disks -> Fa kɔ Cleanroom Data Recovery Lab"]
    PhysicalHealth -->|"Dabi: Drives Nyinaa Spin Up (Ebia Ɛwɔ Pending Bad Sectors anaasɛ Timeout Drops)"| CloneAll["Fa GNU ddrescue (Forward Pass -> Reverse Scrape) Fa Di Dwuma Di Dwuma Di Dwuma Di Dwuma Di Dwuma Di Dwuma Di Dwuma Di Asomfo Biara Drai ho Clone ."]

    CloneAll --> DisconnectOrig["Twa Original Drives & Yɛ Adwuma Katee wɔ Cloned Disks / Mfonini ahorow so"]
    DisconnectOrig --> ArrayType{"Storage Architecture Bɛn na Wɔde Di Dwuma?"}

    ArrayType -->|"Synology DSM (SHR / RAID a Wɔde Di Dwuma) ."| SynologyFlow["Hwɛ Nsɛm a esisi denam mdadm so --examine -> Force-Assemble Akenkan-Nko -> Ma LVM2 / Btrfs Akenkan-Nkoaa nyɛ adwuma"]
    ArrayType -->|"QNAP QTS (HAL LVM RAID a Ɛyɛ Teateaa / Ɛyɛ Den) ."| QnapFlow["Boaboa mdadm Akenkan-Nko -> Ma DRBD Layer no nyɛ adwuma sɛ Ɛwɔ hɔ a -> Scan Custom QNAP LVM2 Superblocks"]
    ArrayType -->|"TrueNAS / ZFS (RAIDZ1 / RAIDZ2 / Ahwehwɛ) ."| ZfsFlow["Run zpool import -d /dev/disk/by-id -> Import Akenkan-Nkutoo ne Rollback: zpool import -f -o akenkan nko ara=wɔ -F so"]
    ArrayType -->|"Linux mdadm a wɔde di dwuma wɔ ɔkwan a ɛfata so"| LinuxFlow["Fa toto Event Counters ho -> Tu mmirika mdadm --assemble --force --readonly -> Fa Faelsystem no to -o ro,noload so"]

--- .

Ɔfa 1: Nea enti a sɛ wɔhyɛ obi ma wɔsan si no a, ɛsɛe data (The URE ne Same-Batch Cascade) .¶

Sɛ wopɛ sɛ wote nea enti a sɛ wobɔ Repair / Rebuild anaasɛ wobɛsesa drive biako na woatwɛn nnɔnhwerew 36 a, ɛtaa ma total array crash ba ase a, ɛsɛ sɛ wote sɛnea parity reconstruction si magnetic media a ɛrebɔ akwakoraa ne aberewa so dua ne nea enti a consumer desktop drives gyae NAS enclosures mu no ase.

1. Nkontaabu mu nokwasɛm a ɛfa Akenkan Mfomso a Wontumi Nnya (UREs) bere a wɔresan akyekye RAID 5 anaa RAIDZ1¶

Wɔ 4-drive mu RAID 5 anaasɛ ZFS RAIDZ1 pool, data ne parity blocks ( .P) no yɛ nsensanee wɔ disk anan no nyinaa so denam Exclusive OR (XOR) akontabuo ( .D1 XOR D2 XOR D3 = P). Sɛ Drive 2 wu koraa a, array no wɔ zero a aka redundancy. Sɛ wobɛsan akyekye Drive 2 wɔ disk foforo koraa a wɔde besi ananmu so a, ɛsɛ sɛ NAS kenkan sector biako biara fi byte 0 kosi disk no awiei wɔ Drive 1, Drive 3, ne Drive 4 so bere koro mu (Reconstructed D2 = D1 XOR D3 XOR P).

Susuw nea ɛba bere a saa drive ahorow no yɛ hard drive anan a ne kɛse yɛ terabyte 12 (gigabyte 12,000) a wɔtɔ fii adwumayɛbea koro no ara mu mfe anan a atwam ni no ho hwɛ: - Sɛ wobɛsan akyekye terabyte 12 a, ɛhwehwɛ sɛ wokenkan 36 terabytes (2.88 x 1014 ankorankoro bits) kɔ so wɔ nnɔnhwerew 24 kosi 48 wɔ ɔhyew ne mfiri adesoa a ɛsen biara mu. - Mpɛn pii no, consumer hard drive ahorow no kura Unrecoverable Read Error (URE) nkyerɛkyerɛmu a ɛfa ho 1 error in 1014 bits (12.5 terabytes), na onyin a ɛkanyan onyin no nya mfomso a ɛyɛ komm a wɔde sie wɔ ɔfã bi mu (Current_Pending_Sector) wɔ disk no mmeae a awɔw wom a wɔankenkan mfe pii ni. - Bere a Drive 3 bɔ 4 kilobyte (0.004 megabyte) bad sector biako a wontumi nkenkan bere a Drive 2 da so ara yera anaasɛ wɔasan akyekye fã no,... XOR equation wɔ abien a wonnim (D2 ne D3).

2. Nea enti a desktop drives a enni mu TLER / . SCT ERC nya kicked out koraa wɔ 1 bad sector¶

Afiri a ɛde asiane kɛse ba multi-drive drops wɔ Synology, QNAP, ne Linux so ni mdadm: 1 .

+-------------------------------------------------------------------------+
| WHY A SINGLE BAD SECTOR DROPS AN ENTIRE DRIVE DURING REBUILD            |
|                                                                         |
| 1. Drive 2 is dead/rebuilding. NAS reads Sector 849,102,400 on Drive 3. |
| 2. Drive 3 hits a weak magnetic spot (Current_Pending_Sector).          |
| 3. Consumer Drive Behavior (No TLER / SCT ERC):                         |
|    - Drive 3 enters deep internal error recovery for 30 to 120 seconds, |
|      stopping all SATA responses while retrying head positioning.       |
| 4. Linux Kernel / NAS Controller Timeout (Default 7 to 30 seconds):     |
|    - Kernel sees Drive 3 unresponsive for >30s -> Issues SATA bus reset |
|    - mdadm assumes Drive 3 is COMPLETELY DEAD and kicks it from array   |
| 5. RESULT: Both Drive 2 and Drive 3 are now marked FAULTY/REMOVED.      |
|    The entire RAID 5 array crashes offline immediately.                 |
+-------------------------------------------------------------------------+

Hyɛ nea esii ankasa no nsow: Drive 3 nwu. Ɛwɔ 99.999999% afã horow a ɛwɔ apɔwmuden ne 1 anaa 2 pɛ a wontumi nkenkan 4 kilobyte sectors (8 kilobytes fi mu 12 terabytes). Nanso esiane sɛ mdadm kicked Drive 3 fi array no mu esiane 30-second command timeout nti, volume no nyinaa kyerɛ sɛ Crashed. Sɛ wo clone Drive 3 no ne ddrescue (a ɛyɛ fɛ sɛ ɛhuruw kilobytes 8 a ɛwɔ sectors bɔne no so na ɛyɛ terabyte 12 a aka no ho mfonini) na ɛhyɛ array no akenkan nkutoo no, ɛkame ayɛ sɛ wosan nya wo fael ahorow no ɔha biara mu nkyem 100.

3. Nea enti a ɛnsɛ sɛ wutu mmirika DA mdadm --create anaa klik "Initialize" so.¶

Sɛ array bi bɔ a, anansesɛm abien a ɛsɛe ade di akɔneaba wɔ Intanɛt so: - Atosɛm 1: "San yɛ array no a drive nhyehyɛe koro no ara pɛpɛɛpɛ a wode redi dwuma." mdadm --create." ."** Mpo ne --assume-clean, nnɛyi nkyerɛase ahorow a ɛfa mdadm default to soronko Data Offset values ​​a egyina kernel no so ne mdadm gyae mu (2048 sectors vs 262144 sectors). Berɛ bɛn mdadm --create kyerɛw nkyerɛase foforo 1.2 superblock wɔ offset a ɛnteɛ anaasɛ ɛne chunk size a ɛnhyia, ɛkyerɛw no so LVM2 honam fam volume header anaa ext4 superblock wɔ ɛnne no anim. - Atosɛm 2: "Twe drive a ɛtɔ so mmienu a ɛtɔeɛ nkyɛreeɛ no, san fa hyɛ mu, na klik Repair." Sɛ Drive 1 gyaee nnansa a atwam ni (enti ne data no yɛ nnafua 3 a ayɛ dedaw) na Drive 3 gyaee simma 10 a atwam ni (enti ne data no yɛ mprempren), twe na wɔsan de drive a ɛnteɛ no hyɛ mu anaasɛ wɔhyɛ ma wɔsan si a Drive 1 a wɔahyɛ no agyirae "active" ne Drive 3 a wɔahyɛ no agyirae "spare" no ma NAS no kyerɛw no boro so up-to-date array a 3-day-old stale parity stripes, asɛe directory ne fael biara a wɔasesa wɔ nnɔnhwerew 72 a atwam no mu.

--- .

Ɔfã 2: Nhwehwɛmu a wɔyɛ wɔ superblocks ne Event counters dwoodwoo wɔ Linux rescue host so¶

Sɛ wopɛ sɛ wogye Synology, QNAP, TrueNAS, anaa Linux array a asɛe no dwoodwoo a, yi member drives nyinaa (bere a woakyerɛw wɔn bay nɔma akyi) na fa bata desktop PC anaa server a ɛreyɛ adwuma Ubuntu 22.04 LTS / 24.04 LTS (wɔabɔ no mpo afi Live USB stick so).

Anamɔn 1: Fa forensic rescue toolkit no hyɛ Ubuntu mu¶

Bue terminal bi wɔ wo Ubuntu nkwagye afiri no so na fa utilities a ɛho hia no hyɛ mu:

sudo apt-get update
sudo apt-get install -y gddrescue smartmontools mdadm lvm2 btrfs-progs xfsprogs zfsutils-linux

Anamɔn 2: Map biara drive letter, serial number, ne partition nhyehyɛe¶

Kyerɛw block devices a ɛka ho nyinaa ne wɔn hardware serial numbers sɛnea ɛbɛyɛ a woremfa rescue disk ne source NAS disk nfrafra da:

lsblk -o NAME,SIZE,MODEL,SERIAL,FSTYPE,TYPE,MOUNTPOINTS

Hwɛ Synology DSM, QNAP, anaa TrueNAS draibɛ a wɔtaa de di dwuma no mpaepaemu pon no:

Anamɔn 3: Hwɛ mdadm --examine sɛ wobɛhwɛ nea enti a array no hwee ase (The Event Counter Matrix) .¶

Wɔ Synology, QNAP, anaa Linux so mdadm array, hwehwɛ RAID metadata a ɛwɔ ɔdefoɔ data mpaepaemu no so (sɛ nhwɛsoɔ no, mpaepaemu 3 wɔ so /dev/sdb3, . /dev/sdc3, . /dev/sdd3, . /dev/sde3) a wɔmfa biribiara nhyɛ mu anaasɛ wonsesa:

sudo mdadm --examine /dev/sd[b-e]3 | grep -E "Filename|Magic|Update Time|Events|Array State|Device Role"

Fa nea efi mu ba no toto drive anan no nyinaa ho:

/dev/sdb3:
    Update Time : Sat Oct 31 14:12:09 2026
         Events : 482190
   Device Role : Active device 0
   Array State : A.AA ('A' == active, '.' == missing, 'R' == replacing)

/dev/sdc3:
    Update Time : Thu Oct 29 03:44:11 2026
         Events : 479012
   Device Role : Active device 1
   Array State : AAAA ('A' == active, '.' == missing, 'R' == replacing)

/dev/sdd3:
    Update Time : Sat Oct 31 14:12:04 2026
         Events : 482188
   Device Role : Active device 2
   Array State : A.AA ('A' == active, '.' == missing, 'R' == replacing)

/dev/sde3:
    Update Time : Sat Oct 31 14:12:09 2026
         Events : 482190
   Device Role : Active device 3
   Array State : A.AA ('A' == active, '.' == missing, 'R' == replacing)

Kenkan asɛnnibea asɛm yi yiye: 1. ** /dev/sdc3 (Device Role 1) wɔ an Events count of 479012 efi nna abien a atwam ni (Oct 29) na ɛyɛ. Saa kar no dii kan gyaee, nna abien a atwam ni, na efi saa bere no, ɛnyɛ intanɛt so. 2. ** /dev/sdb3 (Role 0) ne ** ./dev/sde3 (Role 3)** wɔn baanu nyinaa wɔ Events : 482190 at 14:12:09. 3. ** /dev/sdd3 (Role 2) a Events : 482188 at 14:12:04, sekan 5 pɛ ne nsɛm a esisi 2 wɔ akyi sdb3 ne sde3. 4. Awiei: Ɛsɛ sɛ wosan hyehyɛ array no denam ** .sdb3 (Role 0), . sdd3 (Role 2), ne sde3 (Role 3)** (a ne event counters no ntam kwan yɛ ticks 2 pɛ), bere a refi hɔ sdc3 (Role 1) afiri adi koraa.

--- .

Phase 3: Cloning biara drive bit-for-bit ne GNU ddrescue¶

Ansa na wobɛtu mmirika mdadm --assemble --force anaasɛ zpool import -F, clone drive biara a wɔhwehwɛ (titiriw drive a egyaee nea etwa to esiane sectors bɔne nti, te sɛ /dev/sdd wɔ nhwɛso a ɛwɔ atifi hɔ no mu) kɔ drive hunu a ɛyɛ apɔwmuden a ne tumi yɛ pɛ anaa ɛsõ so, anaasɛ ɛkɔ raw mu .img fael a ɛwɔ storage volume kɛse bi so.

Anamɔn 1: Nea enti a ɛte saa ddrescue ne mapfile yɛ ahyɛde¶

Gyinapɛn dd aborts wɔ ɔfã bɔne a edi kan no so, anaasɛ ɛne conv=noerror,sync ɔsɛe nnɔnhwerew pii de twitwiw ne ti a wɔakenkan no wɔ track a asɛe so bere a ɔhyɛ megabytes a ɛyɛ data pa a ɛbɛn ho ma no. GNU ddrescue ɔyɛ adwuma wɔ nyansa multi-stage passes mu: 1. Pass 1 (Copying phase): Ɛyɛ disk no mmeae a ɛwɔ apɔwmuden, a ɛyɛ ntɛmntɛm nyinaa kɔpi wɔ ahoɔhare a edi ntoatoaso a edi mũ mu (150 MB/s to 250 MB/s), ntɛm ara a wuhuruw fa block biara a ɛyɛ brɛoo anaasɛ wontumi nkenkan so sɛnea ɛbɛyɛ a drive no renhyew dodo anaasɛ enwu ansa na woanya 99.99% data pa. 2. Pass 2 (Trimming phase): Ɛkenkan kɔsi block bɔne biara ano pɛpɛɛpɛ fi anim ne akyi nyinaa (reverse direction) sɛ wɔbɛtew beae a asɛe no afi hɔ akosi 4 kilobyte hardware sector no pɛpɛɛpɛ. 3. Pass 3 (Scraping phase): San sɔ sectors a asɛe no hwɛ brɛoo a ɔnsan nsiesie bɔs no a ɛho nhia.

Anamɔn 2: Tu mmirika 2-stage no ddrescue clone ahyɛde¶

Bere nyinaa kyerɛ mapfile (sdd_rescue.map). Sɛ source drive a ɛrewu no twa na ɛhia sɛ wɔde anyinam ahoɔden kyinhyia a, . ddrescue kenkan mapfile no na ɛsan fi ase wɔ baiti pɔtee a egyaee no a ɛnsan nkenkan sector biako a wɔayɛ dedaw no bio:

# Stage 1: Fast forward pass skipping bad/slow blocks immediately (-n = no-scrape)
sudo ddrescue -f -n -b 4096 /dev/sdd /dev/sdh /root/sdd_rescue.map

# Stage 2: Targeted trimming and 3-retry scrape of the skipped bad sectors
sudo ddrescue -f -d -r 3 -b 4096 /dev/sdd /dev/sdh /root/sdd_rescue.map

--- .

Ɔfã 4: Synology DSM a Wɔsan Yɛ (SHR-1 / . SHR-2 / Classic RAID), QNAP, ne Linux mdadm¶

Sɛ wo cloned drives (anaasɛ read-only loop devices) ayɛ krado na wɔayi mfitiase NAS drives no fi plug mu dwoodwoo a, di nhyiam nnidiso nnidiso pɛpɛɛpɛ a ɛnsɛe ade ma wo platform no akyi.

Nsɛm a ɛfa ho A: Linux a wɔde di dwuma daa mdadm anaasɛ Synology Classic RAID (RAID 5 / . RAID 6) .¶

1. Gyae ɔfã biara md array a ebia Ubuntu abɔ mmɔden sɛ ebefi ase:

   cat /proc/mdstat
   sudo mdadm --stop /dev/md127
   

2. Force-assemble cloned mpaapaemu no (sdb3, . sdd3, . sde3, a wɔayi nea awu akyɛ no afi mu sdc3) wɔ akenkan nkutoo mode a ɛyɛ katee:

   sudo mdadm --assemble --force --readonly --verbose /dev/md2 /dev/sdb3 /dev/sdd3 /dev/sde3
   

   Hwɛ nea ebefi mu aba: mdadm bɛbɔ amanneɛ forcing event count in /dev/sdd3(2) from 482188 up to 482190 ne mdadm: /dev/md2 has been started with 3 drives (out of 4).
3. Hwɛ sɛ array no yɛ adwuma na wɔahyɛ no agyirae (auto-read-only) anaasɛ (read-only): 1 .

   cat /proc/mdstat
   

Nsɛm a ɛfa ho B: Synology Hybrid RAID (SHR-1 ne SHR-2) ne LVM2 ne Btrfs / . ext4¶

Synology no SHR (Synology Hybrid RAID) yɛ ɔha biara mu nkyem 100 gyinapɛn Linux ** .mdadm + LVM2 (Logical Volume Manager)**: - Sɛ draibɛ a ɛwɔ SHR pool mu nyinaa kɛseɛ yɛ pɛ (sɛ nhwɛsoɔ no, terabyte draibɛ anan a ɛyɛ 8) a, Synology yɛ baako mdadm RAID 5 nkyekyɛmu (md2 wɔ partition 3 a ɛwɔ drive biara mu) na ɛde an LVM2 nne kɛse kuw ( .vg1000 anaasɛ vg1) wɔ soro md2. - Sɛ draibɛ a ɛwɔ SHR pool mu no wɔ akɛseɛ a adi afra (sɛ nhwɛsoɔ no, drabyte draibɛ mmienu ne terabyte 16 draibɛ mmienu) a, Synology yɛ mmienu a ɛsono emu biara mdadm nhyehyɛe ahorow: . md2 wɔ Nkyekyɛmu 5 (8 TB slice wɔ 4 drives nyinaa so wɔ RAID 5) ne md3 wɔ Partition 6 (nea aka no nyinaa so 8 TB slice wɔ 16 TB drive abien a ɛwɔ RAID 1 mu), afei ɛka bom md2 + md3 ayɛ no biako LVM2 Po no Kuw (vg1000).

Sɛ wobɛhyehyɛ Synology SHR volume akenkan nko ara wɔ Ubuntu so wɔ ahoɔden-aboaboa ano akyi /dev/md2 (na /dev/md3 sɛ SHR a ne kɛse afrafra a): 1. Scan ma Synology LVM2 Honam fam Nnyigyei ne Nnyigyei Akuw:

sudo pvscan
sudo vgscan
sudo lvscan

sudo vgchange -ay /dev/vg1000

sudo mkdir -p /mnt/synology_rescue
sudo mount -t ext4 -o ro,noload /dev/vg1000/lv /mnt/synology_rescue

sudo mkdir -p /mnt/synology_rescue
sudo mount -t btrfs -o ro,norecovery /dev/vg1000/lv /mnt/synology_rescue

sudo mount -t btrfs -o ro,norecovery,usebackuproot /dev/vg1000/lv /mnt/synology_rescue

Nsɛm a ɛfa ho C: Synology DSM 7+ Volume Encryption anaa Shared Folder Encryption (eCryptfs) .¶

• Folda a Wɔakyekyɛ mu Encryption (@sharename@ folda ahorow a ɛwɔ mu ECRYPTFS_FNEK_ENCRYPTED... fael din ahorow): Kɔpi ne nyinaa @encrypted_share@ folda no adum /mnt/synology_rescue kan, afei mount na decrypt no wɔ Ubuntu denam wo Synology encryption password anaa .key faale:

  sudo apt-get install -y ecryptfs-utils
  sudo mkdir -p /mnt/decrypted_share
  sudo mount -t ecryptfs -o ro /mnt/synology_rescue/@encrypted_share@ /mnt/decrypted_share
  

• DSM 7.2+ Nnyigyei a Ɛyɛ Nyinaa Encryption (LUKS): Sɛ /dev/vg1000/lv kyerɛ TYPE="crypto_LUKS" mu blkid, bue no akenkan nkutoo denam .rkey Recovery Key fael a wɔtwee bere a wɔyɛɛ volume no:

  sudo cryptsetup open --readonly --key-file /path/to/Volume1.rkey /dev/vg1000/lv synology_crypt
  sudo mount -o ro,norecovery /dev/mapper/synology_crypt /mnt/synology_rescue
  

Nsɛm a ɛfa ho D: QNAP QTS (LVM2 Thin Provisioning ne DRBD mmeamu)¶

Nnɛyi QNAP NAS akuw (QTS 4.3+ / 5.x) de emu-node biako hyɛ mu DRBD afidie (/dev/drbd1) ntam /dev/md1 ne nea LVM2 Po no Kuw (vg1). 1. Nea edi kan no, fa ahoɔden-boaboa QNAP data mpaapaemu no ano (/dev/sd[b-e]3) akenkan-nko mu /dev/md1: 1 .

sudo mdadm --assemble --force --readonly /dev/md1 /dev/sdb3 /dev/sdd3 /dev/sde3

--- .

Ɔfa 5: TrueNAS ne Linux a wɔbɛgye ZFS atare ( .RAIDZ1, . RAIDZ2, . RAIDZ3) .¶

Sɛ wo storage server no yɛ adwuma TrueNAS CORE, TrueNAS SCALE, Proxmox VE, anaa Ubuntu ZFS a, sanba no mfa nni dwuma mdadm. Mmom no, ZFS ka volume manager ne copy-on-write (CoW) fael nhyehyɛe mu ayɛ no nkitahodi nhyehyɛe biako a wɔasi atwa Uberblocks ne Adidi Akuw a ɛtoatoa so (TXGs) na ɛyɛ.

Anamɔn 1: Hwɛ ZFS vdev nkyerɛwde 4 no (L0, L1, L2, L3) wɔ disk biara a wɔayɛ no sɛnea ɛte no so¶

ZFS asɔremma mpaepaemu biara sie pool nhyehyɛe no mfonini anan a ɛyɛ pɛ ne Uberblocks 128 a etwa to no nhyehyɛe (nkyerɛwde abien wɔ mpaapaemu no anim, L0 ne L1, ne nkyerɛwde abien a ɛwɔ awiei pɛɛ, . L2 ne L3). Dwane zdb -l wɔ cloned mpaapaemu biara so de hwɛ pool tebea ne Transaction Group a wɔde wɔn ho ahyɛ mu kɛse (txg): .

sudo zdb -l /dev/sdb2 | grep -E "name:|state:|txg:|guid:" | head -n 20

Fa toto ho txg: nɔma ahorow wɔ cloned drives nyinaa so. Te sɛ nea ɛte saa ara mdadm's Events counter, sɛ disk biako gyaee simma 5 ansa na anyinam ahoɔden ayera anaasɛ disk a ɛto so abien atɔ fam a, ne txg bɛba fam kakra asen disk ahorow a aka no.

Anamɔn 2: Fa ZFS pool no ba wɔ Read-Only mode a ɛyɛ katee mu (-o readonly=on) .¶

Di kan hwɛ importable pools a wonhyɛ biribiara via sudo zpool import -d /dev/disk/by-id. Mfa ZFS pool a asɛe anaasɛ multi-disk-dropped mmra da wɔ akenkan-kyerɛw mode mu. Bere a wɔde aba amannɔne ne -o readonly=on, ZFS mmɔ mmɔden sɛ ebefi ase ayɛ resilver, ɛnkyerɛw Uberblocks foforo, na sɛ ahunmu map a asɛe a, entumi mmɔ kernel no hu (spacemap) no hyia bere a wɔrekyekyɛ akyerɛw no:

sudo mkdir -p /mnt/zfs_rescue
sudo zpool import -f -o readonly=on -R /mnt/zfs_rescue tank

Anamɔn 3: Sɛ zpool import di nkogu wɔ I/O error anaasɛ corrupted data, fa TXG Rollback di dwuma (-F ne -T) .¶

Sɛ drive abien gyaee wɔ sikɔne kakraa bi mu bere a nkyerɛwee a emu yɛ duru pae a, Transaction Group a aba foforo koraa (TXG N) betumi ayɛ nea enni mũ wɔ parity stripes a ɛda so wɔ hɔ no nyinaa so, bere a TXG N-1 anaasɛ TXG N-2 (wɔakyerɛw no sikani 5 kosi 15 a atwam) no ɔha biara mu nkyem 100 a enni dɛm wɔ Uberblock ring buffer no mu.

1. Sɔ dry-run rollback preview a ɛnyɛ ɔsɛe hwɛ (-F -n):

   sudo zpool import -f -o readonly=on -R /mnt/zfs_rescue -F -n tank
   

   Sɛ ZFS bɔ amanneɛ a Would be able to return pool to its state as of <timestamp>, tu mmirika akenkan nkutoo rollback import a enni -n: 1 .

   sudo zpool import -f -o readonly=on -R /mnt/zfs_rescue -F tank
   

2. Sɛ -F da so ara ntumi mount Uberblocks a aba foforo no, kyerɛw abakɔsɛm Uberblock TXG nɔma ahorow ne zdb na fa TXG dedaw pɔtee bi ba (-T):

   sudo zdb -e -ul /dev/sdb2 | grep -E "Uberblock|txg =|timestamp ="
   

   Paw a txg nɔma a efi sikɔne 30 kosi 60 ansa na wimhyɛn no ahwe ase (sɛ nhwɛso no, . txg = 9481020) na fa pool a wɔahyɛ no nwini wɔ saa bere pɔtee no mu no ba wɔ akenkan nkutoo tebea mu:

   sudo zpool import -f -o readonly=on -R /mnt/zfs_rescue -T 9481020 tank
   

--- .

Ɔfã 6: Nhwehwɛmu a wɔyɛ wɔ bere a wɔasan agye no akyi ne daakye a wɔbɛsan akyekye nsuo a ɛbɛba no a wɔbɛsiw ano¶

Sɛ woyɛ wo data a woasan anya no ɔha biara mu nkyem 100 fi... /mnt/synology_rescue anaasɛ /mnt/zfs_rescue wɔ independent backup target so, di hardware ne configuration checklist yi akyi ansa na wode wo NAS no asan akɔ adwuma mu:

• Ntɔ NAS drive nyinaa mfi adetɔnfo koro hɔ da koro da: Drives a efi adwumayɛbea koro no ara mu no kyɛ head batches ne firmware a ɛyɛ pɛ, na ɛma wodi nkogu wɔ nnɔnhwerew kakraa bi mu bere a wɔresan asi no. Mix batch anaa wɔn a wɔyɛ ( .Seagate IronWolf / Exos, . WD Red Plus / Ultrastar, . Toshiba N300 / MG).
• Fa NAS/Enterprise drives nkutoo di dwuma ne TLER / . SCT ERC enabled (anaasɛ ma Linux so mdadm SCSI bere a wɔde twa desktop draibɛ): Ma adetɔfo draibɛ a ɛwɔ Linux mu mdadm, fa di dwuma a udev mmara a wɔde bɛma so /sys/block/sdX/device/timeout efi 30 sikani mu de 180 sekan mu saa mdadm twɛn internal sector remapping mmom sen sɛ ɔbɛtow drive no agu.
• Migrate arrays a ɛwɔ drives a ɛsõ sen 8 TB efi RAID 5 / . SHR-1 / . RAIDZ1 to RAID 6 / . SHR-2 / . RAIDZ2: Ne 12 TB to 24 TB drive ahorow no, bere a wɔde si dan a ɛwɔ parity biako mu no boro nnɔnhwerew 30, na ɛma ɛyɛ dual-parity (RAID 6 / . SHR-2 / . RAIDZ2) a ɛho hia na ama wɔatumi atra ase wɔ ɔfã bɔne bi mu bere a wɔreyɛ resilvering no.
• Yɛ nhyehyɛe ɔsram biara Data Scrubbing (mdadm check / . zpool scrub) ne Nea Wɔatrɛw mu SMART sɔhwɛ ahorow: Ɔsram biara scrubbing siesie latent sector mfomso (Current_Pending_Sector) bere a drive ahorow nyinaa wɔ intanɛt so no.
• Kae sɛ RAID yɛ high availability, ɛnyɛ backup da: Di akyi 3-2-1 backup nhyehyɛe a ɛwɔ offline copy bi a ɛwɔ hɔ.

--- .

Mpɔtam hɔ ntɛmpɛ nɔma ne adwumakuw no nhyehyɛe ahorow¶

Nneɛma a wɔsɛe no a ɛka akwahosan ho nhyehyɛe ahorow, nkitahodi a egye ntɛmpɛ, anaa ankorankoro kyerɛwtohɔ ahorow a mmara ma ho kwan no hwehwɛ sɛ wɔma ɛyɛ kɛse ntɛm ara:

• United States ne Canada: Dial ** .911** sɛ nneɛma a wɔkora so a ɛhwe ase ma ayaresabea ayaresabea nhyehyɛe ahorow no nyɛ adwuma a (EHR / PACS) anaasɛ wɔde bɛmena. Bɔ ransomware a wɔde NAS asi wɔn ani so ho amanneɛ (DeadBolt, . LockBit, . Akira) kosi CISA ( .1-844-Say-CISA / . cisa.gov/report), FBI IC3 (ic3.gov), anaa Canada Asoɛe a Ɛhwɛ Intanɛt So Ahobammɔ So (1-833-CYBER-88) na ɛyɛ.
• Ahemman: Dial ** .999** ma ntɛmpɛ a ɛka nkwa ahobammɔ anaa NHS hwɛ a emu yɛ den. Wɔ UK GDPR ase no, hwɛ sɛ ebia ankorankoro data a wɔankora so daa a wɔhwere no hwehwɛ sɛ wɔbɔ ICO (0303 123 1113) wɔ nnɔnhwerew 72 ntam.
• Europa Aman Nkabom Kuw: Dial 112 wɔ EU nyinaa. Ɛsɛ sɛ nnwumakuo a ɛwɔ NIS2 Akwankyerɛ ase no bɔ wɔn man CSIRT amanneɛ sɛ adwumayɛ a wɔatwa mu kɛseɛ wɔ nnɔnhwereɛ aduonu nnan mu, na ankorankoro data a wɔhwere daa no kanyan GDPR Ahyɛdeɛ 33 amanneɛbɔ wɔ nnɔnhwereɛ aduɔson mmienu mu.
• Australia ne New Zealand: Dial ** .000** wɔ Australia anaa ** .111** wɔ New Zealand; bɔ infrastructure anaa ransomware NAS nsɛm a esisi ho amanneɛ kyerɛ ACSC (1300 CYBER1) anaa CERT NZ (0800 237 869) na ɛyɛ.
• India ne Asia-Pacific: Dial ** .112** wɔ India sɛ wɔbɛyɛ biribi a egye ntɛmpɛ; bɔ nsɛm a esisii wɔ infrastructure storage ho amanneɛ kyerɛ CERT-In (incident@cert-in.org.in) wɔ nnɔnhwerew 6 mfɛnsere a ɛyɛ ahyɛde no mu.

--- .

Nsɛm a wɔtaa bisa¶

Dɛn nti na wɔyɛɛ saa mdadm --assemble --force pow sɛ mede befi ase me RAID 5 array no not enough to start the array?¶

Wɔ 4-drive mu RAID 5. Ɔde ne nsa kyerɛɛ ne so array, anyɛ yiye koraa no 3 wɔ 4 mu ɛsɛ sɛ wɔde kɔ mdadm --boaboa --ahyɛdeɛ ano. Dwane sudo mdadm --hwehwɛ /dev/sd [a-z]3 mu sɛ wobɛhwɛ nea enti a wɔpow draibɛ a ɛto so abiɛsa no: anaasɛ wode disk no nyinaa twaam sen sɛ wode mpaapaemu no bɛkɔ (/dev/sdd na ɛwɔ hɔ sɛ anka /dev/sdd3 na ɛwɔ hɔ), na wɔahyɛ ne superblock no agyirae sɛ a Foforɔ denam rebuild a wɔatwa mu so, anaasɛ Ubuntu auto-assembler no too drive biako mu wɔ inactive mu /dev/md127 na ɛwɔ hɔ afiri (tu mmirika sudo mdadm --gyae --scan kan, afei san tu mmirika bio mdadm --assemble --force --akenkan nko ara).

Na sɛ drive bi fii ase san kyekyee nso ɛ (Recovery = 12%) ansa na kar a ɛto so abien no regyae?¶

Sɛ Drive 2 wu a, wode Drive 2 foforo ahyɛ mu, na wɔ 12% na ɛwɔ hɔ. rebuild progress Drive 3 no gyaee offline esiane sector bɔne bi nti, . mfa Drive 2 a wɔasan asi 12%-a wɔasan asi ananmu no nni dwuma. Mmom no, yɛ nea edi kan no ho mfonini Karka 3. Ɔde ne nsa kyerɛɛ ne so ne drescue a wɔde di dwuma. Esiane sɛ na Drive 3 no yɛ mprempren koraa kosii sɛ rebuild no gyaee wɔ 12% nti, force-assembling the array read-only using Drive 1, the drescue a wɔde di dwuma clone a ɛwɔ Drive 3, ne Drive 4 (a wogyaw Drive 2) ma wo nhyehyɛe a ɛkɔ so daa.

So metumi de me Synology anaa QNAP drives ahyɛ NAS chassis foforo koraa mu sɛ NAS power supply anaa board no wu a?¶

Yiw, abien no nyinaa Synology (HDD Tukɔ foforo) ne QNAP ( ) .NAS Tukɔ a Wɔde Tu Kɔtra Ase Tẽẽ) de RAID nhyehyɛe no sie wɔ drive ahorow no ankasa so. Mmom, sɛ na kar abien anaa nea ɛboro saa agyae dedaw a (`Volume Crashed`) ansa na chassis no rewu no, nhyɛ wɔn wɔ NAS chassis foforo mu, efisɛ migration wizard no betumi akyerɛw mpaapaemu ahorow no so anaasɛ akanyan rebuild a ɛsɛe ade. Gye data a wɔkenkan nkutoo wɔ Ubuntu so kan.

Mɛyɛ dɛn ahu sɛ drive a wɔatow agu no yɛ nea ahobammɔ wom sɛ wɔde bɛyɛ clone ddrescue versus hia a ehia sɛ wɔyɛ cleanroom lab?¶

Fa drive no bata SATA ho, sɔ no, na tie sikɔne 10 bere a worehwɛ no sudo dmesg -w. Sɛ drive no yɛ rhythmic clicking, scraping, anaa buzzing nnyigyei a, twitwa kɔ soro na ɛsan twitwiw kɔ fam, anaasɛ ɛbɔ amanneɛ sɛ tumi yɛ 0 B. / . 4.1 GB na ɛwɔ hɔ mu lsblk, akenkan/kyerɛw ti ahorow no adi nkogu wɔ honam fam: twa anyinam ahoɔden ntɛm ara na fa cleanroom lab di dwuma. Sɛ drive no twitwiw yiye a, ɛkyerɛ ne tumi nyinaa wɔ lsblk, na logs nkutoo na ɛwɔ hɔ Mprempren_Akwan_A_Ɛretwɛn anaasɛ timeout mfomso, clone no ne drescue a wɔde di dwuma.

Dɛn ne "RAID 5 Write Hole," na ɔkwan bɛn so na ɛyɛ ZFS anaasɛ Btrfs kwati bere a anyinam ahoɔden atwa?¶

Wɔ atetesɛm mu RAID 5. Ɔde ne nsa kyerɛɛ ne so / . RAID 6. Ɔde ne nsa kyerɛɛ ne so sɛ journal nni hɔ a, stripe a wobɛma ayɛ foforo no hwehwɛ sɛ wokyerɛw data block ne parity block no kɔ disk abien so bere koro mu. Sɛ tumi di nkogu wɔ mid-write mu a, data ne parity nhyia bio (the Kyerɛw Tokuru). ZFS na ɔkyerɛwee (`RAIDZ`) ne Btrfs a wɔde yɛ adwuma yi kyerɛw tokuru no fi hɔ denam Copy-on-Write ( ) so.`CoW`), kyerɛw stripe foforo biara kɔ blocks a wɔmfa nni dwuma mu na wɔyɛ Uberblock/root pointer no foforo bere a stripe mũ no nyinaa wɔ disk so akyi nkutoo.

So metumi de adi dwuma dmsetup overlays a wɔde bɛsɔ RAID parameters ahwɛ a wonsesa cloned drives no?¶

Yiw, wubetumi ayɛ Copy-on-Write (`CoW`) nkataso a ɛwɔ loop mfiri a wɔkenkan nkutoo so (`losetup --read-only`) a wɔde Linux di dwuma dmsetup a wɔde ahyɛ mu (`snapshot` target) a wɔde fael ahorow a ɛnyɛ den ahyɛ akyi wɔ /tmp. Obiara kyerɛw fi mdadm --boaboa --ahyɛdeɛ ano anaasɛ fsck -y kɔ nea wɔde tow gu mu /tmp overlay file, ma wo reset wɔ sekan 1 mu sɛ ɛho hia a.

--- .

Akwankyerɛ ahorow a ɛfa ho¶

• NAS RAID array asɛe, draibɛ pii adi nkogu, ne ZFS/Btrfs sanba
• RAID controller card wu, amannɔne nhyehyɛe import, ne nea enti a ɛnsɛ sɛ wohyɛ disk ahorow ase da
• Hard drive a entumi nyɛ adwuma yiye ne data a wɔsan nya
• SSD ne NVMe mpofirim akenkan nkutoo mode, 0% spare blocks, ne TRIM a ɛma nkwagye yɛ adwuma
• Akwanhyia rm -rf anaa Shift+Delete wɔ Linux, macOS, anaa Windows: ntɛm ara akenkan nkutoo remount
• Kɔmputa so backups, 3-2-1 nhyehyɛe, ne atoyerɛnkyɛm bere mu ahotɔ
• Nnɔmba a egye ntɛmpɛ sɛnea ɔman biara te

--- .

Fibea ne aban akwankyerɛ¶

• Linux Ntuo Wiki (raid.wiki.kernel.org) & Linux Kernel Ahyehyɛde no: Wɔresan anya Software RAID a adi nkogu (mdadm --assemble --force --readonly ne Event Counter a Ɛnhyia).
• Software Fapem a Wɔde Ma Free (GNU Project): GNU na ɛyɛ ddrescue Nhoma: Forensic Data a Wɔsan Nya fi Media a Ɛdi huammɔ.
• OpenZFS Nwoma (openzfs.github.io): ZFS Pool Import a Wɔsan Yɛ (zpool import -F, Nneɛma a Wɔde Ba amannɔne a Wɔkenkan Nkutoo, ne zdb Nhwehwɛmu).
• Synology Inc.: Synology Nimdeɛ Asoɛe: Mɛyɛ dɛn de PC adi dwuma de asan anya data bere a me Synology NAS no ntumi nyɛ adwuma yiye (mdadm + LVM2 Nneɛma a wɔde si so).
• Ɔman Asoɛe a Ɛhwɛ Gyinapɛn ne Mfiridwuma So (NIST) (United States): Nwoma Titiriw 800-209: Ahobanbɔ Akwankyerɛ a ɛfa Nneɛma a Wɔkora So ho.