003-04 Data Deduplication

Pre-requisites
- Windows Server 2016 Datacenter
- Source Volume on non-OS disk - on source & dest. server
- Source Log - on source & dest. server
- for synchronous replication - Low Latency <5 ms
- install File Server & Storage replica roles on each server

invoke-command -scriptBlock {
install-windowsFeature -Name storage-Replica,FS-Fileserver -includeManagementTools -Restart
} -computerName serverl,server2

New-SRPartnership -sourceComputerName serverl
-SourceRGName RGl `
-SourceVolumeName d: `
-SourceLogVolumeName e: `
-DestinationComputerName server2 `
-DestinationRGName RG2 `
-DestinationVolumeName d: `
-DestinationLogVolumeName e: `

Get-SRGroup
Get-SRPartnership

set-SRPartnership -NewSourceComputerName server2 `
-SourceRGName RG2 `
-DestinationComputerName serverl `
-DestinationRGName RGl

Get-SRPartnership | Remove-SRPartnership
Get-SRGroup | Remove-SRGroup

Overview of Data Deduplication
- Finds and removes duplications
- Segments data into small chunks
- Replaces redundant chunks of data with a reference
- Compresses chunks of data

Features
- Supports volume sizes up to 64 TB
- Support file sizes up to 1 TB
- Removes duplications without compromising data integrity
- Support for optimized volume backups

Use cases for deduplication
- General file shares
- User documents
- Virtual hard disks
- Backup volumes
- Software deployment shares

Managing Backups with Data Deduplication
- Block-based backups should maintain optimization on the backup media
- File-based backups - Backup target must be large enough to hold the entire dataset

Setting up Server to Server Storage Replication

Data Deduplication Jobs

There is another job called un-optimisation which effectively disables de-duplication. Make sure you have enough disk space. Can be done at any time.

Get-windowsFeature *dedup*
Instal1-windowsFeature FS-Data-Deduplication -IncludeAl1SubFeatude -IncludeManagementTools
Get-Volume d
Enable-DedupVolume -Volume d: -UsageType Default
Set-DedupVolume -Volume d: -MinimumFileAgeDays 0
Start-DedupJob -Volume d: -Type Optimization -Memory 50
Get-DedupJob
Get-Volume d
Get-Command -noun DedupSchedule
Get-Command -Module Deduplication
Update-Dedupstatus
Expand-DedupFile

Task Scheduler > Library > Microsoft > Windows > Deduplication

Managing Backups with Data Deduplication
1. Block-based backups: Should maintain optimization on the backup media
2. File-based backups: Backup target must be large enough to hold the entire dataset

.

Main Menu

Search