Configuring how AWS DataSync verifies data integrity (original) (raw)
Data verification optionsConfiguring data verification
During a transfer, AWS DataSync uses checksum verification to verify the integrity of the data that you copy between locations. You also can configure DataSync to perform additional verification at the end of your transfer.
Data verification options
Use the following information to help you decide if and how you want DataSync to perform these additional checks.
| Console option | API option | Description |
|---|---|---|
| Verify only transferred data (recommended) | VerifyMode set toONLY_FILES_TRANSFERRED | DataSync calculates the checksum of transferred data (including metadata) at the source location. At the end of your transfer, DataSync compares this checksum to the checksum calculated on that same data at the destination. We recommend this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers. |
| Verify all data | VerifyMode set toPOINT_IN_TIME_CONSISTENT | At the end of your transfer, DataSync checks the entire source and destination to verify that both locations are fully synchronized. NoteNot supported when your task uses Enhanced mode. If you use a manifest, DataSync only scans and verifies what's listed in the manifest. You can't use this option when transferring to S3 Glacier Flexible Retrieval or S3 Glacier Deep Archive storage classes. For more information, see Storage class considerations with Amazon S3 transfers. |
| Don't verify data after transfer | VerifyMode set toNONE | DataSync performs data integrity checks only during your transfer. Unlike other options, there's no additional verification at the end of your transfer. |
Configuring data verification
You can configure data verification options when creating a task, updating a task, or starting a task execution.
The following instructions describe how to configure data verification options when creating a task.
To configure data verification by using the console
- Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.
- In the left navigation pane, expand Data transfer, then choose Tasks, and then choose Create task.
- Configure your task's source and destination locations.
For more information, see Where can I transfer my data with AWS DataSync? - For Verification, choose one of the following:
- Verify only transferred data (recommended)
- Verify all data
- Don't verify data after transfer
You can configure how DataSync verifies data by using the VerifyMode parameter with any of the following operations:
Configuring how to handle files, objects, and metadata
Setting bandwidth limits
Did this page help you? - Yes
Thanks for letting us know we're doing a good job!
If you've got a moment, please tell us what we did right so we can do more of it.
Did this page help you? - No
Thanks for letting us know this page needs work. We're sorry we let you down.
If you've got a moment, please tell us how we can make the documentation better.