![]() ![]() Storage accounts with a hierarchical namespace enabled for use with Azure Data Lake Storage Gen2 are also supported. To restore a deleted blob when its parent container has not been deleted, you must use blob soft delete or blob versioning. However, you can only use container soft delete to restore blobs if the container itself was deleted. When you restore a container, the container’s blobs and any blob versions and snapshots are also restored. During the retention period, you can recover a deleted container by calling the Restore Container operation. When you enable container soft delete, you can specify a retention period for deleted containers that is between 1 and 365 days. After the retention period has expired, the container and its contents are permanently deleted. During the retention period, you can restore a soft-deleted container and its contents to the container’s state at the time it was deleted. More info from the Azure Docs: Container soft delete protects your data from being accidentally deleted by maintaining the deleted data in the system for a specified period of time. To learn how to enable container soft delete, see Enable and manage soft delete for containers. This will help as a ‘first layer of defense’ to protect the Data Lake. The first aspect of this strategy will be to enable the soft delete for container feature of the Azure Storage Account of our Data Lake (if not already enabled). This strategy considers that all resources are secured with Azure Virtual Network and are connected via Private Endpoints, driving the solution design of this strategy.ĭetailed implementation description Soft delete for containers.To increase the availability guarantees of the Data Lake, it is possible to have the secondary Storage Account for backups in a different region (e.g.Please see the Supplemental Terms of Use for Microsoft Azure Previews for legal terms that apply to Azure features that are in beta, preview, or otherwise not yet released into general availability. To enroll in this public preview, please see the link to a form on the Soft delete for blobs page in the Microsoft Docs. The Data Lake has the hierarchical namespace feature enabled. Soft delete for blobs in accounts that have the hierarchical namespace feature enabled is currently in public preview.The other environments (dev/test/acc) will not implement the self-built automated process of copying (a part of) the Data Lake data to a secondary location, to lower costs. The strategy implements all measures on the production Data Lake.Storage Account access tiers (hot/cool/archive).Backup ‘vault’ to store subsets of the Data Lake indefinitely.Self-built automated backup process (copying a part of the Data Lake data to a secondary location).The Data Lake Backup Strategy uses a combination of techniques and features to get the best functionality and performance for an acceptable cost: That is why we need to take additional measures, described in this Data Lake Backup Strategy. This redundancy however does not mean the Data Lake is protected against data failures like corruption or accidental deletion. This redundancy ensures that your storage account meets its availability and durability targets even in the face of such failures. The Data Lake uses Azure Storage, which stores multiple copies of the data so that it is protected from planned and unplanned events, including transient hardware failures, network or power outages, and massive natural disasters. ![]() How about the High Availability features? It uses native Azure services, no additional tools, software, or licenses are required. This strategy works for Data Lake as well as Data Lakehouse implementations. In this blog post, I provide a backup strategy on how to further protect your data from accidental deletions, data corruption, or any other data failures. This ensures durability and high availability. Therefore, the data in your Data Lake(house) is resilient to transient hardware failures within a datacenter through automated replicas. Out of the box, Azure Data Lake Storage Gen2 provides redundant storage. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |