Azure Storage: Files
Author: Ronald Fung
Creation Date: 2 June 2023
Next Modified Date: 2 June 2024
A. Introduction
Azure Files offers fully managed file shares in the cloud that are accessible via the industry standard Server Message Block (SMB) protocol, Network File System (NFS) protocol, and Azure Files REST API. Azure file shares can be mounted concurrently by cloud or on-premises deployments. SMB Azure file shares are accessible from Windows, Linux, and macOS clients. NFS Azure file shares are accessible from Linux clients. Additionally, SMB Azure file shares can be cached on Windows servers with Azure File Sync for fast access near where the data is being used.
Here are some videos on common use cases for Azure Files:
To get started using Azure Files, see Quickstart: Create and use an Azure file share.
Why Azure Files is useful
Azure file shares can be used to:
Replace or supplement on-premises file servers:
Azure Files can be used to replace or supplement traditional on-premises file servers or network-attached storage (NAS) devices. Popular operating systems such as Windows, macOS, and Linux can directly mount Azure file shares wherever they are in the world. SMB Azure file shares can also be replicated with Azure File Sync to Windows servers, either on-premises or in the cloud, for performance and distributed caching of the data. With Azure Files AD Authentication, SMB Azure file shares can work with Active Directory Domain Services (AD DS) hosted on-premises for access control.“Lift and shift” applications:
Azure Files makes it easy to “lift and shift” applications to the cloud that expect a file share to store file application or user data. Azure Files enables both the “classic” lift and shift scenario, where both the application and its data are moved to Azure, and the “hybrid” lift and shift scenario, where the application data is moved to Azure Files, and the application continues to run on-premises.Simplify cloud development:
Azure Files can also be used to simplify new cloud development projects. For example:Shared application settings:
A common pattern for distributed applications is to have configuration files in a centralized location where they can be accessed from many application instances. Application instances can load their configuration through the Azure Files REST API, and humans can access them by mounting the share locally.Diagnostic share:
An Azure file share is a convenient place for cloud applications to write their logs, metrics, and crash dumps. Logs can be written by the application instances via the File REST API, and developers can access them by mounting the file share on their local machine. This enables great flexibility, as developers can embrace cloud development without having to abandon any existing tooling they know and love.Dev/Test/Debug:
When developers or administrators are working on VMs in the cloud, they often need a set of tools or utilities. Copying such utilities and tools to each VM can be a time consuming exercise. By mounting an Azure file share locally on the VMs, a developer and administrator can quickly access their tools and utilities, no copying required.
Containerization:
Azure file shares can be used as persistent volumes for stateful containers. Containers deliver “build once, run anywhere” capabilities that enable developers to accelerate innovation. For the containers that access raw data at every start, a shared file system is required to allow these containers to access the file system no matter which instance they run on.
Key benefits
Easy to use. When an Azure file share is mounted on your computer, you don’t need to do anything special to access the data: just navigate to the path where the file share is mounted and open/modify a file.
Shared access. Azure file shares support the industry standard SMB and NFS protocols, meaning you can seamlessly replace your on-premises file shares with Azure file shares without worrying about application compatibility. Being able to share a file system across multiple machines, applications, and application instances is a significant advantage for applications that need shareability.
Fully managed. Azure file shares can be created without the need to manage hardware or an OS. This means you don’t have to deal with patching the server OS with critical security upgrades or replacing faulty hard disks.
Scripting and tooling. PowerShell cmdlets and Azure CLI can be used to create, mount, and manage Azure file shares as part of the administration of Azure applications. You can create and manage Azure file shares using Azure portal and Azure Storage Explorer.
Resiliency. Azure Files has been built from the ground up to be always available. Replacing on-premises file shares with Azure Files means you no longer have to wake up to deal with local power outages or network issues.
Familiar programmability. Applications running in Azure can access data in the share via file system I/O APIs. Developers can therefore leverage their existing code and skills to migrate existing applications. In addition to System IO APIs, you can use Azure Storage Client Libraries or the Azure Files REST API.
B. How is it used at Seagen
As a biopharma research company using Microsoft Azure, you can use Azure File Storage to store and manage unstructured data in the cloud. Here are some ways you can use Azure File Storage:
Data storage: Azure File Storage can be used to store unstructured data related to your biopharma research efforts, such as documents, images, and other files.
Data sharing: Azure File Storage allows you to securely share data with other researchers and stakeholders, helping to facilitate collaboration and knowledge sharing.
Data backup and recovery: Azure File Storage can be used for data backup and recovery, providing a reliable and scalable solution for protecting your research data.
Data archiving: Azure File Storage allows you to archive data that is no longer actively used, helping to reduce storage costs and improve data management.
Security: Azure File Storage provides advanced security features, helping to protect the privacy and security of your research data.
Scalability: Azure File Storage is highly scalable, allowing you to easily scale up or down as your data needs change.
Performance: Azure File Storage provides high performance data processing capabilities, allowing you to quickly and efficiently store and retrieve your research data.
Integration: Azure File Storage can be integrated with other Azure services, allowing you to move data between systems and perform data integration tasks.
Cost-effectiveness: Azure File Storage provides a cost-effective solution for storing and managing unstructured data, allowing you to pay only for the resources you use.
Overall, by leveraging Azure File Storage, you can effectively store and manage your unstructured research data in the cloud, and collaborate with other researchers and stakeholders to achieve your biopharma research goals. By using Azure File Storage for data storage, data sharing, data backup and recovery, data archiving, security, scalability, performance, integration, and cost-effectiveness, you can effectively manage your research data and make data-driven decisions that support your biopharma research efforts.
C. Features
Azure File Storage is a cloud-based storage service that provides scalable and cost-effective solutions for storing and managing unstructured data. Here are some of the key features of Azure File Storage:
Data storage: Azure File Storage provides a scalable and cost-effective solution for storing unstructured data related to your biopharma research efforts, such as documents, images, and other files.
Data sharing: Azure File Storage allows you to securely share data with other researchers and stakeholders, helping to facilitate collaboration and knowledge sharing.
Data backup and recovery: Azure File Storage can be used for data backup and recovery, providing a reliable and scalable solution for protecting your research data.
Data archiving: Azure File Storage allows you to archive data that is no longer actively used, helping to reduce storage costs and improve data management.
Security: Azure File Storage provides advanced security features, helping to protect the privacy and security of your research data.
Scalability: Azure File Storage is highly scalable, allowing you to easily scale up or down as your data needs change.
Performance: Azure File Storage provides high performance data processing capabilities, allowing you to quickly and efficiently store and retrieve your research data.
Integration: Azure File Storage can be integrated with other Azure services, allowing you to move data between systems and perform data integration tasks.
Durability: Azure File Storage provides high durability, ensuring that your research data is always available and protected.
Availability: Azure File Storage provides high availability and disaster recovery capabilities, ensuring that your research data is always accessible and protected.
Cost-effectiveness: Azure File Storage provides a cost-effective solution for storing and managing unstructured data, allowing you to pay only for the resources you use.
Overall, by leveraging Azure File Storage, you can effectively store and manage your unstructured research data in the cloud, and collaborate with other researchers and stakeholders to achieve your biopharma research goals. By using Azure File Storage for data storage, data sharing, data backup and recovery, data archiving, security, scalability, performance, integration, durability, availability, and cost-effectiveness, you can effectively manage your research data and make data-driven decisions that support your biopharma research efforts.
D. Where Implemented
E. How it is tested
Testing Azure File Storage involves verifying that the service is properly configured and that it is effectively storing and managing your biopharma research data in the cloud. Here are some steps you can take to test Azure File Storage:
Verify configuration: Verify that Azure File Storage is properly configured and integrated with your Azure account and applications and websites.
Test data storage: Test Azure File Storage by storing and managing unstructured data related to your biopharma research efforts, ensuring that the service is effectively storing and managing your research data.
Test data sharing: Test Azure File Storage by securely sharing data with other researchers and stakeholders, helping to facilitate collaboration and knowledge sharing.
Test data backup and recovery: Test Azure File Storage by using it for data backup and recovery, ensuring that the service provides a reliable and scalable solution for protecting your research data.
Test data archiving: Test Azure File Storage by archiving data that is no longer actively used, ensuring that the service is effectively reducing storage costs and improving data management.
Test security: Test Azure File Storage by verifying that the service provides advanced security features, helping to protect the privacy and security of your research data.
Test scalability: Test Azure File Storage by verifying that the service is highly scalable, allowing you to easily scale up or down as your data needs change.
Test durability: Test Azure File Storage by verifying that the service provides high durability, ensuring that your research data is always available and protected.
Test availability: Test Azure File Storage by verifying that the service provides high availability and disaster recovery capabilities, ensuring that your research data is always accessible and protected.
Test performance: Test Azure File Storage by verifying that the service provides high performance data processing capabilities, allowing you to quickly and efficiently store and retrieve your research data.
Test cost-effectiveness: Test Azure File Storage by verifying that the service provides a cost-effective solution for storing and managing unstructured data, allowing you to pay only for the resources you use.
Overall, testing Azure File Storage involves verifying that the service is effectively storing and managing your research data in the cloud, and providing powerful data storage, data sharing, data backup and recovery, data archiving, security, scalability, durability, availability, performance, and cost-effectiveness capabilities. By taking these steps, you can ensure that you are effectively using Azure File Storage to manage your research data and make data-driven decisions that support your biopharma research efforts.
F. 2023 Roadmap
????
G. 2024 Roadmap
????
H. Known Issues
As with any software or service, there may be known issues or limitations with Azure File Storage that users should be aware of. Here are some of the known issues with Azure File Storage:
Cost: Azure File Storage can be expensive, particularly for organizations that require a high level of storage capacity or that require frequent data access.
Complexity: Azure File Storage can be complex to configure and use, particularly for organizations with limited experience in cloud-based storage and data management.
Integration: While Azure File Storage can be integrated with other Azure services, there may be compatibility issues that need to be addressed.
Reliability: Azure File Storage may experience occasional outages or service disruptions, which can impact the storage and management of your research data.
Performance: Azure File Storage may experience performance issues when working with large datasets or complex data management workflows.
Security: While Azure File Storage provides advanced security features, there may be security risks associated with storing and managing research data in the cloud.
Scalability: While Azure File Storage is highly scalable, there may be limitations to how quickly and easily you can scale up or down to meet changing data needs.
Durability: While Azure File Storage provides high durability, there may be rare cases where data loss or corruption occurs.
Overall, while Azure File Storage offers a powerful tool for storing and managing unstructured research data in the cloud, users must be aware of these known issues and take steps to mitigate their impact. This may include carefully managing costs to ensure that they stay within their budget, carefully configuring the service to meet the specific needs of their data management workflows, and carefully monitoring data storage and management activity to ensure that the service is effectively storing and managing research data. By taking these steps, users can ensure that they are effectively using Azure File Storage to manage their research data and make data-driven decisions that support their biopharma research efforts.
[x] Reviewed by Enterprise Architecture
[x] Reviewed by Application Development
[x] Reviewed by Data Architecture