This is a cloud-native file processing system built with :
- ASP.NET Core Web API
- Azure Blob Storage
- Azure Functions
- Azure SQL Database
It enables users to upload a CSV file via an API, automatically triggers processing through an Azure Function, saves the data into a SQL database, and sends a confirmation email. API is deployed in Azure App Service
- Upload CSV file with API
- Stored uploaded file in Blob storage container
- Trigger azure function the moment file is uploaded to blob
- Parse CSV & store the CSV data in Azuew SQL table
- Send email after the processing
[API: Upload csv file] -> [Azure Blob storage] -> [Blob trigger function] -> [Parse CSV and Insert data into SQL] -> [Send email after processing using send grid]
- Azure App Service (Deployed API)
- Azure Blob Storage
- Azure Function APP
- Azure SQL Database
- Use local.settings.json for Azure Function
- Use appsettins.json for Web API
--It is object storage solution for the cloud, which is optimized for stroing massive amounts of unstructured data. Unstructured data is data that doesn't adhere to a particular data model or definition, such as text or binary data.
- The storage account
- Container in the storage account
- A blob in a container
- A storage account provides a unique namespace in Azure for your data. Every object that you store in Azure Storage has an address that includes your unique account name. The combination of the account name and the Blob Storage endpoint forms the base address for the objects in your storage account.
- A container organizes a set of blobs, similar to a directory in a file system. A storage account can include an unlimited number of containers, and a container can store an unlimited number of blobs.