Automation | Integration | Solutions
AWS Data Upload Automation
About
This solution is an example of ETL automation where data from an AWS storage location is downloaded, parsed, then uploaded into an Azure database. The process is orchestrated by an Azure Logic App with an Azure Function performing the data transformation and load.
Business Requirement
The City of Gold Coast utilise a third-party to collect data for their Flora and Fauna website (https://florafauna.goldcoast.qld.gov.au). The vendor’s stores this data in an AWS storage account however the City’s website is hosted in Azure.
An automated daily download in required from this AWS storage, then new information uploaded into the website’s Azure database.
Key Components
- Azure Logic Apps
- Azure Functions
- Azure Storage Account
- Azure SQL Managed Database
CLOUD PARTNERS TECHNOLOGY
Want to know more?