I think it's been using azcopy for a fair while now. Azcopy has improved dramatically over the last few years to have more switches and options. I recently used it to bulk copy a container in one storage account to another, then bulk upload all files with certain extensions (which wasn't originally possible). In each case it was harder than refining fissionable uranium, so I pasted the skeletons of the working commands into my "bag of tricks" text file. The Blazor bulk upload is mercifully on hold while they reconsider who should have the facility -- Greg K

On Wed, 3 Jan 2024 at 16:27, Dr Greg Low via ozdotnet <ozdotnet@ozdotnet.com> wrote:

I notice that the Azure Storage Explorer desktop app nowadays defaults to using azcopy under the covers to copy files. That’s a much better option for files of any size. Probably need a component that does that but azcopy has a few dependencies.

 

It’s on GitHub as open source so you could probably check out how it does what it does. It’s sure fast and filesize isn’t an issue. I’ve used azcopy on multi-terabyte files without issue. (Apart from the hosting provider for the site calling to find out what was going on, given the way it worked in parallel and flooded their network)

 

Regards,

 

Greg

 

Dr Greg Low

 

1300SQLSQL (1300 775 775) office | +61 419201410 mobile

SQL Down Under | Web: https://sqldownunder.com | About Greg:  https://about.me/greg.low

 

From: DotNet Dude via ozdotnet <ozdotnet@ozdotnet.com>
Sent: Wednesday, January 3, 2024 4:17 PM
To: ozDotNet <ozdotnet@ozdotnet.com>
Cc: DotNet Dude <adotnetdude@gmail.com>
Subject: Re: Web app large uploads and downloads

 

Yep we usually do this sort of thing with a batch process, particularly if there are large files. I don’t see any web app being used just to upload a bunch of files.

 

For fun try asking ChatGPT or one of the others to see where they go.

 

On Wed, 3 Jan 2024 at 11:13, Greg Keogh via ozdotnet <ozdotnet@ozdotnet.com> wrote:

Folks (welcome to the distant future of 2024)

 

I'm pretty sure that there is no sensible way to provide a bulk Azure Blob upload facility in a web hosted app (Wasm, JS or whatever). There could be thousands of files with a total size up to hundreds of MB. Managers are currently using a WPF program I created for uploads and it feels like a perfectly natural process on the desktop, and it's pretty fast using streams on multi cores (I also optionally check for new or changed so only diffs are uploaded which often saves a lot of time).

 

None of the components or controls I've seen are designed for huge uploads, and in any case, I've reported that it's technically and usability questionable to have "normal" users of the browser app doing this sort of thing. The boss of the app suite is now considering the bigger picture and the bulk upload feature may be delayed or moved to somewhere else in the flow, or the desktop program will suffice. So I'm happy the issue is on-hold for now.

 

I think this is a good example of how the web browser should never have evolved into a host for business apps. I think the web browser, HTML, HTTP, REST, css and JS have diseased 21st century IT.

 

Greg K

--
ozdotnet mailing list
To manage your subscription, access archives: https://codify.mailman3.com/

--
ozdotnet mailing list
To manage your subscription, access archives: https://codify.mailman3.com/