The codacy warnings are just silly.

The codacy warnings are just silly.

You can turn that one off via Code patterns -> Flawfinder.

I can? I can't find anywhere to do that!

After "Login with GitHub", "Code patterns" appears at the menu on the left.

I would just use --parallel and nix the short option, this seems like use will be almost always in scripts. I don't see anyone at the command line running curl -Z <fifty urls>.

confusing:
ckmopsuvwxz
CKMOPSUVWXZ

I had one unreproducible hang while I was playing around with this, I'm not sure what caused it but during the investigation I found an off-by-one bug so I'm going to attribute it to that unless it happens again.

> curld --parallel -o first http://mirrors.rit.edu/ubuntu-releases/16.04/ubuntu-16.04.2-server-amd64.template
DL% UL%  Dled  Uled  Xfers  Live   Qd Total     Current  Left    Speed
--  --      0     0     1     1     0 --:--:-- --:--:-- --:--:-- -9223

That resource no longer exists, so I expect the tool to terminate almost immediately. The first time it didn't but every time after that it did (regardless of the fix).

thanks for the fixes @jay!

I saw your YouTube video.. you can do a ETA if you request the file size of all urls first

No, I can't.

Primarily, lots of transfers libcurl can do simply do not know the size before-hand no matter what we do.
Secondly, for those that do, if we are to make 10,000 transfers it is not feasible to "get the size" of those 10K first before any transfers start. Partly because how libcurl works and partly because how those protocols work.

I've now moved a few of the remaining action items to get them done after the first merge, so that we can do the development of those things more parallel and with cooperation. As long as the non-parallel use cases still work exactly like before and are stable it shouldn't be a problem to proceed like this.

My --write-outs are being overwritten by the progress meter. Simple example:

> curld --parallel --write-out "test %{http_code}" -o foo http://httpbin.org/get

DL% UL%  Dled  Uled  Xfers  Live   Qd Total     Current  Left    Speed
--  --    204     0     1     0     0 --:--:-- --:--:-- --:--:--  3290

In parallel_transfers after a transfer finishes post_transfer is called for that transfer, which does the write-out. However after that progress meter is called again which overwrites the line.

"DL% UL%  Dled  Uled  Xfers  Live   Qd Total     Current  Left    Speed\n"
"test 200"  <---  result = post_transfer(global, share, ended, result, &retry); 
"\r--  --    204     0     1     0     0 --:--:-- --:--:-- --:--:--  3290\n"  <---  (void)progress_meter(global, &start, TRUE); 

Any suggestion on what to do with --write-out in a parallel scenario?

Any suggestion on what to do with --write-out in a parallel scenario?

I'm not sure. Delay until finished?

I suppose it goes into the whole "how to show what happened for each transfer" discussion too. If you do 20 transfers, how are those --write-out going to make sense at the end...

I suppose it goes into the whole "how to show what happened for each transfer" discussion too. If you do 20 transfers, how are those --write-out going to make sense at the end...

If they're done in the order they were given they could make some sense. Or there could be a transfer id like "%{transfer_id}"

I intend to merge this within shortly.

This broke the autobuilds. Unfortunately, it's not easy to see why in this huge diff:
https://curl.haxx.se/dev/log.cgi?id=20190722042000-16028#prob1

src/tool_operate.c:2290:11: error: implicit declaration of function 'easysrc_cleanup'; did you mean 'glob_cleanup'? [-Werror=implicit-function-declaration]

This broke the autobuilds.

#4142