A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem? Thanx!!
Hi Jd,
Did you checked the older version? Downgrade perhaps to avoid bogus version?
Z
2016-10-28 5:22 GMT+02:00 jd1008 jd1008@gmail.com:
A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem? Thanx!! _______________________________________________ users mailing list -- users@lists.fedoraproject.org To unsubscribe send an email to users-leave@lists.fedoraproject.org
On 10/28/2016 03:57 AM, Zoltan Hoppar wrote:
Hi Jd,
Did you checked the older version? Downgrade perhaps to avoid bogus version?
Youtube (like most streaming services) take a VOD (video on demand) asset file and breaks it into fragments based on either a time period or fragment size. Ordinarily, your player code downloads a fragment and plays it. While it's playing, the next fragment in sequence is downloaded in the background and played when the first completes and this cycle is completed. Technically this is called "progressive download". When you see a video "buffering" or whatever, that's caused by a delay in getting those fragments to you and you're seeing the player waiting for them to appear.
What you're doing with the utility is downloading those individual fragments rather than playing them in sequence. You can use a tool like ffmpeg to concatenate those fragments back into a single asset file by doing something like:
$ cd /directory/where/you/downloaded/to $ ls -1 *.part-Frag* | \ awk '{print "file \x27"$1"\x27"}' >/tmp/chnklst.txt $ ffmpeg -f concat -i /tmp/chklst.txt -copyinkf -c:v copy \ -copyts -c:a libfdk_aac -avoid_negative_ts 1 \ -movflags faststart -f mp4 /output/directory/filename.mp4
That would concatenate all the chunks into a single file called /output/directory/filename.mp4 (the options I'm using utilize the same video encoder that was used on the original and converts the audio to AAC, see the ffmpeg documentation for the gory details). Yes, it's convoluted but that's what you do to reassemble the chunks.
YMMV
2016-10-28 5:22 GMT+02:00 jd1008 jd1008@gmail.com:
A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem? Thanx!! _______________________________________________ users mailing list -- users@lists.fedoraproject.org To unsubscribe send an email to users-leave@lists.fedoraproject.org
2016-10-28 5:22 GMT+02:00 jd1008 jd1008@gmail.com:
A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem?
You could try to cat the fragments together into a new file. Whether this works depends on whether youtube puts some glue on the end for their browser video player.
I think the issue is that web video servers like youtube have begun to serve videos in small chunks. My theory is that this is a response to mobile processing. If someone is streaming and moving between access points, if the whole file is being sent, it's lost. If a small chunk, just the small chunk is lost. And, it keeps resource usage minimal (memory and disk).
I notice that the firefox downloaders (ant, dlhelper) have adjusted to this. They download the video chunks, and then knit them together and write them at completion. No longer are there any partial files. It's all or nothing.
On 10/28/2016 11:13 AM, stan wrote:
2016-10-28 5:22 GMT+02:00 jd1008 jd1008@gmail.com:
A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem?
You could try to cat the fragments together into a new file. Whether this works depends on whether youtube puts some glue on the end for their browser video player.
I think the issue is that web video servers like youtube have begun to serve videos in small chunks. My theory is that this is a response to mobile processing. If someone is streaming and moving between access points, if the whole file is being sent, it's lost. If a small chunk, just the small chunk is lost. And, it keeps resource usage minimal (memory and disk).
I notice that the firefox downloaders (ant, dlhelper) have adjusted to this. They download the video chunks, and then knit them together and write them at completion. No longer are there any partial files. It's all or nothing.
Yes. And it increases the download time by many factors.
On 10/28/2016 04:57 AM, Zoltan Hoppar wrote:
Hi Jd,
Did you checked the older version? Downgrade perhaps to avoid bogus version?
Z
2016-10-28 5:22 GMT+02:00 jd1008 jd1008@gmail.com:
A new strange behavior of this util. When downloading a format of the file that is pure video (i.e. no audio) I end up with tens of small files each one labeled by the name of the listed movie appended with .part-FragN where N ranges from 0 to more than 200 sometimes. I updated youtube-dl by running youtube-dl -U and retried. It does the same thing. After it finished getting all the fragments, it does not catenate them into a single video file. How can I get around this problem? Thanx!! _______________________________________________
This behavior started for me only a few days ago, an I had not updated it when it was working "just right"; i.e. no fragments; and then I was surprised/bummed by the fragmented behavior. It has already been explained that youtube is doing this.
-
JD -
Rick Stevens -
stan -
Zoltan Hoppar