Clive being blocked by youtube???

Tim ignored_mailbox at yahoo.com.au
Tue Nov 6 17:35:44 UTC 2012


Tim:
> > Try adding a www.youtube.com referrer to the request.

JD:
> Not sure what you mean and man page for clive mentions no such thing. 

I'm not familiar with clive (*), but am familiar with how various
websites stop people directly downloading from them, by using the
referrer header in the HTTP request.

When you request a resource from a website, it's usually a referral from
somewhere else.  e.g. If a page includes a picture, the referrer will be
the web address of the particular page.  i.e. If you were looking at
www.example.com and the homepage had picture.jpg included in it, the
request for the picture.jpg would mention www.example.com as the
referrer.  And the same thing applies if you request a page, the request
for the page mentions the page that linked to it as the referrer.

On websites that try to prevent leaching and bandwidth theft, they may
return errors to any requests that don't come from their approved list
of referrers, which will be their own addresses, and anyone else's that
they care to approve.  And the usual way to defeat such checks, for when
you're trying to directly grab something with utilities rather than web
browsers, is to fake up a referrer to go with your request, usually by
using their own domain name.

Looking at a man page for clive, I cannot see an option for doing this.
It may be that it already does it, anyway.  But I can't see a way to
test whether this is your issue.  It may be that YouTube has taken steps
to prevent downloading that /this/ tool cannot circumvent.  It could
just be an issue with the particular clips that you're trying to fetch.
(When I've been browsing YouTube on a PPC computer, I keep striking
pages with Flash content that I cannot view, and others with HTML5
content that I can.)

If I were you, I'd try some other random pages, or another utility.

* I have tried clive, but like I said, I'm unfamiliar with it, so I
don't know how well to expect it to work (usually works, sometimes
works, lots of problems, et cetera).

Trying one of the links that you originally mentioned gives me this
response:

$ clive -f best 'http://www.youtube.com/watch?v=_SEULZIHru0'
Checking ...error: /usr/share/libquvi-scripts/lua/website/youtube.lua:112: This video contains content from UMG. It is not available in your country. (code=150)

And I can't view the same in the webpage, either.

Trying it on another video, that I can view normally, gives me a 403
error message:  Checking ...error: server response code 403 (conncode=0)

It looks like "clive," itself isn't the HTTP agent, and that it may be
possible to monkey around with the go-betweens, that it uses, to do what
I've been talking about (with referrers).  The configuration file found
at /etc/clive/config looks promising.  But it's 4am, and I'll have
another look at it tomorrow.

-- 
[tim at localhost ~]$ uname -rsvp
Linux 3.6.3-1.fc17.x86_64 #1 SMP Mon Oct 22 15:32:35 UTC 2012 x86_64

All mail to my mailbox is automatically deleted, there is no point
trying to privately email me, I will only read messages posted to the
public lists.





More information about the users mailing list