another weirdness for bbc.co.uk

Re: another weirdness for bbc.co.uk

tong2shot — Fri, 26 Feb 2016 10:28:37 +0000

ilanad Wrote:
-------------------------------------------------------
> It might well be a worthwhile option, for this and
> other plugins, let you choose your proxy for the
> plug as needed (ie. the destination for the proxy,
> BBC a UK proxy, another for Australia, another for
> the US...)

This feature will be available in the next release. It will land in code repository's main branch in few days.

Spoiler image :-) :

Re: another weirdness for bbc.co.uk

ilanad — Thu, 21 May 2015 14:11:54 +0000

It might well be a worthwhile option, for this and other plugins, let you choose your proxy for the plug as needed (ie. the destination for the proxy, BBC a UK proxy, another for Australia, another for the US...)

Re: another weirdness for bbc.co.uk

tong2shot — Thu, 21 May 2015 14:04:00 +0000

It's possible, but it will duplicate proxy option (user auth, socks, etc) code in main app. There's a feature request for proxy auto config : [wordrider.net]. But AFAIK no code has been committed for the feature.

Re: another weirdness for bbc.co.uk

ilanad — Wed, 20 May 2015 22:18:14 +0000

This may be a stupid idea, but could the bbc.co.uk pluging (and maybe others) have a check box for 'use proxy' like 'use tor' and fill in your proxy info? Then that when it's trying to get something d/l'ed it will go thru the proxy and not have your whole system using the proxy? Forgive the stupidity of that question, I admit to knowing little about the 'proper' use of a proxy

Re: another weirdness for bbc.co.uk

tong2shot — Wed, 20 May 2015 13:14:15 +0000

@Tvjunkie
Thanks for the detailed analysis.

@all
Thanks for the feedbacks.

Re: another weirdness for bbc.co.uk

rancor — Wed, 20 May 2015 09:34:36 +0000

A few hours ago I tried [www.bestukvpn.com] and downloading 480p files OK :) but very slow and unstable, Port 80 , Akamai.

Re: another weirdness for bbc.co.uk

ilanad — Wed, 20 May 2015 01:54:35 +0000

well that explains why I'm getting "ERROR - Cannot download from service' for everything :( someone recommend a trustryworthy UK VPN? I need my weekly Jools Holland fix :(

Re: another weirdness for bbc.co.uk

TVjunkie — Wed, 20 May 2015 01:14:33 +0000

@rancor:

Please read my detailed analysis -
the news is NOT GOOD!

> VPN [freecloudvpn.com] still does not work

Yes, it is unfortunate their UK server is down...
Another good and free VPN I was using
(freevpnnetwork) is also down...
If you find a working VPN, remember it may be
necessary to change the rtmpport to 443 in
the bbc plugin's settings...

I really have no money to spare, but maybe
a paid for UK VPN is a solution - not a good
one, since it would be easy from now on for the
BBC to blacklist VPN IPs (as a lot of traffic
would appear to be coming from a single IP
or a limited range of IPs...)

Commiserations

Re: another weirdness for bbc.co.uk

TVjunkie — Wed, 20 May 2015 00:56:37 +0000

tong2shot wrote:
-----------------------
> So it's proxy problem.
> Here is my plugin settings :
> SettingsConfig{videoQuality=480p,
> rtmpPort=1935 (default), cdn=Limelight}.

rancor wrote:
-----------------------
> the problem only occurs when downloading files
> with max. 480p (old series without HD versions),
> HD (720p) downloading OK.
> This is not a problem with the proxy.

rancor is right: Unfortunately, this is NOT
a wrong proxy issue; instead it is a more ominous
change implemented by the BBC sometime
over the last weekend, or most probably since
Mon May 18th 2015!
If this is a permanent change, it would mean that
by using the Tor plugin/http UK proxy/"smart DNS"
service, only the HD (720p) TV files are accessible
from overseas (i.e. non-UK IPs) by FRD or other
BBC iPlayer downloaders...:-(

ANALYSIS (for the devs and others who need
to get to the bottom of this):
Let me again bring you a quick summary from
some of my previous posts:

There are 3 different CDNs that serve BBC TV
content over RTMP protocol:
1. Akamai (Ak), hostname: "cp41752.edgefcs.net"
This serves all available quality variants (resolutions),
224p, 360p (@480kbps), 360p (@800kbps), 468p, 720p.
This has always been geo-blocked at FMS level,
meaning the server would reject connection from
overseas if Tor plugin/http UK proxy/"smart DNS"
is used...Successful connection & download achieved
via UK VPN (PPTP, OpenVPN and others), Socks4 proxy,
SSH tunnel to a UK server and the likes...
2. Limelight (Ll), hostname: "bbcmedia.fcod.llnwd.net"
This serves all SD resolutions, i.e.
224p, 360p (@480kbps), 360p (@800kbps), 468p.
This has been always non-blocked at FMS level,
meaning Tor plugin/http UK proxy/"smart DNS", when
used with FRD, could successfully start a fetch...
3. Level 3 (L3), hostname: "iplayertokfs.fplive.net"
This serves only HD resolution, 720p. Has always been
non-blocked at FMS level, so the same usage
comments I made for Ll apply for this one, too.
NB: From late Jan 2015 to mid-March 2015, this CDN
was partially broken, often for both UK and overseas,
but usually for non-UK IPs - this has been now fixed.

The last time I downloaded something from Ll was
on Sat 16/05/2015, ca. 15:00 UTC (pid=b05vs0x4).
Sometime since then, the BBC have implemented
geo-blocking to Limelight CDN, too!
Further research on my part has shown that the
hostname has changed to: "bbcfmt.fcod.llnwd.net",
which is UK-only!
With both Ak & Ll blocked at server level, no SD
download is possible anymore with just "proxy" usage...

The issue had been reported earlier today (19/05)
in the get_iplayer support forum at the following URL:

https://squarepenguin.co.uk/forums/topic/tvmodes-flashvhigh-flashhigh-flashstd-not-working/

but since they do not tolerate discussion
about overseas access, the thread was initially
hastily closed, and later completely deleted!
More info can be found at the GetiPlayerAutomator
issue tracker (this is a MacOS frontend for get_iplayer),
where "overseas access" is better tolerated,
since the original author of the app is an American:
get-iplayer-automator/issues
(and the following comment by "mostlyotter").

I have conducted my own tests and all
agree with mostlyotter's findings:
If I use a (verified to work) UK http proxy in Firefox,
sample programme pid=b05wdnst DOES NOT PLAY
in SD from Ll CDN (nor it does, of course, from Ak);
see attached screenshot.
If I connect through a UK VPN, then the same show
DOES STREAM OK from the Ll CDN, see 2nd screenshot...

To establish this further, I used the mediaselectorURL
to gather the necessary data to compile an rtmpdump
download command for Limelight:
pid=b05wdnst => vpid=b05wdnqk
Then, from a UK IP (proxy):
RTMPstreams-data
=> rtmpdump command for 468p (token lasts about 1hr):

rtmpdump -r "rtmp://bbcfmt.fcod.llnwd.net:443/a8984/e3" -a "a8984/e3?as=adobe-hmac-sha256&av=1&te=connect&mp=iplayerstream/secure_auth/1500kbps/modav/p02qwwtc_b05wdnqk_1431888493764.mp4,iplayerstream/secure_auth/480kbps/modav/p02qwwtc_b05wdnqk_1431888495161.mp4,iplayerstream/secure_auth/800kbps/modav/p02qwwtc_b05wdnqk_1431888493280.mp4&et=1432087491&fmta-token=03820e4e2b1cb1084f83ece19547f88a23aa1af6bd35c5ec1c27f47970c7f7df" -f "WIN 17,0,0,188" -W "http://emp.bbci.co.uk/emp/SMPf/1.11.13/StandardMediaPlayerChromelessFlash.swf" -p "http://www.bbc.co.uk" -C O:1 -C O:0 -y "mp4:iplayerstream/secure_auth/1500kbps/modav/p02qwwtc_b05wdnqk_1431888493764.mp4" -o "b05wdnqk_1431888493764.flv"

The above command (with valid token) DOES NOT WORK from a non-UK IP:

RTMPDump v2.4 GIT-2014-03-02 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
ERROR: Closing connection: NetStream.Failed

however it DOES WORK when a UK VPN is used:

RTMPDump v2.4 GIT-2014-03-02 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration                1699.84
INFO:   moovPosition            36.00
INFO:   width                   832.00
INFO:   height                  468.00
INFO:   videocodecid            avc1
INFO:   audiocodecid            mp4a
INFO:   avcprofile              77.00
INFO:   avclevel                31.00
INFO:   aacaot                  2.00
INFO:   videoframerate          25.00
INFO:   audiosamplerate         48000.00
INFO:   audiochannels           2.00
INFO: trackinfo:
INFO:   length                  42496000.00
INFO:   timescale               25000.00
INFO:   language                und
INFO: sampledescription:
INFO:   sampletype              avc1
INFO:   length                  81592320.00
INFO:   timescale               48000.00
INFO:   language                und
INFO: sampledescription:
INFO:   sampletype              mp4a
1408.545 kB / 7.36 sec (0.4%)

So, it is a fait accompli: by changing the Limelight
hostname to a geo-blocked one, they have
effectively cut-out all non-UK traffic from this CDN too :-(
Be sure they will soon patch up that other
loophole, i.e. the L3 CDN....
Later in the year, the beeb may also remove
the RTMP streams altogether, in favour of
AppleHLS (they have done so for live radio),
or AdobeHDS (as they have done for live TV).
The CDNs for those HTTP formats are all
geo-blocked at server level...

PS: I thank the forum moderators for letting me
post this (and previous) analysis here; I genuinely
feel that (through search engines) many people
will find the documentation invaluable!
A sad day really for BBC lovers!

(Gonna mourn privately now...:-( :-( :-( )

Re: another weirdness for bbc.co.uk

rancor — Wed, 20 May 2015 00:18:01 +0000

Download example file [www.bbc.co.uk] with Limelight CDN, hightest available quality, port 1935 via proxy 80.253.111.240 8080 (or other proxy, transparent, anonymous, elite) Download in 720p OK, other resolutions 0 bytes.

These files only in max 480p and download 0 bytes with various settings CDN (with Akamai) and quality (without hightest available) [www.bbc.co.uk] [www.bbc.co.uk] [www.bbc.co.uk] [www.bbc.co.uk]

VPN [freecloudvpn.com] still does not work, I'll try tomorrow if we start working.

Re: another weirdness for bbc.co.uk

tong2shot — Tue, 19 May 2015 22:54:46 +0000

I can download the example just fine, either 480p or 720p, with limelight as CDN.

Please post your plugin settings, screenshot would be better.

Re: another weirdness for bbc.co.uk

rancor — Tue, 19 May 2015 21:58:25 +0000

I use a variety of proxy and the problem only occurs when downloading files with max. 480p (old series without HD versions), HD (720p) downloading OK. Change the settings to other resolutions - downloading 0 bytes.

File [www.bbc.co.uk] downloading in 720p OK, with settings 480p in plugin: 0 bytes.

This is not a problem with the proxy.

Re: another weirdness for bbc.co.uk

tong2shot — Tue, 19 May 2015 12:26:37 +0000

Just tested your example links : [www.bbc.co.uk] and [www.bbc.co.uk]. Both samples work just fine.

So it's proxy problem.

Here is my plugin settings : SettingsConfig{videoQuality=480p, rtmpPort=1935 (default), cdn=Limelight}.

Re: another weirdness for bbc.co.uk

rancor — Tue, 19 May 2015 12:16:18 +0000

Link [www.bbc.co.uk] working via proxy (example, "fresh" proxy from list [free-proxy-list.net] 81.137.100.158 8080 anonymous)
Link [www.bbc.co.uk] and [www.bbc.co.uk] download 0 bytes.

High speed free VPN [freecloudvpn.com] (i use this) not working at this time. Other VPN run very slowly - I do not use.

Re: another weirdness for bbc.co.uk

tong2shot — Tue, 19 May 2015 11:46:46 +0000

Works fine for me with VPN, for example : [www.bbc.co.uk].

Can you provide example link that doesn't work?

Re: another weirdness for bbc.co.uk

rancor — Tue, 19 May 2015 06:56:06 +0000

Another problems with BBC. Download 0 bytes (or "cannnot download from service") via proxy (any type) and any type CDN. Via VPN error "cannnot download from service".

Re: another weirdness for bbc.co.uk

jm — Sat, 18 Apr 2015 13:23:53 +0000

Thanks for the update. Appreciate your help

Re: another weirdness for bbc.co.uk

tong2shot — Fri, 17 Apr 2015 12:51:51 +0000

I can reproduce that now. The sample link has two vpid : p02p3j3y, b05rp3f9. The default is p02p3j3y, so plugin picked it. But they only provide 360p videos for vpid p02p3j3y. Vpid b05rp3f9 contains all possible video qualities.

Please try plugin v1.3.1.

Re: another weirdness for bbc.co.uk

jm — Thu, 16 Apr 2015 19:08:39 +0000

I dont always want to get all shows in HD, sometimes I just want the 1500k 832x468 file. It is random. Just now using VPN with FRD set to 480p 1935 and Akamai, files for Masterchef UK ep17 and 19 worked fine, but ep 18 would only get the 640x360 796k file. I had to use another program to get the 1500k file.

bbc.co.uk

Thanks

Re: another weirdness for bbc.co.uk

tong2shot — Sun, 12 Apr 2015 13:42:26 +0000

Could you provide sample links ?

I'm also using VPN, works fine for me with this link : [www.bbc.co.uk].
My config : SettingsConfig{videoQuality=Highest available, rtmpPort=1935 (default), cdn=Limelight}

Make sure the show available in HD.

Re: another weirdness for bbc.co.uk

jm — Sun, 12 Apr 2015 01:10:49 +0000

Not sure whats up. the last few days 9 times out of 10 FRD only wants to get the lowest quality stream from iplayer, no matter setting I have the plugin on. I'm using VPN. Have had to resort to other means

Re: another weirdness for bbc.co.uk

TVjunkie — Tue, 07 Apr 2015 21:31:51 +0000

tong2shot wrote:
-------------------------------------------------------
> The sample link is working fine now.
> So I guess it was a temporary problem.

Yes, the issue was reported to the BBC:

Latest programme issues

and they fixed it...

> The requested feature
> (to try all available vPIDs for a given PID)
> has just been implemented in plugin v1.3.0, anyway.

As ever, many thanks tong2shot :)-D

Re: another weirdness for bbc.co.uk

tong2shot — Mon, 06 Apr 2015 13:34:58 +0000

The sample link is working fine now. So I guess it was temporary problem. The requested feature (to try all available vPIDs for a given PID) has just been implemented in plugin v1.3.0, anyway.

Re: another weirdness for bbc.co.uk

TVjunkie — Sat, 04 Apr 2015 02:10:38 +0000

ilanad wrote:
-------------------------------------------------------
> after behaving itself nicely (at SD resolution)

FWIW, sometime in mid-March the Level3 HD CDN
got fixed :-) ; this is the CDN that works with UK HTTP proxy
or the Tor plugin (with known... problems, as far as the
latter is concerned...:-D).
Try a show available in HD by selecting "720p", "Level 3"
& "Enable Tor" in the latest (v1.2.8) BBC plugin -
it should now download in HD... ;-)

> [www.bbc.co.uk]
>
> ERROR- Error fetching media selector: 'selectionunavailable'
>
> so far just this one link.....

It's an error on their end - I can't get past the ident (BBC One) clip
in a browser by using either a UK http proxy or a UK VPN...
Nothing you can do...

@tong2shot:

for pid=b05pl7rt

http://www.bbc.co.uk/programmes/b05pl7rt/playlist.json

produces two versions:
"Original", with duration 2100s=35min & vpid=b05pvl0w and
"Shortened", with duration 1800s=30min & vpid=b05pl7rr
The "Original" is the one posted on iPlayer (Duration 35 mins)
but it doesn't play (nor can it be downloaded by FRD), because

http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/pc/vpid/b05pvl0w

(from a UK IP) yields:

Language: XML
->
 id="selectionunavailable"/>
>

However,

http://open.live.bbc.co.uk/mediaselector/5/select/version/2.0/mediaset/pc/vpid/b05pl7rr

(from a UK IP) DOES PRODUCE stream data, so it is downloadable;
for the Limelight CDN - not geo-blocked - and 1500 bitrate, I compiled this rtmpdump command (token is good for only an hour) :

rtmpdump -r "rtmp://bbcmedia.fcod.llnwd.net:1935/a1414/e3" -a "a1414/e3?as=adobe-hmac-sha256&av=1&te=connect&mp=iplayerstream/secure_auth/400kbps/modav/bUnknown-7d61f6ca-9f47-4940-831b-1b866aa2c6c4_b05pl7rr_1427930081941.mp4,iplayerstream/secure_auth/1500kbps/modav/bUnknown-7d61f6ca-9f47-4940-831b-1b866aa2c6c4_b05pl7rr_1427930079813.mp4,iplayerstream/secure_auth/800kbps/modav/bUnknown-7d61f6ca-9f47-4940-831b-1b866aa2c6c4_b05pl7rr_1427930077180.mp4,iplayerstream/secure_auth/480kbps/modav/bUnknown-7d61f6ca-9f47-4940-831b-1b866aa2c6c4_b05pl7rr_1427930082837.mp4&et=1428116245&fmta-token=a93941c919b5d7e1f0b3a339fc1ef52331eca141c172821bf6ab37e968349bb8" -f "WIN 17,0,0,132" -W "http://emp.bbci.co.uk/emp/SMPf/1.11.9/StandardMediaPlayerChromelessFlash.swf" -p "http://www.bbc.co.uk" -C O:1 -C O:0 -y "mp4:iplayerstream/secure_auth/1500kbps/modav/bUnknown-7d61f6ca-9f47-4940-831b-1b866aa2c6c4_b05pl7rr_1427930079813.mp4" -o "b05pl7rr_1427930079813.flv" -e

which quickly fetches a 324 MB flv file.
The bbc plugin could be perhaps patched so as to try all available vPIDs for a given PID until it finds stream data;
this is a bug that has been fixed in get_iplayer in the past, so ilanad's sample downloads fine with:

perl get_iplayer-292.pl --pid=b05pl7rt --modes=flashvhigh --force --raw

Best regards (and Happy Easter)

another weirdness for bbc.co.uk

ilanad — Fri, 03 Apr 2015 05:05:50 +0000

after behaving itself nicely (at SD resolution) for some weeks now, this popped up...

ERROR- Error fetching media selector: 'selectionunavailable'

so far just this one link.....

[www.bbc.co.uk]