WordRider Home
bbc.co.uk downloads truncated....
January 30, 2015 09:52PM
started a couple days ago, downloads are coming up WAY short.....

these should be around 530mb each, 52mb and 2.9mb ....

[www.bbc.co.uk]

[www.bbc.co.uk]
Re: bbc.co.uk downloads truncated....
January 30, 2015 11:05PM
Please post your BBC plugin settings: quality, port, CDN, tor. Are you using proxy?

Are those downloads completed? Are there any error messages?

Currently I'm downloading your example #2, it's now 60MB of 255MB. I have slow connection, so it will take a while.

My plugin settings:
Quality : lowest available.
Port: 1935
CDN: Limelight.
Tor: enabled, but I'm using proxy, so tor will be ignored.

Edit: it's now 98MB of 254MB, and I get "Pipe broken" error. It's probably connection issue.



Edited 1 time(s). Last edit at 01/30/2015 11:29PM by tong2shot.
Re: bbc.co.uk downloads truncated....
January 31, 2015 12:21AM
quality : highest available
RTMP Port 1935 (default)
CDN: Level 3

Using Tor (no proxy)

just tried again and same results (different sizes)

it has been working GREAT for months, just started doing this wednesday

will give Limelight a shot



Edited 1 time(s). Last edit at 01/31/2015 12:23AM by ilanad.
Re: bbc.co.uk downloads truncated....
January 31, 2015 02:45AM
changed it to Limelight and now instant finish with 0 bytes, same two links

very strange log file


Fri Jan 30 19:36:46 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:37:16 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:38:36 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:38:46 MST 2015 WARNING: Unable to verify signatures on consensus document, discarding...
Fri Jan 30 19:38:50 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:38:52 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:39:11 MST 2015 SEVERE: Status code je 500
Fri Jan 30 19:39:39 MST 2015 SEVERE: Status code je 500
Fri Jan 30 19:39:42 MST 2015 SEVERE: Status code je 500
Fri Jan 30 19:39:46 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:39:50 MST 2015 SEVERE: Status code je 500
Fri Jan 30 19:40:00 MST 2015 WARNING: video duration is null
Fri Jan 30 19:41:46 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:42:16 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:42:30 MST 2015 WARNING: Couldn't create fir X:\bin\FreeRapid-0.9u4\config
Fri Jan 30 19:42:46 MST 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Fri Jan 30 19:42:50 MST 2015 WARNING: video duration is null
Re: bbc.co.uk downloads truncated....
January 31, 2015 10:47AM
Try to delete "tor-gb" directory from your FRD config directory (Help->Browse to log file, then up one directory, config directory is log's parent).

I'll try to test it further at night or tomorrow.
Re: bbc.co.uk downloads truncated....
January 31, 2015 05:49PM
Google translate:

I have the same problem:

File (HD) [www.bbc.co.uk] download 47.17 MB (level3 and limelight and port 1935)

Other files (HD): 0 bytes size

Download with "lowest available" OK

All files playing ok in browsers (with UK proxy).

Sat Jan 31 18:35:09 CET 2015 WARNING: Unable to verify signatures on consensus document, discarding...
Sat Jan 31 18:35:12 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:16 CET 2015 WARNING: Consensus signed by unrecognized directory authority: 23d15d965bc35114467363c165c4f724b64b4f66
Sat Jan 31 18:35:18 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:35:44 CET 2015 WARNING: Failed to download router descriptors: Directory request timed out
Sat Jan 31 18:36:41 CET 2015 WARNING: video duration is null
Sat Jan 31 18:36:51 CET 2015 WARNING: video duration is null
Sat Jan 31 18:37:03 CET 2015 WARNING: video duration is null
Sat Jan 31 18:37:19 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:38:31 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:39:35 CET 2015 WARNING: video duration is null
Sat Jan 31 18:39:44 CET 2015 WARNING: video duration is null
Sat Jan 31 18:39:53 CET 2015 WARNING: video duration is null
Sat Jan 31 18:39:57 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:42:17 CET 2015 WARNING: video duration is null
Sat Jan 31 18:42:43 CET 2015 WARNING: video duration is null
Sat Jan 31 18:43:45 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:43:52 CET 2015 WARNING: video duration is null
Sat Jan 31 18:44:00 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:44:45 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:46:15 CET 2015 WARNING: video duration is null
Sat Jan 31 18:46:19 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD
Sat Jan 31 18:46:30 CET 2015 WARNING: Couldn't create fir C:\Documents and Settings\USER\Dane aplikacji\VitySoft\FRD



Edited 2 time(s). Last edit at 01/31/2015 06:12PM by rancor.
Re: bbc.co.uk downloads truncated....
January 31, 2015 07:12PM
Tor is proxy
Re: bbc.co.uk downloads truncated....
January 31, 2015 09:22PM
Okay, I updated the Tor plugin, please try v1.0.2.
Re: bbc.co.uk downloads truncated....
January 31, 2015 09:58PM
Still problem with HD files - no change (enable "hightest available" or "720p"). Working with other quality level.
Re: bbc.co.uk downloads truncated....
February 01, 2015 04:07AM
I wouldn't push the alert button just yet, but there certainly is something going wrong with the HD streams sad smiley

But first, the "Tor plugin" issue is a separate thing from the "truncated downloads" problem;
once the Tor plugin effectuates connection with the geo-filtered BBC servers (these are "playlist" servers that FRD
must connect to in order to gather data for the available streams), then it gets out from the play and the actual RTMP
download is realised via a direct connection between the Limelight (for <=480p) or the Level 3 (720p) CDN and your ISP.
Using a UK (HTTP) proxy or the Tor plugin may grant you access to the Akamai CDN servers (for all video resolutions),
but those servers are GEOLOCKED at FMS level, meaning they won't start the requested stream once they
verify your non-UK originating IP address. FRD will produce a "0 bytes" download in those cases...

I was not having any out of the ordinary problems with previous version (1.0.1) of the Tor plugin,
neither should anyone who heeds to my guidelines described here. Updated to 1.0.2 and so far so good...

Now, the "truncated downloads" problem:
Limelight CDN is a set of de-centralised media servers; your copy of FRD connects to the one server which is closer to
your physical location. You can find this info out by loading - DIRECT CONNECTION, NOT USING A PROXY - the
following URL:
Ll CDN identity
You can geo-search the yielding IP address to pinpoint the limelight PoP (point of presence).

I myself, physically located in south-eastern Europe, am not experiencing the interrupted downloads issue;
it may well be that those affected by it are downloading from a CDN node hammered by
extra heavy requests at peak times.
When I download from the Limelight CDN,
I only download one file at a time and - whenever possible - do it after peak times, i.e. past 00:00 GMT.
It is indeed true that in the past downloading from the Ll CDN was done with very high speeds (>=1.2 MBps),
but in the latest months that the (illicit) overseas downloads grew more plentiful, I get no more than half that speed...
@ilanad:
Both of your sample programmes download fine at 468p resolution (with Tor plugin) from the Ll CDN.

It is indeed a shame that the rtmp plugin DOES NOT HAVE RESUME SUPPORT. In the past I had time-outs
at 80-90% of a BBC file; when FRD would "resume", it would delete the partial file and restart from scratch...
If rtmp resume support is ever to be considered, please take a look at this patch:
rtmpdump "BBC iPlayer files" special resume patch
which is special for iPlayer downloads...

Level 3 CDN

@ilanad:
Both of your sample programmes IN FACT LACK A HD (720p) version; the "Watch in HD" option
in the iPlayer pages is MISLEADING.
@tong2shot:
If you load via a UK proxy the Mediaselector/5 API URLs:
vPID=p00pvbj7
vPID=p00pvbj7
you'll see for yourself that no <media bitrate="2800" version has been uploaded to either Ll or Ak CDNs - if FRD
is configured to 720p/level3, then a "0 bytes" download will be produced!
@rancor
Your sample programme downloads fine in SD 468p (with Tor enabled) from Ll CDN.
As far as the 720p version is concerned, I can replicate your issue with an incomplete
download sized 47.17 MB coming from the Level3 CDN.
It may well be that the BBC uploaded a truncated file to that CDN.
You are not right saying
Quote
All files playing ok in browsers (with UK proxy).
If you play the Level3 HD version in Firefox (via UK proxy), then playback stops at 02:53.
Also, if you download the file with the dedicated tool get_iplayer,
get_iplayer -p "http://[proxyhost]:[proxyport]" --partial-proxy --pid=b0517vrl --raw --modes=flashhd --attempts=1
you get:
INFO: skipping flashhd1 mode
INFO: Trying flashhd2 mode to record tv: Great British Railway Journeys: Series
6 - 20. Oakham to Cambridge
INFO: File name prefix = Great_British_Railway_Journeys_Series_6_-_20._Oakham_to
_Cambridge_b0517vrl_default
RTMPDump v2.4 GIT-2015-01-15 (Compiled by KSV)
(c) 2010 Andrej Stepanchuk, Howard Chu, The Flvstreamer Team; license: GPL
Connecting ...
INFO: Connected...
Starting download at: 0.000 kB
INFO: Metadata:
INFO:   duration                1745.28
INFO:   moovPosition            36.00
INFO:   width                   1280.00
INFO:   height                  720.00
INFO:   videocodecid            avc1
INFO:   audiocodecid            mp4a
INFO:   avcprofile              100.00
INFO:   avclevel                41.00
INFO:   aacaot                  2.00
INFO:   videoframerate          25.00
INFO:   audiosamplerate         48000.00
INFO:   audiochannels           2.00
INFO: trackinfo:
INFO:   length                  43632000.00
INFO:   timescale               25000.00
INFO:   language                und
INFO: sampledescription:
INFO:   sampletype              avc1
INFO:   length                  83773440.00
INFO:   timescale               48000.00
INFO:   language                und
INFO: sampledescription:
INFO:   sampletype              mp4a
48301.104 kB / 173.92 sec (9.9%)
Download may be incomplete (downloaded about 9.90%), try resuming
INFO: Command exit code 2 (raw code = 512)
INFO: Checking existence of audiodescribed version
INFO: No specified modes (flashhd) available for this programme with version 'au
diodescribed' (try using --modes=flashhigh,rtsphigh)
ERROR: Failed to record 'Great British Railway Journeys: Series 6 - 20. Oakham t
o Cambridge (b0517vrl)'
If you are desperate to acquire the 720p version, then the Akamai CDN is all you are left with...
You can use one of the free available UK VPNs
(try Free UK VPN) and configure BBC plugin
to 720p/443 (or 80)/Akamai - NB: These free VPNs have default RTMP port 1935 blocked!
... and do not expect great speeds!

Another Level3 issue was recently reported to the get_iplayer support forum
(they are adamant about not supporting overseas users - don't post there if not in the UK!):
https://squarepenguin.co.uk/forums/topic/trouble-downloading-octonauts-s01e02-in-hd/
It turns out (this is my inspection result) that although the Mediaselector/5 API
produces the data for a Level 3 stream, the same stream is non-existent
on the server itself, which returns
"ERROR: Closing connection: NetStream.Failed".

To recap with HD streams:
1) For many recent TV shows, no HD versions are available at all
(no matter what the iPlayer pages indicate).
e.g. last week's Graham Norton has a L3 HD stream:
The Graham Norton Show - S16E15,
which FRD can fetch just fine, while last Friday's episode does not:
The Graham Norton Show - S16E16,
FRD resulting in a "0 bytes" download.
2) Some Level3 HD uploads have been reported to be "problematic".
Use the Akamai CDN via a UK VPN if you must obtain the 720p files.

And I believe the Beeb personnel are not daft - they must've already noticed all this huge bandwidth
being spent to overseas clients - perhaps this is the beginning of more changes to come.
They have already moved their live TV & live Radio streams over to HTTP streaming (AppleHLS & AdobeHDS),
and they announced that at least audio-on-demand will be migrated in 2015 to HTTP streaming, too!
I bet they have similar plans for video-on-demand; if this is realised, no Tor plugin or free (open) HTTP
proxy could handle all these video streams...sad smiley A high bandwidth paid-for UK VPN will then be mandatory for us
overseas BBC lovers...eye rolling smiley



Edited 1 time(s). Last edit at 02/02/2015 12:03AM by TVjunkie.
Sorry, only registered users may post in this forum.

Click here to login