WordRider Home
Welcome! Log In Create A New Profile

Advanced

Tor not working with ITV plugin

Posted by TVjunkie 
Tor not working with ITV plugin
August 01, 2016 03:25AM
Hello tong2shot and other devs smiling smiley

Specifics:
OS: Windows Vista SP2 en-US x86,
fully updated (including July's 2016 MS updates)
JRE: 7u111 32bit, released on 20/07/2016 (latest 7)
FRD: 0.9u4 (semi-portable mode, uses -p switch)
GeoIP plugin: 1.0.0
Tor plugin: 1.0.2
ITV plugin: 1.3.0
Location: non-UK

After many months since my previous ITVhub download,
today I tried to fetch:
Tom Daley: Diving For Gold

On this very laptop, I recall in early
spring that after a wait of some seconds
(20-30), the RTMP download would start
at great speeds, so all was fine - different
MS updates and JRE version back then,
of course...

Today, the download would stall forever at
the "GETTING" stage confused smiley
I exited FRD, then went into the "config"
directory and saw that a "tor-gb" folder
wasn't present there sad smiley
After consulting the debug app.log, it dawned
on me that I had to also re-install the
JCE Unlimited Strength Jurisdiction Policy Files 7
that were inadvertently deleted
during some different JRE versions tests...

After those were properly installed
(inside "C:\Program Files\Java\jre7\lib\security\"),
now when I retry the posted ITVhub link
I do get a "config\tor-gb" folder created,
but the download quickly fails with an
"ERROR - File is not available anymore" message angry smiley angry smiley
Debug app.log has been attached!

The thing is the file IS available!
It can be viewed on the ITVhub site
(a UK HTTP Proxy/VPN and a user account
are both needed), but, what's more important,
it can also be downloaded with FRD
if it is configured to use a UK HTTP Proxy
(not blacklisted by ITV).

I'd prefer to have the Tor plugin working instead,
so any tips/advice are most welcome!
Do I need to do something else with
my Java installation? Is this issue ITV related?

I verified the Tor plugin works correctly with
BBC iPlayer URLs (albeit with many attempts)
in that I do get the subtitles (.srt files) of TV shows,
while of course no actual FLV video files
(all RTMP CDNs have been geo-blocked long ago
and require currently a non-blacklisted
UK VPN or UK SOCKS proxy).

Hoping there's still a fix for Tor+ITV spinning smiley sticking its tongue out

Best regards
Attachments:
open | download - app.log (11.7 KB)
Re: Tor not working with ITV plugin
August 01, 2016 01:22PM
I can reproduce this issue. I change the exception type in my local repo, and I get more meaningful error message: "This video is not available in your region". This and the fact that Tor plugin works fine (able to get BBC iplayer subtitle), indicate that ITV blocks UK Tor exit nodes.

I also test UK Tor exit nodes via Tor Browser, and use the SOCK proxy in FRD, I get the same error message.

To set specific country in Tor Browser: [www.wikihow.com]
To use Tor as socks proxy: [www.deepdotweb.com]
Re: Tor not working with ITV plugin
August 01, 2016 01:35PM
The "Failed to remove cryptography restrictions" is odd and should not occur – seems like something has changed in the JRE. Is this version (7u111) publicly available? If not, it might not be worth fixing because there are not many users.
Re: Tor not working with ITV plugin
August 01, 2016 01:48PM
I can't reproduce the "Failed to remove cryptography restrictions" on 1.8.0_101.
Re: Tor not working with ITV plugin
August 01, 2016 01:58PM
Yeah, I guess it was only changed in the non-public releases of Java 7.



Edited 1 time(s). Last edit at 08/01/2016 01:59PM by ntoskrnl.
Re: Tor not working with ITV plugin
August 04, 2016 05:10AM
tong2shot wrote:
-------------------------------------------------------
> I can reproduce this issue. I change the exception type in my local repo
> and I get more meaningful error message:
> "This video is not available in your region"
> (snip)
> indicate that ITV blocks UK Tor exit nodes.

Hi tong2shot and many apologies for not getting back to you sooner eye rolling smiley
Real life problems, you see...sad smiley

Many thanks for testing this, it confounded my fears
ITV had something to do with it... angry smiley

HOWEVER, I did some further tests on my own,
so please do read on...

> I also test UK Tor exit nodes via Tor Browser,

Thanks for that - it was you that made me remember
I had a copy of the FirefoxESR-based Tor Browser
in a portable format inside one of my external HDDs.
Once I located it, I first had to enable Flash NPAPI plugin
in Tor Browser (which is a big no-no, because it leaks your IP,
among other private identifiable data... angry smiley );
I already had a (bogus) account with ITV, so I then began
my own tests: Let me just say that they don't blacklist
all UK exit nodes in a blanket fashion
!

The very first time I tried, my GB exit node was "163.172.211.135";
that specific one was BL, hence see attachment "TorBrowserITVFailure.jpg"
Once I exited and then relaunched, I got me another GB exit node,
"37.130.227.133", that was WL! The video in question started to play,
see attachment "TorBrowserITVSuccess.jpg"
On another later relaunch of the Tor Browser I was again lucky
with exit node "37.139.64.123", see attachment "TorBrowserITVSuccess2.jpg"

Having my hopes rekindled after the Tor Browser results,
I went back to FRD: After a nerve-wracking situation of maybe more
than ten consecutive cycles of "Cancel & Resume", I was finally able
to initiate the ITVhub download, see attachment "FRD_ITV_Success.jpg"
So it is plausible that, after many repeated attempts,
you'll get a WL GB Tor exit node and hence succeed!

> and I get more meaningful error message:

Perhaps the ITV.com plugin could be patched so as to
print something other than the false
"ERROR - File is not available anymore" it gives currently; maybe:

ERROR - UK Tor Exit Node blocked; try again via "Cancel & Resume"

Just a thought tongue sticking out smiley
Many thanks for maintaining the ITV plugin in the first place smileys with beer

Best wishes
Attachments:
open | download - TorBrowserITVFailure.jpg (85.2 KB)
open | download - TorBrowserITVSuccess.jpg (96.4 KB)
open | download - TorBrowserITVSuccess2.jpg (84.6 KB)
open | download - FRD_ITV_Success.jpg (43.9 KB)
Re: Tor not working with ITV plugin
August 04, 2016 06:06AM
ntoskrnl wrote:
-------------------------------------------------------
> Is this version (7u111) publicly available?
> If not, it might not be worth fixing
> because there are not many users.

Many greetings, ntoskrnl! smiling bouncing smiley

I get my non-publicly released versions of JRE 7
through a friend in the University, where they have
paid Oracle Support; this is because I am using
an older payware (no longer supported/developed)
that doesn't run well with JRE 8; it appears JRE 7
is the highest it can work with as expected sad smiley

But a thorough google search does reveal
there exist people generous enough that are
willing to share winking smiley

> The "Failed to remove cryptography restrictions" is odd and should not occur
> – seems like something has changed in the JRE.

Unfortunately, I know nothing about Java,
so can't assess the importance of that message confused smiley

I have currently 3 installers of JRE7 on disk:
1. jre-7u80-windows-i586.exe (EOL'd last public release)
2. jre-7u101-windows-i586.exe (previous non-public release)
3. jre-7u111-windows-i586.exe (latest non-public release)

I did some tests and here are my results:

1. With jre-7u80 and jre-7u101, for Tor plugin to work at all
(creation of ".config/tor-gb" subdirectory) I don't have to install
the UnlimitedJCEPolicyJDK7 files
; my ITV logs don't contain
the offending "Failed to remove cryptography restrictions" line!

2. On the contrary, with latest jre-7u111 I do have to install
the UnlimitedJCEPolicyJDK7 files
for creation of
".config/tor-gb" subdirectory. As you were able to see in my
original post, my ITV logs do contain the line you quoted!

I hope you get some more sense from all that than me... spinning smiley sticking its tongue out

tong2shot wrote:
-------------------------------------------------------
> I can't reproduce the "Failed to remove cryptography restrictions" on 1.8.0_101.

I am sorry tong, not the case on my system confused smiley
I downloaded and installed latest JRE 8u102
(jre-8u102-windows-i586.exe) from [www.oracle.com]

As I already wrote about JRE 7u111, in order for the Tor plugin
to work on my system (creation of ".config/tor-gb" subdirectory),
I, too, had to install the UnlimitedJCEPolicyJDK8 files from
JCE Unlimited Strength Jurisdiction Policy Files 8
After that, the Tor plugin works, but the
"offending" line does appear inside my ITV logs (see attachment).
As long as that line isn't fatal with my ITV downloads,
are you of the opinion it can just be ignored?

Many regards
Attachments:
open | download - JRE8u102_successITV.log (19.8 KB)
Re: Tor not working with ITV plugin
August 04, 2016 03:39PM
TVjunkie Wrote:
-------------------------------------------------------
> Perhaps the ITV.com plugin could be patched so as
> to
> print something other than the false
> "ERROR - File is not available anymore" it gives
> currently; maybe:
>
> ERROR - UK Tor Exit Node blocked; try again via
> "Cancel & Resume"

Patch applied in plugin v1.3.1, thanks.


> I am sorry tong, not the case on my system confused smiley
> I downloaded and installed latest JRE 8u102
> (jre-8u102-windows-i586.exe) from
> [www.oracle.com]
> loads/jre8-downloads-2133155.html
>
> As I already wrote about JRE 7u111, in order for
> the Tor plugin
> to work on my system (creation of ".config/tor-gb"
> subdirectory),
> I, too, had to install the UnlimitedJCEPolicyJDK8
> files from
> JCE Unlimited Strength Jurisdiction Policy Files
> 8
> After that, the Tor plugin works, but the
> "offending" line does appear inside my ITV logs
> (see attachment).
> As long as that line isn't fatal with my ITV
> downloads,
> are you of the opinion it can just be ignored?

I forgot to mention that I also have UnlimitedJCEJDK8 (auto) installed. Whether the error message can just be ignored, maybe ntoskrnl can answer that.
Re: Tor not working with ITV plugin
August 04, 2016 11:47PM
If you have the unlimited policy files installed, then yes, the line can be ignored.

Sadly, most users are not capable of installing the policy files, so we ought to take a look at what has changed and rectify the issue in FRD.
Re: Tor not working with ITV plugin
August 07, 2016 12:47AM
When using FRD on ITV, with the same proxy that still can get bbc iplayer video and subtitles down, FRD says :
error: UK Tor Exit Node blocked; try again via "Cancel and Resume"
Sorry, only registered users may post in this forum.

Click here to login