FRD 0.9ua
Windows 10 x64 (installed on a SSD).

I tried to report this error inside FRD but I received notice "Sending error report failed. Failed to connect to remote server."


Error


Message:
java.lang.NullPointerException
Level:
SEVERE
Stack Trace:
null
com.objectdb.o.TYW.(TYW.java:102)
com.objectdb.o.ENH.d(ENH.java:224)
com.objectdb.o.ENT.Z(ENT.java:891)
com.objectdb.o.LDR.K(LDR.java:840)
com.objectdb.o.LDR.J(LDR.java:804)
com.objectdb.o.LDR.U1(LDR.java:1027)
com.objectdb.o.MST.aV(MST.java:522)
com.objectdb.o.MST.aU(MST.java:448)
com.objectdb.o.MST.U8(MST.java:421)
com.objectdb.o.WRA.U8(WRA.java:266)
com.objectdb.o.LDR.F(LDR.java:536)
com.objectdb.o.LDR.E(LDR.java:470)
com.objectdb.o.OBC.UO(OBC.java:1080)
com.objectdb.o.OBC.aL(OBC.java:766)
com.objectdb.o.ENT.beforeAccess(ENT.java:1116)
cz.vity.freerapid.model.DownloadFile.__odbGet_description(DownloadFile.java:1)
cz.vity.freerapid.model.DownloadFile.getDescription(DownloadFile.java:385)
cz.vity.freerapid.core.tasks.LinksAddedTask.getStringRepresentation(LinksAddedTask.java:67)
cz.vity.freerapid.core.tasks.LinksAddedTask.doInBackground(LinksAddedTask.java:35)
cz.vity.freerapid.core.tasks.LinksAddedTask.doInBackground(LinksAddedTask.java:18)
javax.swing.SwingWorker$1.call(Unknown Source)
java.util.concurrent.FutureTask.run(Unknown Source)
javax.swing.SwingWorker.run(Unknown Source)
java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.lang.Thread.run(Unknown Source)



Edited 2 time(s). Last edit at 12/11/2015 09:58PM by v3rv3.

Reply Quote

submit feature still not working
another log:


Error


Message:
java.lang.NullPointerException
Level:
SEVERE
Stack Trace:
null
com.objectdb.o.TYW.(TYW.java:102)
com.objectdb.o.ENH.d(ENH.java:224)
com.objectdb.o.ENT.Z(ENT.java:891)
com.objectdb.o.LDR.K(LDR.java:840)
com.objectdb.o.LDR.J(LDR.java:804)
com.objectdb.o.LDR.U1(LDR.java:1027)
com.objectdb.o.MST.aV(MST.java:522)
com.objectdb.o.MST.aU(MST.java:448)
com.objectdb.o.MST.U8(MST.java:421)
com.objectdb.o.WRA.U8(WRA.java:266)
com.objectdb.o.LDR.F(LDR.java:536)
com.objectdb.o.LDR.E(LDR.java:470)
com.objectdb.o.OBC.UO(OBC.java:1080)
com.objectdb.o.OBC.aL(OBC.java:766)
com.objectdb.o.ENT.beforeAccess(ENT.java:1116)
cz.vity.freerapid.model.DownloadFile.__odbGet_description(DownloadFile.java:1)
cz.vity.freerapid.model.DownloadFile.getDescription(DownloadFile.java:385)
cz.vity.freerapid.core.tasks.LinksAddedTask.getStringRepresentation(LinksAddedTask.java:67)
cz.vity.freerapid.core.tasks.LinksAddedTask.doInBackground(LinksAddedTask.java:35)
cz.vity.freerapid.core.tasks.LinksAddedTask.doInBackground(LinksAddedTask.java:18)
javax.swing.SwingWorker$1.call(Unknown Source)
java.util.concurrent.FutureTask.run(Unknown Source)
javax.swing.SwingWorker.run(Unknown Source)
java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
java.lang.Thread.run(Unknown Source)

Reply Quote

I think the latest version of objectdb (2.6.6_08) fixes this issue. I've tested with large number of items (230K+). But on some occasions FRD (the latest SVN revision) still gets choked on saving large number of items, in my case it was saving 199807 items. Objectdb could not handle the saving operation.

Mon Feb 29 18:37:23 2016 INFO: Config files directory: /home/tong2shot/Program/FreeRapid-0.9u4test/config
(snipped)
Mon Feb 29 18:37:42 2016 INFO: =====Removing deleted files from the database (83) =====
Mon Feb 29 18:37:42 2016 INFO: =====Saving updated/added files into the database (199807) =====
Mon Feb 29 18:40:27 2016 SEVERE: Uncaught exception on EDT. 
[ObjectDB 2.6.6_08] javax.persistence.PersistenceException
Failed to get reference value of field field cz.vity.freerapid.model.DownloadFile.averageSpeed using enhanced method (error 362)
        at com.objectdb.jpa.EMImpl.rollback(EMImpl.java:319)
        at cz.vity.freerapid.gui.managers.DatabaseManager.saveCollection(DatabaseManager.java:63)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.saveToDatabase(FileListMaintainer.java:212)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.initDownloadFiles(FileListMaintainer.java:205)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.loadListToBean(FileListMaintainer.java:120)
        at cz.vity.freerapid.gui.managers.DataManager.initProcessManagerQueue(DataManager.java:147)
        at cz.vity.freerapid.gui.managers.ManagerDirector.guiIsReady(ManagerDirector.java:174)
        at cz.vity.freerapid.core.MainApp.ready(MainApp.java:121)
        at org.jdesktop.application.Application$DoWaitForEmptyEventQ.finished(Application.java:443)
        at org.jdesktop.application.Task$StatePCL$1.run(Task.java:1021)
        at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:311)
        at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:756)
        at java.awt.EventQueue.access$500(EventQueue.java:97)
        at java.awt.EventQueue$3.run(EventQueue.java:709)
        at java.awt.EventQueue$3.run(EventQueue.java:703)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
        at java.awt.EventQueue.dispatchEvent(EventQueue.java:726)
        at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
        at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
        at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
        at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)
Caused by: com.objectdb.o.UserException: Failed to get reference value of field field cz.vity.freerapid.model.DownloadFile.averageSpeed using enhanced method
        at com.objectdb.o.MSG.d(MSG.java:75)
        at com.objectdb.o.UMR.P(UMR.java:934)
        at com.objectdb.o.UMR.F(UMR.java:719)
        at com.objectdb.o.ENT.D(ENT.java:452)
        at com.objectdb.o.ENT.D(ENT.java:382)
        at com.objectdb.o.STA.af(STA.java:835)
        at com.objectdb.o.STM.J(STM.java:602)
        at com.objectdb.o.OBM.bT(OBM.java:1078)
        at com.objectdb.o.OBM.rollbackTransaction(OBM.java:1049)
        at com.objectdb.jpa.EMImpl.rollback(EMImpl.java:316)
        ... 23 more
Caused by: java.lang.OutOfMemoryError: GC overhead limit exceeded
        at java.lang.Float.valueOf(Float.java:433)
        at cz.vity.freerapid.model.DownloadFile.__odbGetMember(DownloadFile.java:1)
        at com.objectdb.o.UMR.H(UMR.java:748)
        at com.objectdb.o.UMR.F(UMR.java:713)
        at com.objectdb.o.ENT.D(ENT.java:452)
        at com.objectdb.o.ENT.D(ENT.java:382)
        at com.objectdb.o.STA.af(STA.java:835)
        at com.objectdb.o.STM.J(STM.java:602)
        at com.objectdb.o.OBM.bT(OBM.java:1078)
        at com.objectdb.o.OBM.rollbackTransaction(OBM.java:1049)
        at com.objectdb.jpa.EMImpl.rollback(EMImpl.java:316)
        at cz.vity.freerapid.gui.managers.DatabaseManager.saveCollection(DatabaseManager.java:63)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.saveToDatabase(FileListMaintainer.java:212)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.initDownloadFiles(FileListMaintainer.java:205)
        at cz.vity.freerapid.gui.managers.FileListMaintainer.loadListToBean(FileListMaintainer.java:120)
        at cz.vity.freerapid.gui.managers.DataManager.initProcessManagerQueue(DataManager.java:147)
        at cz.vity.freerapid.gui.managers.ManagerDirector.guiIsReady(ManagerDirector.java:174)
        at cz.vity.freerapid.core.MainApp.ready(MainApp.java:121)
        at org.jdesktop.application.Application$DoWaitForEmptyEventQ.finished(Application.java:443)
        at org.jdesktop.application.Task$StatePCL$1.run(Task.java:1021)
        at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:311)
        at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:756)
        at java.awt.EventQueue.access$500(EventQueue.java:97)
        at java.awt.EventQueue$3.run(EventQueue.java:709)
        at java.awt.EventQueue$3.run(EventQueue.java:703)
        at java.security.AccessController.doPrivileged(Native Method)
        at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:76)
        at java.awt.EventQueue.dispatchEvent(EventQueue.java:726)
        at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
        at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
        at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
        at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)

I've been experimenting for over two months now, using different database backend (Berkeley DB ). With the same scenario, BDB can handle it pretty well.

Mon Feb 29 18:54:13 2016 INFO: Config files directory: /home/tong2shot/Program/FreeRapid-0.10-bdb/config
(snipped)
Mon Feb 29 18:54:27 2016 INFO: =====Removing deleted files from the database (114) =====
Mon Feb 29 18:54:27 2016 INFO: =====Saving updated/added files into the database (199785) =====
Mon Feb 29 18:54:44 2016 INFO: Parsing search.xml file /home/tong2shot/Program/FreeRapid-0.10-bdb/search/filespy.xml
Mon Feb 29 18:54:44 2016 INFO: Parsing search.xml file /home/tong2shot/Program/FreeRapid-0.10-bdb/search/freerapid.xml
Mon Feb 29 18:54:44 2016 INFO: Parsing search.xml file /home/tong2shot/Program/FreeRapid-0.10-bdb/search/google.xml
Mon Feb 29 18:54:44 2016 INFO: Parsing search.xml file /home/tong2shot/Program/FreeRapid-0.10-bdb/search/imdb.xml
Mon Feb 29 18:54:44 2016 INFO: Parsing search.xml file /home/tong2shot/Program/FreeRapid-0.10-bdb/search/ulozto.xml

So my conclusion for this case is, this is not FRD core code issue, but rather objectdb issue.

ObjectDB is problematic because those NullPointerExceptions just keep happening even though we update it to the latest version. Also, it's not open source, so it's actually incompatible with FRD's own license (GPL)...

How big is BDB with the Java bindings and other necessary libraries? I think originally we went for ODB because it's so compact. If BDB is not too big, we should definitely consider switching.

Also, BDB is a native library, right? We need to include the library for all platforms we support (Windows x86/amd64, Linux x86/amd64, OS X amd64), and hopefully users of other platforms can add their own native library manually.



Edited 1 time(s). Last edit at 03/01/2016 03:36PM by ntoskrnl.

BDB Java Edition is native java library, so all you have to do is to deploy the jar. The jar size of version 6.4.9 (je-6.4.9.jar) is about 2.9MB. The latest version is 6.4.25.

Ad NPEs:
It wouldn't probably happen if we would use DownloadFile entities from one thread. As the author of ObjectDB told me t he problem is that we don't use it like that and sometimes (it happened to me 1x a year) it causes race condition inside ObjectDB.
Therefore I don't think db change would solve our problem.

-------------------------------------





Edited 1 time(s). Last edit at 03/01/2016 03:47PM by Vity.

NPE in objectdb definitely happens to me more than once a week. I've never experienced the same thing with BDB JE since experimenting with it (over 2 months ago).

@Tong2Shot Interesting. And does it happen also with the latest version of ODB?
Maybe we could collect bunch of NPE and post it here:
[www.objectdb.com]
He was usually active with fixes (but he will probably want some test case...).

-------------------------------------





Edited 1 time(s). Last edit at 03/01/2016 03:59PM by Vity.

As far as I can remember, no, it happened with the version distributed with FRD 0.9u4. I have tested the latest version for less than a week.

Also please consider about the license issue.



Edited 2 time(s). Last edit at 03/01/2016 04:14PM by tong2shot.

tong2shot Wrote:
-------------------------------------------------------
> BDB Java Edition is native java library, so all
> you have to do is to deploy the jar. The jar size
> of version 6.4.9 (je-6.4.9.jar) is about 2.9MB.
> The latest version is 6.4.25.

By native java library I meant it's purely written in Java.