Main and devprev crashing

Case number:845829-992727
Topic:Crash/Hang
Opened by:bertro
Status:Open
Type:Bug
Opened on:Wednesday, May 23, 2012 - 02:01
Last modified:Saturday, June 23, 2012 - 12:51

Both main and devprev latest clients are crashing repeatedly for unknown reason. See attached log file for main (was on 558, this time).

AttachmentSize
log.txt11.35 MB
(Wed, 05/23/2012 - 02:01  |  38 comments)


bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

and again on main...

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

...

beta_helix's picture
User offline. Last seen 23 hours 25 min ago. Offline
Joined: 05/09/2008
Groups: None

and you're on a PC running Windows 7?
Can you pinpoint anything in particular that causes it to crash?

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

yes on win7 prof and updated. Sorry, no clues on the crashes, windows just says that the app has stopped working. Very frustrating. Sometimes, not even an exception message in the log.txt file.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

...

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

on devprev, some info in unhandled exception...

B_2's picture
User offline. Last seen 4 years 21 weeks ago. Offline
Joined: 11/29/2008
Groups: None

How many instances of fold.it are you running at once? I get similar crashes when the client exceeds available system resources, either by running too many clients, or with very large puzzles.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

B_2,

I run from 3 to 6 clients (main and devprev), crash can/will happen with 2 only clients open.

Only ~60,000 handles and ~1400 threads for 6 clients at the moment, 9260MB available Physical Memory.

My PC:

Intel Core i7 2600K (Sandy Bridge)
16MB DDR3 RAM
Radeon HD 5770

I don't think that is the problem.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

on devprev:

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9562264 bytes (no line)
3: library_main +9562191 bytes (no line)
4: library_main +4968207 bytes (no line)
5: library_main +4973763 bytes (no line)
6: library_main +4986172 bytes (no line)
7: library_main +4458308 bytes (no line)
8: library_main +4448586 bytes (no line)
9: library_main +2659405 bytes (no line)
10: library_main +2521315 bytes (no line)
11: library_main +2524331 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

on main:

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9555768 bytes (no line)
3: library_main +9555695 bytes (no line)
4: library_main +4963471 bytes (no line)
5: library_main +4968931 bytes (no line)
6: library_main +4981340 bytes (no line)
7: library_main +4446404 bytes (no line)
8: library_main +4442570 bytes (no line)
9: library_main +2658701 bytes (no line)
10: library_main +2520259 bytes (no line)
11: library_main +2523275 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

marie_s's picture
User offline. Last seen 1 year 46 weeks ago. Offline
Joined: 05/18/2008
Groups: None

crashing when supress bands during wiggle is back in 562 : freezing
win7

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

Script was saying running but it was not and the upper left corner was not showing the clock like object. Clicking Cancel did not stop the script. All "wets" buttons at bottom were grayed out. Rest of interface was running. Had to use Save and Exit to quit client.

In attached file, see large bunch of NUL characters on line 8482 (see with Notepad++) just before series of Autosaved...

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

unhandled exception...

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

both on main and devprev...unhandled exceptions

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

in devprev:

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9562264 bytes (no line)
3: library_main +9562191 bytes (no line)
4: library_main +4968207 bytes (no line)
5: library_main +4973763 bytes (no line)
6: library_main +4986172 bytes (no line)
7: library_main +4452420 bytes (no line)
8: library_main +4448586 bytes (no line)
9: library_main +2659405 bytes (no line)
10: library_main +2521315 bytes (no line)
11: library_main +2524331 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

devprev

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: no symbol (no line)
3: no symbol (no line)
4: no symbol (no line)
5: no symbol (no line)
6: no symbol (no line)
7: no symbol (no line)
8: no symbol (no line)
9: no symbol (no line)
10: no symbol (no line)
11: no symbol (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

devprev

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9580264 bytes (no line)
3: library_main +9580191 bytes (no line)
4: library_main +4987215 bytes (no line)
5: library_main +4992771 bytes (no line)
6: library_main +5005180 bytes (no line)
7: library_main +4470756 bytes (no line)
8: library_main +4466922 bytes (no line)
9: library_main +2675149 bytes (no line)
10: library_main +2534627 bytes (no line)
11: library_main +2538043 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

Main:

UNHANDLED EXCEPTION
1: no symbol (no line)
2: no symbol (no line)
3: no symbol (no line)
4: no symbol (no line)
5: no symbol (no line)
6: no symbol (no line)
7: no symbol (no line)
8: no symbol (no line)
9: no symbol (no line)
10: no symbol (no line)
11: no symbol (no line)
12: no symbol (no line)
13: no symbol (no line)
14: no symbol (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

Main:

IRC::run error, code = 5, desc = Remote connection closed
Exiting IRC::run
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
No object matching key 0.
SRVR_THRD starting solution upload...
SRVR_THRD finished solution upload. took 1.0787 seconds.
exiting...
Autosaved puzzles/0000992868/0000253386/570s1/autosave.ir_solution.
ViewOptionsWidget::refresh()
Option file found. Sending...
closing boinc...
SRVR_THRD starting solution data upload...
SRVR_THRD finished solution data upload. took 0.964005 seconds.
SRVR_THRD sending: 253386 992868 group_score
SRVR_THRD sending: 253386 992868 score
SRVR_THRD sending play event log...
Couldn't quit: Illegal operation for this state (..\..\..\rosetta_source\src\game\util\IRC.cc:430)
done.
(bertro: and following here are 2690167 NUL characters)

brow42's picture
User offline. Last seen 1 week 2 days ago. Offline
Joined: 09/19/2011
Groups: None

I crashed main when I clicked the reset alignment button. I had recently made a new track, shifted alignment (unlocked). Clicked lock to align. Unlocked it. Shook sidechains. Sent all other alignments down. A lot of spinning looking around. Clicked reset alignment. Puzzle 566 2012-05-17-48987M-win_x86. I only had 1 main client running (and 1 devprev running).

SRVR_THRD getting notifications...
Autosaved puzzles/0000992797/0000269484/3qzkA/autosave.ir_solution.
Autosaved puzzles/0000992797/0000269484/3qzkA/autosave-best.ir_solution.
Autosaved puzzles/0000992797/0000269484/3qzkA/autosave-recentbest.ir_solution.

UNHANDLED EXCEPTION
1: library_main +2887810 bytes (no line)
2: library_main +2904431 bytes (no line)
3: library_main +3020652 bytes (no line)
4: library_main +3025814 bytes (no line)
5: library_main +2962732 bytes (no line)
6: library_main +2168365 bytes (no line)
7: library_main +3599822 bytes (no line)
8: library_main +2167557 bytes (no line)
9: library_main +3601193 bytes (no line)
10: library_main +3603436 bytes (no line)
11: gapfnScSendMessage +818 bytes (no line)
12: GetThreadDesktop +215 bytes (no line)
13: GetClientRect +197 bytes (no line)
14: CallWindowProcW +27 bytes (no line)
15: wglSwapBuffers +730 bytes (no line)
16: gapfnScSendMessage +818 bytes (no line)
17: GetThreadDesktop +215 bytes (no line)
18: CharPrevW +312 bytes (no line)
19: DispatchMessageA +15 bytes (no line)
20: library_main +3604213 bytes (no line)
21: library_main +2164499 bytes (no line)
22: library_main +15867 bytes (no line)
23: library_main +32 bytes (no line)
24: no symbol (no line)
25: no symbol (no line)
26: no symbol (no line)
27: BaseThreadInitThunk +18 bytes (no line)
28: RtlInitializeExceptionChain +99 bytes (no line)
29: RtlInitializeExceptionChain +54 bytes (no line)

jflat06's picture
User offline. Last seen 2 days 3 hours ago. Offline
Joined: 09/29/2010
Groups: Window Group

Is anyone else able to reproduce these issues?

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

On Main: By far the most recurring type of crash I see.

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9562264 bytes (no line)
3: library_main +9562191 bytes (no line)
4: library_main +4968207 bytes (no line)
5: library_main +4973763 bytes (no line)
6: library_main +4986172 bytes (no line)
7: library_main +4452420 bytes (no line)
8: library_main +4448586 bytes (no line)
9: library_main +2659405 bytes (no line)
10: library_main +2521315 bytes (no line)
11: library_main +2524331 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

Main:

core.fragment.picking_old.vall.eval.IdentityEval: ss = LLL | aa = GTG

UNHANDLED EXCEPTION
1: no symbol (no line)
2: no symbol (no line)
3: no symbol (no line)
4: no symbol (no line)
5: no symbol (no line)
6: no symbol (no line)
7: no symbol (no line)
8: no symbol (no line)
9: no symbol (no line)
10: no symbol (no line)
11: no symbol (no line)
12: no symbol (no line)
13: no symbol (no line)
14: no symbol (no line)
15: no symbol (no line)

Joined: 06/17/2010

What is your graphics card and what drivers d you use? Looks like you are only one person who have that issues.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

My PC:

OS Name Microsoft Windows 7 Professional
Version 6.1.7601 Service Pack 1 Build 7601
System Manufacturer MSI
System Model MS-7672
System Type x64-based PC
Processor Intel(R) Core(TM) i7-2600K CPU @ 3.40GHz, 3392 Mhz, 4 Core(s), 8 Logical Processor(s)
BIOS Version/Date American Megatrends Inc. V18.8, 16/01/2012
SMBIOS Version 2.7
Hardware Abstraction Layer Version = "6.1.7601.17514"
Installed Physical Memory (RAM) 16.0 GB
Total Physical Memory 16.0 GB
Available Physical Memory 10.4 GB
Total Virtual Memory 31.9 GB
Available Virtual Memory 24.6 GB
Page File Space 16.0 GB

ATI Radeon HD 5700 Series
Driver Packaging Version: 8.961-120405a-137813C-ATI
Catalyst Version: 12.3
2D Driver Version: 8.01.01.1243
Direct3D Version: 7.14.10.0903
OpenGL Version: 6.14.10.11631
Catalyst Control Center Version: 2012.0405.2205.37728

Hope that helps.

Joined: 06/17/2010

Darn, it all looks good :(
I also have win7 64, only 4G ram and radeon 6770.
2 clients working almost 24/7 and reboot every few days (mostly power failure).
Haven't have crash from month or so...

brow42's picture
User offline. Last seen 1 week 2 days ago. Offline
Joined: 09/19/2011
Groups: None

I had another crash while setting up tracks of different alignments for 570. The alignment window was open and I had recently aligned but it was NOT locked. Crashed when made a new track. No log because I had multiple clients open. I have 8 GB 4 cores and an nVidia card.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

And it is the only app that are crashing (on many clients of the latest main version, these days) on my PC, no other are troublesome and I play Skyrim or other games for hours without problems, don't need to reboot for days/weeks if no windows update or other install requiring reboot :)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

latest dev: 2012-06-13-49440M-win_x86-devprev

core.pack.pack_rotamers: built 1307 rotamers at 4 positions.

UNHANDLED EXCEPTION
1: no symbol (no line)
2: no symbol (no line)
3: no symbol (no line)
4: no symbol (no line)
5: no symbol (no line)
6: no symbol (no line)
7: no symbol (no line)
8: no symbol (no line)
9: no symbol (no line)
10: no symbol (no line)
11: no symbol (no line)
12: no symbol (no line)
13: no symbol (no line)
14: no symbol (no line)
15: no symbol (no line)
16: no symbol (no line)
17: no symbol (no line)

jflat06's picture
User offline. Last seen 2 days 3 hours ago. Offline
Joined: 09/29/2010
Groups: Window Group

The log files don't seem to be particularly helpful. Are there any common elements in the crashes? Does it happen randomly or does it happen in response to something you've done?

We cannot debug this without more information.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

All crashes are occurring during minimized script runs. Never a crash during manual and/or maximize operations. Different puzzles and scripts.

Concerning the log files usefulness, are you talking about the ones like:

UNHANDLED EXCEPTION
1: no symbol (no line)
...

Or all of them, even those like:

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9562264 bytes (no line)
3: library_main +9562191 bytes (no line)
...

What more can I provide?

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

devprev: ...x2

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

On main:

core.scoring.NeighborList: Minimization stats: 110 score/deriv cals, 5 narrow-from-wide updates, 0 full updates.

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9579720 bytes (no line)
3: library_main +9579647 bytes (no line)
4: library_main +4987071 bytes (no line)
5: library_main +4992627 bytes (no line)
6: library_main +5005036 bytes (no line)
7: library_main +4470884 bytes (no line)
8: library_main +4467050 bytes (no line)
9: library_main +2674765 bytes (no line)
10: library_main +2535267 bytes (no line)
11: library_main +2538683 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

Joined: 05/19/2009
Groups: Contenders

I used to have problems like that years ago when running dev and main clients on one machine together. I would recommend you only run either devprev or main.

You should also test your main memory using a memtest boot CD. images are available for download on the net. I had a set of bad ram a month or two ago, with inexplicable reboots. Foldit will access a lot of memory and part of that may be faulty. I had only one bit in one region fault on me.

http://www.memtest86.com/download.html
or
http://www.memtest.org/

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

thanks Bletchley, I will try that

I had crash running either main or devprev clients alone. So far, I have had no other application crashing.

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

"core.scoring.NeighborList: Minimization" That seems to be recurring very often...

on Main:

core.scoring.NeighborList: Minimization stats: 15 score/deriv cals, 0 narrow-from-wide updates, 0 full updates.

UNHANDLED EXCEPTION
1: no symbol (no line)
2: no symbol (no line)
3: no symbol (no line)
4: no symbol (no line)
5: no symbol (no line)
6: no symbol (no line)
7: no symbol (no line)
8: no symbol (no line)
9: no symbol (no line)
10: no symbol (no line)
11: no symbol (no line)
12: no symbol (no line)
13: no symbol (no line)
14: no symbol (no line)

and on main:

core.scoring.NeighborList: Minimization stats: 263 score/deriv cals, 44 narrow-from-wide updates, 9 full updates.

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9579720 bytes (no line)
3: library_main +9579647 bytes (no line)
4: library_main +4987071 bytes (no line)
5: library_main +4992627 bytes (no line)
6: library_main +5005036 bytes (no line)
7: library_main +4470884 bytes (no line)
8: library_main +4467050 bytes (no line)
9: library_main +2674765 bytes (no line)
10: library_main +2535267 bytes (no line)
11: library_main +2538683 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

on main, almost always this type:

core.scoring.NeighborList: Minimization stats: 315 score/deriv cals, 76 narrow-from-wide updates, 4 full updates.

UNHANDLED EXCEPTION
1: RaiseException +88 bytes (no line)
2: library_main +9579720 bytes (no line)
3: library_main +9579647 bytes (no line)
4: library_main +4987071 bytes (no line)
5: library_main +4992627 bytes (no line)
6: library_main +5005036 bytes (no line)
7: library_main +4470884 bytes (no line)
8: library_main +4467050 bytes (no line)
9: library_main +2674765 bytes (no line)
10: library_main +2535267 bytes (no line)
11: library_main +2538683 bytes (no line)
12: BaseThreadInitThunk +18 bytes (no line)
13: RtlInitializeExceptionChain +99 bytes (no line)
14: RtlInitializeExceptionChain +54 bytes (no line)
at 10 positions.
core.pack.pack_rotamers: IG: 192172 bytes

bertro's picture
User offline. Last seen 3 weeks 3 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

on main: NEW data

Unhandled exception in thread 0A587470 (class interactive::application::Thread): Can't start thread. (..\..\..\rosetta_source\src\interactive\application\Thread.cc:52)

ERROR: Unhandled exception: Can't start thread.
ERROR:: Exit from: ..\..\..\rosetta_source\src\interactive\application\Thread.cc line: 201

and:

Unhandled exception in thread 0AF7A2E8 (class interactive::application::Thread): Can't start thread. (..\..\..\rosetta_source\src\interactive\application\Thread.cc:52)

ERROR: Unhandled exception: Can't start thread.
ERROR:: Exit from: ..\..\..\rosetta_source\src\interactive\application\Thread.cc line: 201

Sitemap

Developed by: UW Center for Game Science, UW Institute for Protein Design, Northeastern University, Vanderbilt University Meiler Lab, UC Davis
Supported by: DARPA, NSF, NIH, HHMI, Amazon, Microsoft, Adobe, RosettaCommons