BUNS crash while mutating on 1812

Case number:954892-2009066
Topic:Developer Preview
Opened by:LociOiling
Status:Open
Type:Bug
Opened on:Saturday, March 14, 2020 - 05:56
Last modified:Sunday, March 22, 2020 - 02:58

Running Mutate No Wiggle on 1812 in 20200302-4da6c7ec14-win_x86-devprev

UNHANDLED EXCEPTION
  1: interactive::rosetta_util::BuriedUnsatisfiedPolarsCalculator::recompute +1539 bytes (no line)
  2: interactive::rosetta_util::InteractiveCache::fill_meta_cache +361 bytes (no line)
  3: interactive::rosetta_util::ReferencePoseInfo::score_pose +663 bytes (no line)
  4: standalone::application::StandaloneApplication::score_pose +810 bytes (no line)
  5: game::application::GameApplication::push_undo +119 bytes (no line)
  6: interactive::application::actions::ActionReplaceResidue::on_instant_run +3701 bytes (no line)
  7: interactive::application::shared::ToolActionInstant::do_launch +81 bytes (no line)
  8: interactive::application::shared::ToolAction::launch +224 bytes (no line)
  9: standalone::application::run_action_and_wait +49 bytes (no line)
 10: standalone::application::luaV2_structure_SetAminoAcid +322 bytes (no line)
 11: luaD_precall +425 bytes (no line)
 12: luaV_execute +3242 bytes (no line)
 13: luaD_call +99 bytes (no line)
 14: lua_call +83 bytes (no line)
 15: luaD_rawrunprotected +76 bytes (no line)
 16: luaD_pcall +53 bytes (no line)
 17: luaL_newstate +7265 bytes (no line)
 18: luaD_precall +425 bytes (no line)
 19: luaV_execute +3242 bytes (no line)
 20: luaD_call +99 bytes (no line)
 21: lua_call +83 bytes (no line)
 22: luaD_rawrunprotected +76 bytes (no line)
 23: luaD_pcall +53 bytes (no line)
 24: lua_pcall +93 bytes (no line)
 25: interactive::application::shared::lua::LuaScripter::exec_string +93 bytes (no line)
 26: interactive::application::shared::lua::LuaExec::on_exec +88 bytes (no line)
 27: interactive::util::detail::checked_fxn_wrapper,std::allocator > const &)>::operator(),std::allocator > &,void (__thiscall interactive::application::shared::lua::LuaExec::*)(std::basic_string,std::allocator > const &),0> +79 bytes (no line)
 28: boost::detail::function::void_function_obj_invoker0,std::allocator > const &)>,boost::_bi::list2 >,boost::_bi::value,std::allocator > > > >,void>::invoke +34 bytes (no line)
 29: boost::function0::operator() +120 bytes (no line)
 30: interactive::util::Thread::thread_entry_func +69 bytes (no line)
 31: interactive::util::Thread::win32_thread_startup_helper +14 bytes (no line)
 32: BaseThreadInitThunk +25 bytes (no line)
 33: RtlGetAppContainerNamedObjectPath +228 bytes (no line)
 34: RtlGetAppContainerNamedObjectPath +180 bytes (no line)
(Sat, 03/14/2020 - 05:56  |  11 comments)


LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

Similar:

UNHANDLED EXCEPTION
  1: interactive::rosetta_util::BuriedUnsatisfiedPolarsCalculator::recompute +1539 bytes (no line)
  2: interactive::rosetta_util::InteractiveCache::fill_meta_cache +361 bytes (no line)
  3: interactive::rosetta_util::ReferencePoseInfo::score_pose +663 bytes (no line)
  4: interactive::application::actions::cart::PoseLoopThreadActionCart::update_game_pose_from_work_pose +797 bytes (no line)
  5: interactive::application::actions::cart::PoseLoopThreadActionCart::minimizer_pose_updater +792 bytes (no line)
  6: interactive::util::detail::checked_fxn_wrapper::operator() +76 bytes (no line)
  7: boost::detail::function::void_function_obj_invoker0,boost::_bi::list1 > > >,void>::invoke +28 bytes (no line)
  8: boost::function0::operator() +120 bytes (no line)
  9: interactive::util::Thread::thread_entry_func +69 bytes (no line)
 10: interactive::util::Thread::win32_thread_startup_helper +14 bytes (no line)
 11: BaseThreadInitThunk +25 bytes (no line)
 12: RtlGetAppContainerNamedObjectPath +228 bytes (no line)
 13: RtlGetAppContainerNamedObjectPath +180 bytes (no line)
LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

annuder one

UNHANDLED EXCEPTION
  1: interactive::rosetta_util::BuriedUnsatisfiedPolarsCalculator::recompute +1539 bytes (no line)
  2: interactive::rosetta_util::InteractiveCache::fill_meta_cache +361 bytes (no line)
  3: interactive::rosetta_util::ReferencePoseInfo::score_pose +663 bytes (no line)
  4: standalone::application::StandaloneApplication::score_pose +810 bytes (no line)
  5: standalone::application::StandaloneApplication::pose_edit +172 bytes (no line)
  6: game::application::GameApplication::pose_edit +117 bytes (no line)
  7: interactive::util::detail::checked_fxn_wrapper::operator() +76 bytes (no line)
  8: boost::detail::function::void_function_obj_invoker0,boost::_bi::list1 > > >,void>::invoke +28 bytes (no line)
  9: boost::function0::operator() +120 bytes (no line)
 10: interactive::rosetta_util::WrappedPose::call_edit_callback +218 bytes (no line)
 11: standalone::application::FilterWidget::run_filter_internal +278 bytes (no line)
 12: standalone::application::FilterWidget::run_filter_callback +48 bytes (no line)
 13: standalone::application::FilterWidget::enable_check_callback +171 bytes (no line)
 14: interactive::util::detail::checked_fxn_wrapper::operator() +90 bytes (no line)
 15: boost::detail::function::void_function_obj_invoker1,boost::_bi::list3 >,boost::arg<1>,boost::_bi::value > >,void,bool>::invoke +36 bytes (no line)
 16: boost::function1::operator() +123 bytes (no line)
 17: standalone::application::FilterWidget::set_filters_disabled +63 bytes (no line)
 18: standalone::application::StandaloneApplication::nli_set_filters_disabled +20 bytes (no line)
 19: standalone::application::luaV2_behavior_SetSlowFiltersDisabled +105 bytes (no line)
 20: luaD_precall +425 bytes (no line)
 21: luaV_execute +3242 bytes (no line)
 22: luaD_call +99 bytes (no line)
 23: lua_call +83 bytes (no line)
 24: luaD_rawrunprotected +76 bytes (no line)
 25: luaD_pcall +53 bytes (no line)
 26: luaL_newstate +7265 bytes (no line)
 27: luaD_precall +425 bytes (no line)
 28: luaV_execute +3242 bytes (no line)
 29: luaD_call +99 bytes (no line)
 30: lua_call +83 bytes (no line)
 31: luaD_rawrunprotected +76 bytes (no line)
 32: luaD_pcall +53 bytes (no line)
 33: lua_pcall +93 bytes (no line)
 34: interactive::application::shared::lua::LuaScripter::exec_string +93 bytes (no line)
 35: interactive::application::shared::lua::LuaExec::on_exec +88 bytes (no line)
 36: interactive::util::detail::checked_fxn_wrapper,std::allocator > const &)>::operator(),std::allocator > &,void (__thiscall interactive::application::shared::lua::LuaExec::*)(std::basic_string,std::allocator > const &),0> +79 bytes (no line)
 37: boost::detail::function::void_function_obj_invoker0,std::allocator > const &)>,boost::_bi::list2 >,boost::_bi::value,std::allocator > > > >,void>::invoke +34 bytes (no line)
 38: boost::function0::operator() +120 bytes (no line)
 39: interactive::util::Thread::thread_entry_func +69 bytes (no line)
 40: interactive::util::Thread::win32_thread_startup_helper +14 bytes (no line)
 41: BaseThreadInitThunk +25 bytes (no line)
 42: RtlGetAppContainerNamedObjectPath +228 bytes (no line)
 43: RtlGetAppContainerNamedObjectPath +180 bytes (no line)
bkoep's picture
User offline. Last seen 1 hour 53 min ago. Offline
Joined: 11/15/2012
Groups: None

Hi Loci, can you confirm that these crashes were in Puzzle 1812, and NOT the devprev puzzle?

The BUNS code is not supposed to be running at all unless the puzzle has a BUNS objective

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

Yes, these were all on puzzle 1812. (You won't see the devprev puzzle in my soloist profile.)

I stated the recipe incorrectly, all three crashes were in a descendant of Mutate Combo,
not Mutate No Wiggle.

I switched over to a Remix recipe, haven't seen any crashes from that.

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

Here's yet another one, in a Remix recipe this time:

UNHANDLED EXCEPTION
  1: interactive::rosetta_util::BuriedUnsatisfiedPolarsCalculator::recompute +1539 bytes (no line)
  2: interactive::rosetta_util::InteractiveCache::fill_meta_cache +361 bytes (no line)
  3: interactive::rosetta_util::ReferencePoseInfo::score_pose +663 bytes (no line)
  4: standalone::application::StandaloneApplication::score_pose +810 bytes (no line)
  5: standalone::application::StandaloneApplication::pose_edit +172 bytes (no line)
  6: game::application::GameApplication::pose_edit +117 bytes (no line)
  7: interactive::util::detail::checked_fxn_wrapper::operator() +76 bytes (no line)
  8: boost::detail::function::void_function_obj_invoker0,boost::_bi::list1 > > >,void>::invoke +28 bytes (no line)
  9: boost::function0::operator() +120 bytes (no line)
...and so on...

Log file attached.

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

Possibly related, I seem to be having issues with scoring between main and devprev.

I started a solution on devprev, and then moved it to main at 19389. It appears to have improved to
19503, but when I share that solution an open it devprev *or* main, it loads as 19228.

Perhaps there's a BUNS penalty being assessed when there shouldn't be, but that doesn't explain
why the solution also loads lower on main.

This seems like a throwback to a few years ago, when this type of scoring issue was common. Maybe
something got backleveled in the current release.

Solution shared with scientists as "shows 19503, but loads at 19228".

bkoep's picture
User offline. Last seen 1 hour 53 min ago. Offline
Joined: 11/15/2012
Groups: None

Thanks Loci for the feedback (and also for sharing with scientists)! This is super helpful!

We should be able to follow up on the score discrepancy more easily than the crash, and I'd guess that will probably lead us to the bug.

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

One more thing on the score discrepancy, some of it stemmed from the h-bond bonus dropping.

In several cases, the bonus was 1800 when I saved, but then opened at 1542.86.

I don't see any obvious difference in the networks, just a drop of 257.14 in the score.

That's most of the difference, but not all. One saved at 19585 and change opened at 19310.376,
a drop of 274.624. So another 17.484 points beyond the h-bond drop. Another pose saw an overall
drop of 274.655, for what it's worth.

I'll compare my print protein output next, and I did a few screenshots, which will be on
the wiki in due time.

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

OK, somehow between making the save and re-opening it, the bonding subscore of two segments (41 and 45) dropped by ~, 8.756, so a total drop of 17.513.

Combined with the 257.14 drop in the filter score, that's a total drop of 274.663.

The original score was 19652.571, which loaded as 19377.916, so a drop of 274.655. I'll call the difference a rounding error.

Shared with scientists as "19652.571 (saved as)".

LociOiling's picture
User offline. Last seen 1 hour 3 min ago. Offline
Joined: 12/27/2012
Groups: Beta Folders

Also shared "19652 (loads ok)". I had restarted the client in question. The high score reloaded.

I made several saves with different camera positions.

These opened normally in another client, the client where the previous solution had loaded lower.
This is the client used for in-game chat. Restarting this client had no effect. The first save still
loads lower, and the subsequent saves load at their original score.

So perhaps there is some subtle difference between "19652.571 (saved as)" and "19652.571 (saved as)" that's
down to making a save after running recipes for around 24 hours.

neilpg628's picture
User offline. Last seen 22 hours 50 min ago. Offline
Joined: 08/01/2019
Groups: None

That's possible.
I've been looking at the Rosetta scoreterm energies, and there are discrepancies between the cached values in the shared solution and the values when the pose is
scored in a new client. These differences are independent of objectives, and so I think there are inconsistencies in the process of calculating the raw score.

Sitemap

Developed by: UW Center for Game Science, UW Institute for Protein Design, Northeastern University, Vanderbilt University Meiler Lab, UC Davis
Supported by: DARPA, NSF, NIH, HHMI, Amazon, Microsoft, Adobe, RosettaCommons