Foldit partition went from 10 gigs to 20 gigs of useage since Saturday.

Case number:954892-993083
Topic:Developer Preview
Opened by:Hanto
Status:Closed
Type:Bug
Opened on:Monday, July 2, 2012 - 20:55
Last modified:Saturday, July 7, 2012 - 15:33

I woke on Saturday to find all my clients crashed having used up all my 10 gigs allotted to the partition. I got it cleaned up finally, and then doubled the size of the foldit partition to 20 gigs, and started playing again. Now as of 15 minutes ago, I'm being warned of low disk space on foldit partition. Lo and behold when examining the partition I was left with only 30 MEGS of space. I would have crashed again, had I not caught this just in the nick of time.
Doing virus scans now with AVAST, which dearly love, but in the mean time is it possible that the devprev release in the last release might have a bug causing files to increase in number greatly. Last time I saw something like this was with Norton Antivirus 2003 or so, it had a bug that would do the same thing, far worse the most viri and trojans.
Thanks for checking

(Mon, 07/02/2012 - 20:55  |  36 comments)


Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

P.S. If the bug does exist, what am I going to do to get my space back, and don't me I have to wipe and re-install, not a good answer.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

P.S. If the bug does exist, what am I going to do to get my space back, and don't me I have to wipe and re-install, not a good answer.

tamirh's picture
User offline. Last seen 8 years 25 weeks ago. Offline
Joined: 05/11/2012

Hi Hanto,

It looks like the autosave feature may not be deleting the temporary files it uses to ensure saves are not corrupted. That would fill up your hard drive after a while.

If you go into the puzzles folder, you should be able to find out where the errant files are. Once you do, if you could take a screenshot or tell us the filenames that would help out in figuring out what happened.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Default subfolders on some of my puzzles ( suspect the ones I'm currently working ) have grown to tremendous sizes, in one case to over 2 gigs. The are full of temp files, where the puzzles that I am not working seem to have ONLY decent file names that seem to be related to the Foldit program.

Joined: 09/20/2010
Groups: Go Science

My puzzle directory for 588 (0000993072) is 1.6 GB and I have 13,543 files with names like autFFF7.tmp (107 Kb each) and 2,003 files with names like quiFFF0.tmp (also 107 Kb each). The four autosave files only add up to 427 Kb. If I close out any clients that are running puzzle 588 can I delete these *.tmp files?

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

I'm gonna delete them anyway, besides temp files should go in a TEMP folder!!!!

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

In all honesty tho, Foldit admins should be writing a program to clean these temp files off our drives. We shouldn't have to do it manually.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

In all honesty tho, Foldit admins should be writing a program to clean these temp files off our drives. We shouldn't have to do it manually.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

I recovered over 9 gigs by just deleting the /default/*.tmp files on one of my clients. I'm gonna restart all my clients and see if they work, as I did not close them during this operation.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

I've recovered my system, and all clients currently working. I did perform saves and recover from saves while performing this action, but to truthful when I deleted the .tmp files, I also deleted the default files that should have remained in the folder, that is why tmp files should be a TEMP folder and controlling files outside the TEMP folder.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

I did keep my clients open while performing my deletes on the default subfolder, because I didn't want to risk deleting a file-in-use. everything is now working from the Credit Bests that I performed before deleting .tmp files, but on at least some of my default folders, I have lost the controlling files that should always be there. That's a easy fix tho, I'm a bit afraid that I might accidently create a credit best from one puzzle onto a puzzle it doesn't belong to...

bertro's picture
User offline. Last seen 16 weeks 4 days ago. Offline
Joined: 05/02/2011
Groups: Beta Folders

like pauldunn said.

tamirh's picture
User offline. Last seen 8 years 25 weeks ago. Offline
Joined: 05/11/2012

It is safe to delete the .tmp files, they should have been deleted automatically but you hit a bug where they are not. I've found the bug and I'll push out a fix for it as soon as possible.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Thank you very much tamirh. By the way, the buttons to register how well an answer is appreciated should not be by the reply button. I can't change it now, sorry for the wrong button push. These Logitech expensive mice have some real switch problems.. Gone thru three of them over the few months..

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Thank you very much tamirh. By the way, the buttons to register how well an answer is appreciated should not be by the reply button. I can't change it now, sorry for the wrong button push. These Logitech expensive mice have some real switch problems.. Gone thru three of them over the few months..

tamirh's picture
User offline. Last seen 8 years 25 weeks ago. Offline
Joined: 05/11/2012
Status: Open » Closed

Haha, no worries. Yes there are definitely some odd behaviors with the interface on the forums/feedback pages.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Just a little add-in, the fix you provide should replace the default files that were in the proper ' Default ' sub-folder to puzzles. Thanks again.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

In fact, any fix should include auto-deleting all those temp files. I know you realize this already, but sometimes people forget. Needless to say, I'm senile myself, and loving it. Great excuse for some of the stuff I pull.

Joined: 05/19/2009
Groups: Contenders
Status: Closed » Open

Done to Ongoing as this is NOT resolved in the field and when status is DONE it is not visible to people checking for this bug. I have thousands and thousands of files in my filesystem because of it.

Please change status to DONE only after:
1. There is a real bugfix and
2. That fix is actively being pushed and
3. The push and the bug are announced in the messages / blog on the foldit website.

This will corrupt data for other applications as well in case the disk runs full. People will not be aware of what is causing it. If you run this on a work related PC you're in trouble !

Joined: 05/19/2009
Groups: Contenders

This workaround may save trouble: switch to clients in 'main' rather than 'devprev'. The currently existing tmp files will not be deleted, but no new ones should appear.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

BP is absolutely correct, I came home from partying and found ALL of my clients done, ie. QUIT. When I looked at Foldit partition, I saw that it was AGAIN at 20 gigs of space, i.e there was NO MORE available for the clients in questions. I DON"T consider this to be DECENT behavior on the part of the client or for the programmers creating that clients, you create problem, NO-ONE goes home until problem is PROPERLY fixed, if the military behaved this way, there would be NO victories for the HOME team... Either you are dedicated or you are NOT. So simple, it sounds like idiocy, it's NOT, it is the truth. This is a programmer created issue, I EXPECT a programmer to fix it, BEFORE HE/SHE GOES HOME.. You don't like my attitude, get a different job.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Just so you know, there will need to at LEAST a 24 hour period, and most likely a 48 hour period to compensate for this problem. Some of you might consider it fun to play around with DevPrev users, Those people need to be released from their duties..

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

It all comes back to QA ( Quality Assurance ). Personally I want to know why releases are being made without proper QA. It doesn't take much knowledge of a HD ( hard drive ) to figure out that a particular release is TAKING FAR TO MUCH SPACE. Right now, as much as I love this game for many, many reasons, I have NO love of the people creating it, which is an ABSOLUTE SHAME.

Joined: 05/19/2009
Groups: Contenders

**** How to switch to the main group: ****

1. STOP all running clients. There will be a software update after you change to the main group. For that, all clients must be stopped and exited.

2. find the foldit directory. Most windows PCs will have a foldit directory that contains specific files, you can use the windows explorer search function to locate those files.
Search for a file called "all.macro", this will get you to the foldit directory.

3. In the foldit directory, locate the file named "options.txt" and edit it in Notepad

4. Search for the line that startes with the text "update_group"
It will either have : "main" or : "devprev" following it on the same line.
If it has "main", you are done. You are not affected.
If you have "devprev", change it to "main" and save the options.txt file.

5. restart your FIRST client. Do NOT start multiple clients yet, you will receive a software update.

6. let the program update itself and restart itself.

7. After it restarts, you may start new clients.

In due time the Foldit team will have to release a fix for the devprev version and a tool to remove the possibly thousands of .tmp files on your system.

Good luck, Bletchley park.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Sorry BP, I appreciate your response, it is ' good enough ' for most people, however Foldit admin has made this issue paramount. I will not be changing to Main for ANYBODY's sake. Fix the DevPrev and NEVER let it happen again. That is called QA. Your response it good enough for those that want to continue their runs, however it doesn't solve the REAL issues. I spent 20 hears in the Navy as a Team player, I expect the same from those that pretend to be interested in the results from Foldit.
Thank you BP.

tamirh's picture
User offline. Last seen 8 years 25 weeks ago. Offline
Joined: 05/11/2012

What I've tended to do is go from open->done when the bug is fixed and checked in. I will try to mark feedback some other way if marking as done is causing problems

When the fix goes out to DevPrev it should go from done->resolved and then to closed once it has been regressed.

tamirh's picture
User offline. Last seen 8 years 25 weeks ago. Offline
Joined: 05/11/2012

The fix has a flag added to the options.txt which will sweep the folders for the temporary files and delete them.

The bug came up because of the different code path that Windows has to take for autosave. Most of my testing is done in Linux where the bug didn't show up. When I tested the fix on a Windows machine, I didn't notice the temp file buildup. I didn't run through extensive quicksaves/autosaves which would cause a significant amount of the temp files to accumulate.

Again, sorry about all the autosave issues. The bug reports helped track down what exactly was happening quickly.

Joined: 06/24/2008
Groups: Void Crushers

Bugs suck; however the reason that devpre exists is to help catch the bugs before the new code incorporated in Main. "Devpre" is part of the Q&A of Foldit. Those of us running Devpre are doing so to help vet the code and yes we will get eaten by bugs. We need to report the bugs but we shouldnt be surprised when we get hit by them that is the reason we are running Devpre.

Susume's picture
User offline. Last seen 2 days 6 hours ago. Offline
Joined: 10/02/2011

I am concerned that on machines where many gigabytes of files have accumulated, the client may take several minutes to delete them, and may appear hung in the meantime. (I know deleting them manually through file manager takes a long time; idk if doing it programmatically will too). I wonder if the developers can test whether that will happen, and post a warning about it for people accepting the update when it comes out.

I am also dismayed that no notice about this bug and the need to switch to main until it's resolved has been added to the news or the front page, given how serious the consequences can be.

jflat06's picture
User offline. Last seen 1 week 2 days ago. Offline
Joined: 09/29/2010
Groups: Window Group

If you need to get rid of the files, and you don't to go through the file manager, there is a command line solution. Please note that you should NOT use this if you are unfamiliar with the windows command line, and there's the potential it may mess up your computer. If you choose to use this, I am not responsible for any problems it might cause. It would also be a good idea to stop all clients before running this.

1. Hit [Windows-Key]-R This will bring up the run dialog
2. Type cmd and hit enter
3. Navigate to the Foldit directory using the cd command. If you installed to the default directory (C:\Foldit\) then you can get there by typing cd \Foldit\puzzles\ . If this step fails, or you cant locate your Foldit installation, do not continue.
4. Now type del *.tmp /s

This should get rid of all the tmp files for all puzzles in all tracks.

B_2's picture
User offline. Last seen 6 years 31 weeks ago. Offline
Joined: 11/29/2008
Groups: None

When will the fix for this be released? An actual date would be nice, not just "... in the next 'devprev' release".

beta_helix's picture
User offline. Last seen 1 hour 49 min ago. Offline
Joined: 05/09/2008
Groups: None
Status: Open » Closed

Update released: http://fold.it/portal/node/993109
Please re-open this if you still have issues in devprev.

Again, thanks to everyone who uses the devprev client to catch these bad bugs.
Without your thorough testing across all three platforms, these nasty bugs wouldn't get caught until they reached main!

We appreciate you all "taking it for the team" and apologize for how particularly nasty this bug turned out to be for many of you.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

25 minutes of running multiple clients with NO added tmp files, i.e. my concern is fixed. Foldit partition back to 10 gigs and defragged. Should be fine for the duration, at least until next devprev release..

Thanks guys, all of you. But I am wondering what you did with the tmp files???

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

I am seeing reductions in free space and increases in used space, but will assume at least for the moment that what I am seeing might be quick saves. Assuming this behaves as it always has in the past, I should have no difficulty with it.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Over-night space used went from 2.28 gigs ( after complete clean-up of all .tmp files) to present value of 2.32 gigs. I'm pretty sure that .04 difference is around 40 MBs and a utterly huge improvement over the previous devprev which would have increased by nearly 2 gigs by this time.

Hanto's picture
User offline. Last seen 7 weeks 19 hours ago. Offline
Joined: 05/10/2008
Groups: None

Over-night space used went from 2.28 gigs ( after complete clean-up of all .tmp files) to present value of 2.32 gigs. I'm pretty sure that .04 difference is around 40 MBs and a utterly huge improvement over the previous devprev which would have increased by nearly 2 gigs by this time.

Sitemap

Developed by: UW Center for Game Science, UW Institute for Protein Design, Northeastern University, Vanderbilt University Meiler Lab, UC Davis
Supported by: DARPA, NSF, NIH, HHMI, Amazon, Microsoft, Adobe, Boehringer Ingelheim, RosettaCommons