Portal Home > Knowledgebase > Articles Database > Just a large Gallery2 site..
Just a large Gallery2 site..
| Posted by Ophelus, 05-12-2008, 11:54 AM |
| I'm strained with about a dozen problems.. that I'm not used to cause I'm going from colocation to webhosting..
I have a 20k photo site I want to put up.. (that is mostly for personal use, not really expected much processor/bandwidth requirements at all after initial setup)
And I just have numerous issues with it.. the main issue is that Gallery2 won't complete say a high photo add-in of 1k to 2k of photo's.. it will actually do most of the work (like folders/files will be created) but it will just end with a corrupt database error (it will do lesser just fine)
I don't know if this is caused because there is not enough resources? (shared webhosting.. dreamhost is host).. or just gallery2 going crazy by bad configuration or missing a particular setting or whatnot.. (I seem to have gotten this to work mostly fine on my own servers and yes I have seen a lot of cpu/hard drive use during the workings of the scan)
In addition to all that I have one slight other problem and that is that my upload intermittently goes out during particular hours (seems to knock itself out every 10-15 seconds) and this is 20k of pictures I'm trying to add or about 200 Gb of data
So I look at this logically and I come up with these strange scenarios as fixes all highly technical and over-complicated..
1. Setup a temp server to create the site the way it's supposed to be and then re-upload everything using sftp/scp or something that will resume easily in unix shell on intermittent internet connection (bare in mind I've already uploaded at least half the data already.. which has taken well yah know months)
2. Somehow borrow cpu cycles (from a idle) web server I have to compensate for possible not enough from my current provider etc. (I'm not even sure if this is possible)
3. Find a Gallery2 client app that will resume uploads and handle 200 Gb of effortless data
4. Fix the existing problems with the scan (more then likely by hiring a admin if someone can't help out here.. and may ultimately achieve nothing if it's hosts fault or gallery2 problems)
Last edited by Ophelus; 05-12-2008 at 12:02 PM.
|
| Posted by RSkeens, 05-12-2008, 12:29 PM |
| Hi,
Gallery2 is pretty notorious for causing high CPU loads - I am very surprised DreamHost allows you to run such a huge site (maybe there is little traffic).
Hiring an administrator would be of no use - the server is shared. You may want to look into hiring a professional script manager / programmer to rectify any issues, but from what I estimate it is mainly the load created by uploading so many photos in succession.
Good luck!
|
| Posted by Ophelus, 05-12-2008, 01:32 PM |
| I'm not really uploading photo's persay.. I am creating whole directory's of my photo's and after there complete I scan them in.. I don't use anything other then gallery's scan a directory portion.. and when gallery2 would be doing this said scan it would copying the photo's not uploading them..
Last edited by Ophelus; 05-12-2008 at 01:44 PM.
|
| Posted by reasonpolice, 05-13-2008, 03:44 AM |
| You can ask on the gallery forums. . .make sure you're not generating the thumbs when you add the items. but sounds like you need to add in smaller chunks, scripts may be timing out
|
| Posted by Ophelus, 05-13-2008, 07:38 PM |
| Well, the problem is smaller chunks.. adding say 500 pictures or less at a time is a lot of work.. not to mention doesn't help out my directory structure much..
Usually my posts on g2 forum go unreplied.. but thanks..
I have a smaller folder that appears to be 8,000 files I think I managed to get that one done in 3-5 smaller sections.. that means holy hell for me with a folder that's more like 25,000 files.. maybe I got my estimate wrong on exactly how many pictures and movies are in 200 Gb
I also believed I've tried without thumbnails.. but I can try again..
Last edited by Ophelus; 05-13-2008 at 07:45 PM.
|
| Posted by jumpinjack, 05-14-2008, 08:47 AM |
| There is no way you can add that many pictures at once with Gallery2, especially on a shared server.
I have a dedicated server Quad Core Xeon with 4GB of ram and if I try to add over 2000 pictures at a time there will be problems, timeouts etc, and that means a lot of work clearing up what was added.
I try to only add less than 500 pics in one go. It takes longer but at least I know that it is going to work.
|
| Posted by Ophelus, 05-14-2008, 08:15 PM |
| I've done it before on my own dedicated; it can be done.. yah the page times out in the browser but I think I've done about 14k worth at minimum of 1 shot.. and yah I watched top run for hours.. (as I recall I had to tweak maybe php.ini for like 1 Gb of shared memory and other things)
What’s interesting to note is, it is doing it.. the thing just is completing I’d say 90% of the work is done and then viola it doesn’t finish it.. I should know since once I try to re-add it, it fails and I have to systematically delete data and files to make another go of it..
Last edited by Ophelus; 05-14-2008 at 08:19 PM.
|
Add to Favourites 
Print this Article
Also Read
Shared Hosting
Shared Hosting
