| DNS changes |
[Jul. 11th, 2009|04:04 pm] |
|
We're updating DNS servers this weekend. You shouldn't notice any changes, but just in case... |
|
|
| Site down (unknown reason) |
[May. 12th, 2009|05:47 pm] |
VGMusic is currently down. I'm looking into the matter now.
5:53pm EDT/10:53pm UTC: I can't log into the old EV1Servers customer portal, and the new one is not responding either.
5:58pm EDT/10:58pm UTC: Word on The Planet's boards is that The Planet is experiencing a widespread outage.
6:03pm EDT/11:03pm UTC: The Planet's bandwidth graph (may be down) shows a huge drop in incoming and outgoing traffic. The Planet's staff has yet to comment. If you can't view the bandwidth graph, incoming drops from 6.9Gb/s to 3.6Gb/s.
6:09pm EDT/11:09pm UTC: The Planet's twitter feed confirms that 3 datacenters are experiencing outages, including H2 (where VGMusic.com is located).
6:18pm EDT/11:18pm UTC: The site is back up. |
|
|
| OS Upgrade complete |
[Feb. 23rd, 2009|08:14 pm] |
It's a good thing, too, as my Internet connection is destabilizing.
If you see any problems, we have a forum topic on the News board about it. Staff have an additional topic on our Staff board to discuss back-end problems. |
|
|
| OS upgrade |
[Feb. 23rd, 2009|06:49 pm] |
As mentioned on our site, I'm going to be doing an OS upgrade on the server tonight.
During this time, the website may go down. If it's not back in a few hours, you have my permissions to panic.
I will begin the upgrade process in about 10 minutes (7:00pm EST / midnight UTC / 4:00pm PST) after some backup files finish downloading. |
|
|
| DNS has been updated |
[Jun. 5th, 2008|05:16 pm] |
This should mark the end of this week's major downtime run. The server is back online and DNS is updated.
If you still can't connect to the site, you can temporarily use http://new.vgmusic.com/ - a new subdomain that will resolve to the new address. |
|
|
| Server is up |
[Jun. 5th, 2008|08:35 am] |
|
...however, DNS changes are not currently being made. We are looking into our options for getting that up and running. |
|
|
| Server IP? |
[Jun. 4th, 2008|11:46 pm] |
| [ | Current Mood |
| | angry | ] | I'm not sure what's going on over at The Planet.
The server is going to be at IP 74.55.70.254, accessable temporarily at http://74.55.70.254/ or http://new.vgmusic.com/ (if DNS is actually being updated after all the past problems)... whenever they get the server back online with the new IP.
The last status update was "Server has been transported to our H2 facility at this time. Please standby for further updates as the server is configured with an IP and is placed on the network ." at 7:13pm EDT. At 10:20pm EDT, I added a note to the ticket expressing my concerns at not hearing back from them. It's now 11:50pm EDT, and I'm about to head to bed.
Mike is expressing interest in upgrading to a better server. If we do, I'm going to suggest that we may want to switch hosts as well. |
|
|
| The server have started to move |
[Jun. 4th, 2008|05:56 pm] |
The server is currently being moved from the H1 to the H2 datacenter.
Which should have been done yesterday... |
|
|
| Moving to H2 datacenter? |
[Jun. 3rd, 2008|01:13 pm] |
We've filed a request to be moved to The Planet's H2 datacenter, as per the 10:15am post on The Planet's service update site.
In other news, they tried to fix the generator being used for Phase 1 of the datacenter we're currently in, but couldn't. Another generator is scheduled to be brought in, but hopefully we'll be moved to H2 before too long.
Update 01:58pm EDT: The ticket has been updated to a proper Move ticket. Unfortunately, I don't know the status of the actual move.
The server will be assigned a new IP when it is finished transferring. This may cause a delay as DNS propogates. I will, however, post a link to the server's new IP when it becomes available. |
|
|
| ...aaaand back down |
[Jun. 3rd, 2008|07:12 am] |
The Planet is having some problems with the backup generators powering Phase 1 (read: floor 1) at its H1 datacenter.
As I concluded earlier, VGMusic is on floor 1.
At this time, servers are up, but routers are not, making said servers inaccessable. |
|
|
| Server back up, but... |
[Jun. 2nd, 2008|06:16 pm] |
|
The server is back up, but it was stated yesterday that the first floor of the datacenter may be on emergency power. Meaning that the server may go down again prior to the switch back to main power. |
|
|
| Status update |
[Jun. 2nd, 2008|07:10 am] |
The Planet has all servers on the second floor of their data center up and running again.
I can only assume this means VGMusic's server is one of those on the first floor and won't be up until sometime this evening. |
|
|
| New ETA |
[Jun. 1st, 2008|02:19 pm] |
| [ | Current Mood |
| | annoyed | ] | According to word from The Planet, customer systems will not start being brought back up until around 10pm CDT / 4am UTC. |
|
|
| Unexplained downtime at The Planet (server host) |
[May. 31st, 2008|07:28 pm] |
VGMusic is currently down.
Updated 2008-05-31 11:36pm EDT / 2008-06-01 03:36 UTC The datacenter that hosts VGMusic's machine had a transformer fire. Our host, The Planet, was required by the fire department to shut down all power to the datacenter.
It is not clear when power will be restored. Barring any bad luck, our server should come up automatically when power is restored.
Source: The Planet's forums |
|
|
| DNS is down |
[Apr. 12th, 2007|11:59 am] |
The Planet has had a problem with the DNS servers our site uses. This means that the site is inaccessible by domain name.
You can presently access the site through its IP address.
Edit: DNS is back up. |
|
|
| Back Online |
[Dec. 3rd, 2006|09:38 am] |
|
The site is now back online, although there are a few things that are not functioning. |
|
|
| Filesystem problem |
[Dec. 1st, 2006|01:42 pm] |
| [ | Current Mood |
| | annoyed | ] | We're currently dealing with a file system problem. During the meantime, the site will be down.
Friday
1:00pm EST (approx): I reboot the server after seeing strange behavior from the system. When the system comes back up, it does so with the main hard drive in read-only mode because of a file system (journal playback) error on boot.
1:25pm EST: I'm currently downloading site backups, as FTP seems to be working OK. This will take some time.
2:20pm EST: I ran a file system check and fixed some errors. Now the file system's REALLY screwed up. Trying to shut the system down tried to run one of the site's text files.
2:30pm EST: I have posted a trouble ticket with our host... most likely the first in a chain of them in order to get things restored. Having done this before, I know I can't just ask for a server restore or hardware replacement (Hard Drive) or they'll want me to pay for it.
3:16pm EST: EV1 changes my check system request to a Reboot request. I have no idea why, but they say they'll investigate if it doesn't come back up.
3:31pm EST: Server has been sent to Investigations.
4:56pm EST: Investigations says the kernel isn't booting. No surprise there. They recommend restoring the system. Unfortunately, this takes 3-24 hours unless you're willing to pay more.
5:25pm EST: Ordered a System Restore (Sorry, I was taking a short nap during the above time).
6:11pm EST: Customer Service has stated "We will begin imaging a new drive to be used for the restore and will be taking your server offline shortly. Please standby for further updates." If it's the drive that was the problem, that should fix it. If it was the IDE controller...
7:51pm EST: The server is finally up, although I didn't know it yet.
8:30pm EST: Reinstalling OS.
11:30pm EST: Forgot to install the network driver when switching kernels, leaving networking disabled.
11:45pm EST: Asked for a KVM to be connected to the system so I can fix the previous problem.
2:00am EST: Still having no response from EV1Servers about the KVM deal, I call it a night
Saturday
10:45am EST: I'm back up and waiting on data center again.
Noon EST: Nothing yet, taking a nap.
1:00pm EST: Change trouble ticket type in hopes they'll at least acknowledge it.
Played Sam & Max: Hit the Road for a bit while waiting for EV1.
3:15pm EST: After no acknowledgement after ticket was updated, I've submitted a new trouble ticket. We'll see if that gets us anywhere. Tonight is the night my friends usually stop over, so it'd be nice if the server is finished by the time they get here.
5:20pm EST: Investigations has reported that the system wanted a manual file system check. Needless to say, the system requesting a file system check the first time a partition is booted from is abnormal and may indicate a hardware problem. If so, the site's return may be further delayed.
10:20pm EST: The server is now operational, but backups have not yet been transferred to the server. I will begin transferring those as soon as I get the initial system up and running... and booting from the correct drive every time.
11:00pm EST: Beginning to upload backups... estimated transfer time on the main backup is 2 hours. However, I'm likely to be asleep by then.
8:30am EST: The files finished transferring while I was asleep. Now bringing the site online.
9:10am EST: The site is now online.
ETA: Site now online |
|
|