网站全新改版,使用全新主题,精简文章,重新分类。同时建议大家使用FireFox、Opera、Safri、IE9+等高级浏览器访问!

网站服务器宕机八小时后终于恢复

Wordpress 木华澄 4323℃ 0评论

核心提示:这篇文章详细讲述自己的博客从中午三点四十五分左右发现自己的网站无法访问,联系客服后得知是服务断电后,到30日凌晨两点二十分恢复的整个过程。

发现宕机

从中午三点四十五分左右发现自己的网站无法访问,我以为是短暂的问题,刷新了几次,没有解决问题。因为之前有过ixwebhosting宕机达二三十分钟,所以我也没有非常的在意。但是等到四点半时,我在此访问自己的网站,还是无法访问,这下我觉得大事不妙,立即和ixwebhosting客服联系,被告知,由于断电的原因,正在积极修复,估计一个小时后就可以正常。

等到六点,期间多次尝试都无法访问,又再次联系客服,为了便于交流,前面的两次客服都是中文客服,都是被告知, ixwebhosting机房突然断电,正在积极处理,询问多久处理好时,还是被告知,一个小时左右,我勒个去,到底多少个一个小时啊!

宕机原因

等到晚上九点时,中文客服已经不在线,就连线了ixwebhosting的美国官方网站,联系他的24小时客服,美国客服的态度相当的好,询问了我的域名,被告知

Our power is restored and servers are coming back online, this process will take some time as the drives go through file system checks.  We sincerely apologize for this outage, and will release a post mortem once we have full information.  Commercial power has been intermittent over the past week as high temperatures have caused strain, but our UPS and Generator systems were handling it until this morning.  We are unable to currently explain why there was a failure this morning.

(我们的电力系统正在修复中,服务器正在恢复上线,这个过程需要一段时间,因为硬盘需要进行文件系统检查。我们真诚的为这次中断道歉,并且我们会对这次中断进行一次全面的剖析已获得全面的信息。商业电力在过去的一周里面由于高温一直断断续续,但是我们的UPS和发电系统一直让服务器保持了良好的状态直到今天早上(美国东部时间和中国有12个小时的时差,美国东部时间EST为-5,中国为+8,现在夏令时和中国的时差为慢北京时间12个小时, 所以这里就是中国的下午)。我们目前也无法解释为什么早上(我们的电力系统和UPS、系统)会宕机。)

并且紧接着,给我发送了一个网址http://status.ixwebhosting.com,我登录后发现这是ixwebhosting的所有服务器出现问题以及处理的记录,第一条,也就是6月29日的日志,就是在说所有的ixwebhosting服务器全部因为电力原因中断。仔细进行了阅读。发现里面说到了服务器的代号,但是我不知道我的网站是放在哪个服务器上,所以进行了询问,得知自己的服务器代号后,就一直关注着自己的服务器update状态,如下是整个ixwebhosting的处理过程。

ixwebhosting处理经过

Power Failure

Posted In: Outage — Jun 29th, 2012 at 6:00 am EST by IX: Robyn M.

Incident Description:

Our power is restored and servers are coming back online, this process will take some time as the drives go through file system checks.  We sincerely apologize for this outage, and will release a post mortem once we have full information.  Commercial power has been intermittent over the past week as high temperatures have caused strain, but our UPS and Generator systems were handling it until this morning.  We are unable to currently explain why there was a failure this morning.

Which Customers are Impacted?

All customers.

How are Customers Impacted?

Everything will be down.

How often will we be updated?

Every 30 minutes.

Time to Resolution (ETA)

We will post an ETA once we have more information.

Incident Updates

  • 06/29/2012 6:00 AM EDT – Name servers are back online. All servers are booting and running file system checks.
  • 06/29/2012 6:33 AM EDT – Some servers are now online and all servers are continuing to restore. Email is NOT up at this time, message will bounce back to sender, which usually results in the sending server to try again later.
  • 06/29/2012 6:45 AM EDT – All Internet Gateways are up and fully functional
  • 06/29/2012 6:55 AM EDT – Ironport mail gateways are back up, mail should be spooling, (so will not bounce), but will not be delivering until mail servers finish boot.
  • 06/29/2012 7:21 AM EDT – All CP 9 mail servers are online, all CP10 mail servers are online except mail 1017
  • 06/29/2012 7:25 AM EDT – All CP 9 & 10 web, database, and mail servers are up with the exception of mail 1017 which is undergoing file system check and should be up shortly
  • 06/29/2012 7:36 AM EDT – All CP11 mail and database servers are online
  • 06/29/2012 8:12 AM EDT – 65% of CP11 webs are online, rest are in fsc
  • 06/29/2012 9:04 AM EDT – BIG LINUX UPDATE:
    • All CP6 linux servers are up except: mysql303, web301, web304, web306, web307, mail303, mail308 (FSCK), mail309
    • All CP7 linux servers are up except: mysql405, web406, web422
    • All CP8 linux servers are up except: mail500, mail501, mail505, mail509, web602, whbpgsql501, whbweb500
    • All CP9 linux servers are up 
    • All CP10 linux servers are up 
    • All CP11 linux servers are up except: ns21, ns22, web1109, web1112, web1114-1116, web1120-1134
    • All CP12 linux servers are up except: mail1217, mail1215, web1231, web1232, web1233, web1234, web1235, web1236, web1237, web1238
    • All CP13 linux servers are up except: mail1301-1320,ns25, ns26,web1301-1337
    • All CP14 linux servers are up except: mail1401-mail1425, web1401-1439
  • 06/29/2012 9:07 AM EDT – ALL PUBLIC CLOUD ONLINE
  • 06/29/2012 9:10 AM EDT – BIG WINDOWS UPDATE
    • All CP6 Windows servers are up except: mssql300, iis301, iis303, iis305
    • All CP7 Windows servers are up except: mssql401
    • All CP8 Windows servers are up except: iis500cf, iis504, iis505, iis506, iis509, iis511
    • All CP10 Windows servers are up except: mssql1006, iis1001, iis1004
  • 06/29/2012 9:12 AM EDT – Windows VPS Nodes up except for: vwz5
  • 06/29/2012 9:42 AM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: mysql303, web304, web306, web307, mail303
    • All CP7 linux servers are up except: web406, web422
    • All CP8 linux servers are up except: mail500, mail501, mail505, web509, web602
    • All CP11 linux servers are up except: web1102, web1109, web1112, web1114-web1116, web1120-web1130, web1132, web1133
    • All CP12 linux servers are up except: mail1215, web1215, web1231-web1238
    • All CP13 linux servers are up except: mail1301-mail1320, web1301-web1317, web1319-web1337
    • All CP14 linux servers are up except: web1401-web1407, web1409-web1430
  • 06/29/2012 9:44 AM EDT – WINDOWS UPDATE
    • All CP5 Windows servers are up except: iis132
    • All CP6 Windows servers are up except: mssql300, iis301, iis303, iis305
    • All CP7 Windows servers are up except: mssql401
    • All CP8 Windows servers are up except: iis500cf, iis504, iis505, iis506
    • All CP10 Windows servers are up except: mssql1006, iis1004
  • 06/29/2012 9:49 All Linux VPS Nodes up!
  • 06/29/2012 10:19 AM EDT – Windows VPS Nodes up except for: vwz5
  • 06/29/2012 10:22 AM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: web304, web307, web308
    • All CP7 linux servers are up except: web406, web410, web422
    • All CP8 linux servers are up except: mail500, mail501, mail505, web509, web602
    • All CP11 linux servers are up except: web1102, web1109, web1112, web1114-web1116, web1120-web1130, web1132, web1133
    • All CP12 linux servers are up except: mail1215, web1215, web1231-1238
    • All CP13 linux servers are up except: mail1301, mail1302, mail1305, mail1308-mail1320, web1301-web1317, web1319-web1337
    • All CP14 linux servers are up except: web1401-web1407, web1409-web1430
  • 06/29/2012 10:33 AM EDT – WINDOWS UPDATE
    • All CP6 Windows servers are up except: mssql300
    • All CP7 Windows servers are up except: mssql401
    • All CP8 Windows servers are up except: iis500cf, iis504, iis505, iis506
    • All CP10 Windows servers are up except: mssql1006
  • 06/29/2012 10:39 AM EDT – Windows VPS Nodes up except for: vwz5
  • 06/29/2012 10:55 AM EDT – Windows and Linux VPS Nodes up!
  • 06/29/2012 11:30 AM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: web301, web304, web307, mail308
    • All CP7 linux servers are up except: mysql405, web422
    • All CP8 linux servers are up except: mail501, web509, web602
    • All CP11 linux servers are up except: web1102, web1109, web1115, web1116, web1120, web1122-web1124, web1128, web1129, web1132
    • All CP12 linux servers are up except: web1215, web1231-web1236, web1238
    • All CP13 linux servers are up except: mail1302, mail1313, web1302, web1303, web1305-web1310, web1312, web1316, web1319, web1322, web1324, web1327-web1330
    • All CP14 linux servers are up except: web1401, web1403-web1407, web1410-web1425, web1427-web30
  • 06/29/2012 12:19 PM EDT – WINDOWS UPDATE
    • All CP6 Windows servers are up except: mssql300
    • All CP8 Windows servers are up except: iis500cf, iis505
    • All CP10 Windows servers are up except: mssql1006
  • 06/29/2012 12:30 PM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: web301, web307
    • All CP7 linux servers are up except: mysql405
    • All CP8 linux servers are up except: web509, web602
    • All CP11 linux servers are up except: web1102, web1109, web1123, web1124, web1128, web1129, web1132
    • All CP12 linux servers are up except: web1215, web1234, web1236, web1238
    • All CP13 linux servers are up except: web1322, web1330
    • All CP14 linux servers are up except: web1401, web1403-web1405, web1407, web1410-web1425, web1427, web1428
  • 06/29/2012 12:50 PM EDT – WINDOWS UPDATE
  • All CP8 Windows servers are up except: iis500cf, iis505
  • 06/29/2012 1:00 PM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: web301, web307
    • All CP7 linux servers are up except: mysql405
    • All CP8 linux servers are up except: web602
    • All CP11 linux servers are up except: web1102, web1128, web1129
    • All CP12 linux servers are up except: web1238
    • All CP13 linux servers are up!
    • All CP14 linux servers are up except: web1403-web1404, web1407, web1410-web1414, web1416-web1422, web1427, web1428
  • 06/29/2012 1:28 PM EDT – LINUX UPDATE
    • All CP6 linux servers are up except: web301, web307
    • All CP7 linux servers are up except: mysql405
    • All CP8 linux servers are up except: web602
    • All CP11 linux servers are up except: web1128, web1129
    • All CP12 linux servers are up except: web1238
    • All CP14 linux servers are up except: web1403, web1404, web1410-web1414, web1416-web1418, web1420-web1422, web1424, web1425, web1427, web1428
  • 06/29/2012 1:55 PM EDT – LINUX UPDATE
    • All CP6 linux servers are up!
    • All CP7 linux servers are up except: mysql405
    • All CP8 linux servers are up except: web602
    • All CP11 linux servers are up except: web1128, web1129
    • All CP12 linux servers are up except: web1238
    • All CP14 linux servers are up except: web1403, web1404, web1410, web1411, web1414, web1417, web1420-web1422, web1424, web1425, web1428
  • 06/29/2012 2:22 PM EDT – LINUX UPDATE
    • All CP7 linux servers are up except: mysql405
    • All CP8 linux servers are up except: web602
    • All CP11 linux servers are up except: web1128, web1129
    • All CP12 linux servers are up except: web1238
    • All CP14 linux servers are up except: web1404, web1410, web1411, web1414, web1417, web1420, web1425
  • .

Resolution Description

  • Windows servers are up except iis500cf and iis505 which are being addressed in their own blog posts.

服务器恢复

看到他的解释说是半小时更新一次处理结果,我非常准时的从九点半开始就是没半个小时进行一次ixwebhosting状态博客的刷新,查看处理结果,最终在两点二十二分得知,我自己的网站所在的服务器上线。立刻打开,看到了熟悉的界面。

宕机感悟

服务器的宕机我们是无法预料,和无法控制的,但是我们可以去选择一个非常稳定的服务器!在宕机的过程中,我还查看了status.ixwebhosting.com上的其他的故障处理,其中就有硬盘故障的,所以这也再次提醒自己,对于网站的数据自己一定要做好备份,定期备份是必须必须必须的!!

转载请注明:程春杰博客 » 网站服务器宕机八小时后终于恢复

喜欢 (0)or分享 (0)
发表我的评论
取消评论

表情

Hi,您需要填写昵称和邮箱!

  • 昵称 (必填)
  • 邮箱 (必填)
  • 网址
(24)个小伙伴在吐槽
  1. 这样多网站的优化没啥好处
    液压机2014-04-20 00:08 回复
  2. I write a comment when I appreciate a post on a website or I have something to add to the discussion. Usually it is a result of the fire communicated in the article I browsed. And after this article %BLOG_TITLE%. I was excited enough to create a leave a responsea response 😉 I actually do have a few questions for you if you do not mind. Is it only me or do some of these responses look like left by brain dead people? 😛 And, if you are writing on additional sites, I would like to follow anything new you have to post. Could you make a list every one of your shared pages like your linkedin profile, Facebook page or twitter feed?
  3. ixwebhosting的空间我也买过,试用期没过就退了……
    菜鸟FLY2012-07-02 12:31 回复
    • 抽风抽的太频繁了,天天都抽一下,可惜我是买了两年的空间啊
      程春杰2012-07-02 16:36 回复
    • 以后买空间的问题,就多向你请教请教,看到你的空间使用经历了,相当的老道了
      程春杰2012-07-02 16:37 回复
  4. 呵呵··用同样模板的童鞋哦··刚打开还以为走错了~~
    娄娄2012-07-01 23:08 回复
    • 是啊 ,现在的这个主题使用的人实在是太多了
      程春杰2012-07-02 00:49 回复
  5. 计算机术语真多。
    焚云日2012-07-01 10:11 回复
    • 要不很多解释不清楚
      程春杰2012-07-01 12:08 回复
  6. CodeGuard提供备份功能,不知道效果咋样……
    季风雨2012-07-01 00:52 回复
    • 恩,我现在在使用my visitor进行数据备份,但是发现说的是可以自动发送邮箱,但是邮箱中从来没有看到备份,但是服务器上确实是自动备份了,我只有隔上一周,自己手动下载一次
      程春杰2012-07-01 09:52 回复
      • Hi, the whole thing is going sound here and ofcourse every one is sharing data, that's actually fine, keep up writing.
        ray ban sunglasses2013-06-07 02:21 回复
    • Hi there, You have done an excellent job. I will certainly digg it and for my art suggest to my friends. I'm confident they'll be benefited from this site.
      ray ban sunglasses2013-06-07 02:21 回复
  7. As I site possessor I believe the content material here is rattling magnificent , appreciate it for your efforts. You should keep it up forever! Good Luck.
    Scrapebox proxy2012-06-30 17:47 回复
    • Thank you for your coming!And I have visited your site
      程春杰2012-06-30 19:26 回复
      • Howdy would you mind letting me know which hosting company you're utilizing? I've loaded your blog in 3 completely different browsers and I must say this blog loads a lot quicker then most. Can you recommend a good web hosting provider at a reasonable price? Many thanks, I appreciate it!
        ray ban sunglasses2013-06-07 02:21 回复
        • are you a robot?
          程春杰2013-06-07 14:30 回复
  8. dnspod+备用网站空间+每日自动备份数据库
    safecn2012-06-30 15:29 回复
    • 自动备份数据库是必须啊,上次说的主机你最后买的哪里的
      程春杰2012-06-30 16:03 回复
  9. 注意备份啊,世事难料啊
    鸡啄米2012-06-30 12:05 回复
    • 必须的啊,备份的重要性从升级到服务器当机一次次的凸现出来
      程春杰2012-06-30 12:19 回复
  10. 我没有想到会出现这么长时间的宕机,一般服务器集群都应该有很好的UPS和供电系统,昨天一下子宕机八个小时,我的神呐,呵呵
    程春杰2012-06-30 11:14 回复
  11. 昨天访问了几次都是无法访问,晚上一点左右我的博客也出现了跌机,3年来好像是第一次遇到。现在每周备份一次数据库。
    土狼妹妹2012-06-30 09:09 回复
    • 是啊,我没有想到会出现这么长时间的宕机,一般服务器集群都应该有很好的UPS和供电系统,昨天一下子宕机八个小时,我的神呐,呵呵
      程春杰2012-06-30 12:19 回复