So late last night we had a storm of epic proportions which caused quite a bit of flooding to occur.
While the server is fine it fried our network router / switch entirely.

I brought over my secondary repeating router to fill in the service gap for now.
We really need to get / replace the current router with a different one as this is only a stopgap solution.

If you are a current user of inexistence and enjoy our services then I please ask you to donate
any amount to help fix this massive issue.

You can use the button below to help out:

Debian pushed the apache update finally (get to disable the workaround)
apache2 (2.2.16-6+squeeze1) stable-security; urgency=high
* Fix CVE-2011-1176 in apache2-mpm-itk: If NiceValue was set, the default
with no AssignUserID was to run as root:root instead of the default
Apache
user and group. Closes: #618857

So that should close the issue…
Thanks Debian and Apache for the fix!

Hurricane Electric is back up and working and so is our DNS.

Our primary DNS provider for inexistence.org (Hurricane Electric) is having kittens,

DNS.he.net is experiencing an issue at the moment. For those that are missing zones, we are in the process of recovering them at this time.

This also includes tunnelbroker.net which is how our IPv6 works so yeah epic fail on their end.

As of right now all *.inexistence.org services will probably not work for you.
If you know how to edit your hosts file you can temporarily fix it by referring directly
to our IP: 216.196.207.102.

216.196.207.102 inexistence.org
216.196.207.102 mail.inexistence.org
216.196.207.102 www.inexistence.org
216.196.207.102 cubemail.inexistence.org

If their servers continue to be down for too much longer I might change DNS servers.
I am willing to give them a chance to fix it as their services rocks with it’s working…
All other hostnames will continue to work (we use cloudflare for everything else).

You may have noticed recently if you do a validation check on your sites code and it
comes back with four errors. This is Cloudflare’s injection of Google Analytics
on your site causing this issue.

I filled a bug report with them and once I get a reply
I will post here with either the final solution or a work around.

Apparently the issue has been fixed, cloudflare was “nice” enough
to not inform me and just deleted the bug report… *sighs*

Apparently while securing Inexistence (did an audit over the weekend) accounts,
I made an mistake of not adding false to the valid shells so pretty much all email was broken.

This issue has been addressed and all email accounts should work as expected.

If you were expecting an email and didn’t receive it I would email them and request them to resend it.
Thanks to George for the heads up about email being broken.

Sorry about this folks but hey you live and learn.

Once again we return to our normal scheduled program and enjoy!

So tonight I finally got to roll the Debian 6.0 (Squeeze) update on Inexistence.
There may be some hiccups for the next few days as I fix anything that it broke.

I also started rolling IPv6 support now.
I will start adding AAAA dns records as I continue to test the functionality of each host.
All AAAA records have been set for all hosts now.

So please be patient if you notice anything break, I will more than likely be made aware
of it as it happens and will fix it as soon as I can…

Thanks and enjoy as always!

Updates to follow below (for any hiccups and their fixes):
2011-02-17
Slight hiccup detected with sendmail: local emailing (aka cron jobs) weren’t working as
expected thanks to submit.mc snafu. Fixed now from my preliminary tests aka all
my cron job emails are coming in.

2011-02-19
Did some changes to apache2 to improve performance and security.

So I did an svn pull a couple of days ago that apparently exposed some bad values in the config file.
I had a merry task of hunting it down, first I thought it was the imap server causing hiccups.
So I tried all sorts of crap including downgrading to an older copy of roundcube.

Finally I decided to diff -urN the conf files and just update everything.
And now I’m pleased to say cubemail works again for everybody.
(at least it should)

Sorry about the interruption of service but at least it didn’t take too long to fix imho.
Enjoy!

So tonight I went from the stable version of mysql 5.0.51a to 5.1.49 from debian backports.
*Sigh*

We’ve been having issues with database corruptions hopefully this will help out.
Please let me know if any of your sql powered sites have issues…

As always enjoy and I hope everything is great on your end…

Update – 10/18/2010
So the backport upgrade really didn’t help much…
I now have a custom shell script I wrote checking the databases every day around 4am.
If you site goes down around then don’t be surprised and a refresh of your browser should do the trick..
(It takes about 2 to 4 seconds to run and re-spawns mysql to fix the OOM issue it still causes)
I cannot wait till squeeze comes out (next version of Debian).

That is all…

All SSH access is currently denied for all users as there is a rather evil kernel bug:
Hole in Linux kernel provides root rights

Of course Debian hasn’t patched this in backports yet (which we currently use).
So until this is fixed please drop me a support ticket if you really need shell access.

Otherwise please be patient and I’ll let you know when I lift the ban…

Debian has fixed this with the latest backport kernel upgrade.
Enjoy your shell access again folks!

So I installed and setup varnish tonight.
Everyone should start to see a speedup on page loads / requests for all sites on inexistence.

As always please let me know if you have any issues with your site(s).

Enjoy!

PS. I fixed the files that shouldn’t be cached like audio / video files so things return to their
proper streaming speeds.