I’ll be on America’s most wanted this weekend, with over 10 million viewers i’m worried that my site won’t stand up to the load. supposedly its a high impact interview.
I am also expecting an extra 100 to 300 million pageviews a month as we head into the peak season which will put me over 1 billion monthly pageviews. I don’t think i’ve ever been so busy as i’ve been in the last few days! When it comes to databases I keep wishing i’d created something as simple as a blog network or social network. I’m sure the database people at other dating sites know exactly what i’m talking about.
I am working on getting my 60 Drive 15000 RPM SAN up and running tomorrow and adding 2 Dual Core Quads with 64 gigs of ram each in a fail over cluster setup. This will give me extremely high redundancy for the master database and then allow for scaling out of CPU intensive queries over slave databases. I hope this will solve my master database issues till i’m in the 6 to 10 billion monthly pageviews.
Now i’m running SQL Server 2005 which allows paritioning of tables across drives. So i’ll be looking at spreading out things like my messages table over 5 drives/arrays as well as the indexes. Currently no single array is fast enough. Maybe someone from microsoft could post a comment on real world use/ best practices?
As for webservers, i’m aiming at 1 webserver (IIS 6) per billion monthly pageviews, so no real issue there and scaling that is a simple matter of doing round robin DNS. I’ve also got 3 web servers that handle my Instant messenger polling/syncing etc. Combined they handle between 100 and 500 million pageviews a day between them depending on what settings i use. They max out at 5 billion pageviews a month per server, but at only $1k/piece who cares.