I forgot to turn on my auto delete for the “Who viewed me” section of the website after making some changes and I managed to accumulate over 1 Billion records in a very short time. I still get awesome performance with the SQL Query selecting who viewed you and applying search criteria in under 7 Milliseconds. I’m pretty sure no one else has a table with a billion records in SQL server and is insane enough to have it on One Machine, with only a hand full of internal drives.
So today I fired off an order to get a bigger storage array. My biggest problem is all the space it takes up. With a relatively small investment I should be able to store 100 Billion records. My database is getting scary now, every month or 2 when I look at the tables they end up being a lot bigger. I’ve got a LOT of tables with hundreds of millions of records in them. Last year they only had 10′s of millions. At any rate i’m going to be ordering more servers and breaking up my database more so that I can scale past 100 Million daily pageviews. Anyone else finding their original designs just not cutting it anymore ?