Meta tags:
description=Just another WordPress.com weblog;

Headings (most frequently used words):

memory, asp, net, on, is, google, limit, application, jesper, stuff, what, ranking, worth, clever, internet, marketer, trying, to, trademark, seo, app, engine, part, multiple, pools, impact, virtual, and, pagefile, size, who, hitting, my, website, advanced, stress, testing, with, center, test, keep, your, newsletters, out, of, spam, filters, understanding, pages, archives, categories, blogroll, meta,

Text of the page (most frequently used words):
the (175), memory (64), and (55), that (55), you (46), for (42), this (39), net (29), have (24), not (24), with (23), asp (22), #virtual (22), application (22), per (22), can (21), when (20), your (20), from (19), will (18), 2gb (17), sites (17), test (17), but (16), what (16), set (16), are (16), physical (15), get (13), setting (13), process (13), more (13), make (13), machine (13), has (13), com (12), 2007 (12), google (12), app (12), which (12), windows (12), used (12), use (12), oom (12), just (12), each (12), http (11), some (11), all (11), memorylimit (11), how (11), then (11), pool (11), add (11), was (11), jesper (10), web (10), performance (10), posted (10), microsoft (10), here (10), limit (10), bytes (10), 4gb (10), server (10), pools (10), website (9), about (9), applications (9), spf (9), users (9), requests (9), oheaders (9), could (9), site (8), like (8), wordpress (8), seo (8), may (8), aspx (8), 3gb (8), many (8), iis (8), run (8), leave (8), comment (8), testing (8), traffic (8), were (8), now (7), engine (7), where (7), out (7), well (7), maximum (7), www (7), emails (7), see (7), second (7), orequest (7), one (7), websites (7), 000 (7), would (7), pagefile (7), our (7), same (6), 800mb (6), than (6), want (6), should (6), lot (6), framework (6), outofmemory (6), they (6), these (6), also (6), bit (6), domain (6), spam (6), delay (6), around (6), dim (6), number (6), been (6), new (6), started (5), log (5), create (5), 2008 (5), search (5), available (5), only (5), system (5), never (5), against (5), anything (5), ram (5), code (5), happens (5), limited (5), disk (5), exceptions (5), way (5), did (5), oconnection (5), average (5), minute (5), too (5), during (5), hits (5), 8gb (5), pageviews (5), sitecore (5), cms (5), article (5), box (5), month (5), ranking (5), stuff (4), free (4), blog (4), technology (4), switch (4), above (4), cache (4), allowed (4), sure (4), private (4), read (4), find (4), address (4), why (4), two (4), really (4), config (4), case (4), say (4), default (4), extra (4), total (4), course (4), every (4), because (4), making (4), able (4), running (4), having (4), going (4), sender (4), hotmail (4), getting (4), milliseconds (4), end (4), sub (4), arurl (4), ardomain (4), oresponse (4), image (4), close (4), script (4), real (4), overall (4), however (4), question (4), single (4), world (4), following (4), pagefiles (4), without (4), simply (4), actually (4), times (4), size (4), comments (3), org (3), december (3), april (3), purpose (3), makes (3), worker (3), throw (3), exception (3), avoid (3), 600 (3), larger (3), amount (3), thats (3), there (3), couple (3), increase (3), megabytes (3), always (3), smaller (3), recommended (3), 800 (3), does (3), error (3), hard (3), help (3), using (3), understanding (3), record (3), sent (3), their (3), send (3), who (3), servers (3), receiving (3), easy (3), 500 (3), need (3), stress (3), ubounddomain (3), uboundurl (3), domainindex (3), urlindex (3), p_domain (3), p_url (3), fenabledelays (3), accept (3), into (3), another (3), 1765 (3), later (3), random (3), think (3), identical (3), between (3), center (3), files (3), hours (3), trying (3), much (3), experience (3), short (3), logparser (3), logfiles (3), hour (3), know (3), very (3), resources (3), count (3), 208 (3), additional (3), reading (3), environment (3), its (3), own (3), runs (3), public (3), point (3), 2003 (3), impact (3), called (3), nick (3), high (3), trademark (3), acronym (3), his (3), bingo (3), worth (3), content (2), sign (2), subscribed (2), subscribe (2), account (2), rss (2), entries (2), june (2), september (2), msdn2 (2), library (2), last (2), none (2), therefore (2), leaves (2), through (2), still (2), 1200 (2), rest (2), below (2), happen (2), exceeded (2), release (2), long (2), value (2), logic (2), needed (2), start (2), space (2), tests (2), workerprocess (2), recommends (2), almost (2), 1gb (2), adding (2), custom (2), quite (2), percentage (2), possible (2), sense (2), common (2), heavy (2), unable (2), enough (2), bad (2), thrown (2), anywhere (2), access (2), standard (2), setup (2), reserved (2), swapped (2), developer (2), problems (2), policy (2), records (2), headache (2), tried (2), receive (2), spammers (2), rejected (2), them (2), life (2), abuse (2), incoming (2), mail (2), bounced (2), support (2), fight (2), received (2), user (2), kinda (2), newsletters (2), filters (2), simultaneous (2), simulate (2), main (2), array (2), product (2), ubound (2), int (2), rnd (2), sendrequest1 (2), p_delay (2), strstatuscode (2), true (2), nothing (2), trace (2), else (2), vnd (2), language (2), clr (2), host (2), automatic (2), failed (2), response (2), url (2), vbscript (2), work (2), list (2), might (2), request (2), goes (2), best (2), fine (2), act (2), clicks (2), click (2), different (2), most (2), under (2), anyway (2), care (2), webserver (2), once (2), story (2), peak (2), whatever (2), hosted (2), such (2), patterns (2), 150 (2), top (2), order (2), problem (2), few (2), hope (2), believe (2), showed (2), serve (2), place (2), somewhere (2), handle (2), estimated (2), guess (2), limits (2), assigned (2), 700 (2), described (2), errors (2), risk (2), tested (2), weeks (2), multiple (2), jørgensen (2), other (2), lack (2), either (2), equal (2), cause (2), currently (2), money (2), platform (2), separate (2), being (2), w3wp (2), something (2), full (2), history (2), initiative (2), million (2), preview (2), day (2), expect (2), load (2), data (2), quote (2), year (2), post (2), scary (2), clever (2), internet (2), marketer (2), cards (2), weblog (2), design, collapse, bar, manage, subscriptions, view, reader, report, privacy, already, xfn, meta, blogroll, uncategorized, categories, archives, pages, older, ms998583, scalenetchapt17_topic14, links, ms972959, monitor_perf_topic12, topic, cover, versions, mentioned, maths, determine, calculate, allows, limut, 1800mb, inserted, picture, visualizing, recycle, exceed, eventually, compared, counter, force, stay, plus, 600mb, buffer, 2000mb, higher, risking, behind, argues, things, consider, first, likelihood, experiencing, begins, dramatically, within, generally, secondly, shown, often, outofmemoryexception, explanation, numbers, machines, solved, file, tells, executing, property, straightforward, equalling, equals, review, beginning, change, allocate, piece, thing, predict, outcome, lost, battle, 32bit, operating, bits, remaining, matter, 5gb, means, doesn, fact, experienced, unlimited, resource, ruuning, shows, symptoms, recycling, exceded, basic, resolving, applies, openspf, introduction, newsletter, arrive, mailservers, checking, people, underliverable, reason, email, implementing, sets, text, dns, stating, mailserver, screening, mails, check, match, hotmails, isn, owns, playing, hardball, enforsing, senders, sending, move, cool, implement, gets, deserved, attention, becoming, plaque, inboxes, yet, knowledge, result, legitimate, caught, ever, complaints, got, yournewsletters, keep, happy, graph, flatlining, exactly, expected, domains, adjust, customers, parners, randomize, call, next, mysite, sleep, createconnection, false, connection, createrequest, path, verb, httpversion, headers, removeall, gif, xbitmap, jpeg, pjpeg, excel, powerpoint, msword, shockwave, flash, encoding, gzip, deflate, agent, mozilla, compatible, msie, sv1, infopath, 4322, 50727, cookie, resultcode, option, explicit, hit, programming, smarter, harder, recorded, sample, manipulated, highly, dynamical, arrays, names, relative, urls, realistic, picks, neat, receives, performs, looking, microsofts, made, nice, feature, browser, save, vnscript, seems, tiresome, right, sizes, after, spending, working, understand, hood, mainly, learned, cut, bone, answering, seconds, give, facing, challenge, circumstances, assumptions, variations, original, regarding, lucky, similar, advanced, 100k, extreme, relate, inhouse, crawling, careful, webcrawlers, foreign, hammering, reject, before, spend, 100033, 153, 214, 211, 122, 196, 114, 143, 126, 225, 159, 179, 201, 107, 212, 236, output, program, parser, select, toptenips, txt, ex070601, extract_extension, uri, stem, group, desc, minutes, created, yesterday, went, company, suffering, periodic, initially, night, responsible, stated, beyond, normal, asked, hitting, petri, pagefile_optimization, htm, cheers, given, little, further, insigt, handling, borders, certainly, pictures, hosting, show, strengths, allow, added, 12gb, 100, low, simulated, page, faults, became, frequent, slow, timely, manner, theory, states, raid, optimal, overkill, scid, 237740, win2000, turns, exceeds, swap, 4096, 4096mb, strange, ewebsite, allocated, chance, impressive, practical, results, 16gb, potentially, obviously, cannot, held, becomes, 1400mb, 1100mb, increments, managed, simultaneously, traffik, 1400, jumped, although, responses, sql, express, database, initial, resulted, 100mb, perfmon, knowing, 1200mb, chose, answer, assumtions, external, factors, 3ghz, dual, core, assumed, generate, pagehits, task, finding, joint, venture, personified, rune, mariboe, reference, cohaesio, regards, reasons, documented, exacttly, caused, deeper, investigation, endless, hand, both, together, man, changed, manager, instead, specific, aware, leaving, respect, thanks, waste, whdc, pae, paemem, mspx, questions, unanswered, thought, until, observed, 400mb, loads, prior, combined, usage, instances, near, individually, reaching, misunderstanding, instance, indeed, boot, ini, aspnetenable3gb, variable, processmodel, node, mean, apps, play, max, expandable, assuming, worry, adversely, affecting, subject, saw, today, simpson, osdir, couldn, reply, okay, take, blogs, msdn, tmarq, archive, interesting, seen, limt, min, 1tb, part, exciting, whole, imagine, possibilities, outsource, html, reendering, service, related, tasks, fit, period, 500mb, storage, 200m, megacycles, cpu, 10gb, bandwidth, future, quotas, remain, developers, purchase, continuing, gives, building, blocks, uses, easier, build, reliably, even, large, amounts, includes, features, development, tonight, launched, tool, enables, infrastructure, goal, scale, reaches, significant, millions, campfire, idle, week, woudl, somehow, rent, peaks, morning, came, matt, cutts, spent, time, extremely, trafficed, intriqued, challenges, periods, yeat, official, cup, homepage, etc, intereseting, absuridities, tech, figure, guy, applied, registered, gotten, fthe, sarah, bird, seomoz, pulling, fast, optimization, had, ages, describe, experts, comparable, management, industry, tags, serps, rank, position, exit, income, spot, leaked, aol, referenced, document, uniques, him, unique, visitors, recently, ranked, card, creator, patrick, moderator, community, forums, apetizer, extract, estimate, business, todays, credit, aaron, wall, seobook, great, quantify, measured, superior, measuring, gilb, law, scientist, heart, love, somebody, provides, information, better, quantifying, predicting, evalue, efforts, big, fan,

Text of the page (random words):
and 800mb separate app pools throw loads of outofmemory exceptions this was prior to the 3gb switch being in place the limit would have been 1 2gb then 60 of 2gb but outofmemory exceptions were thrown when the combined amount of memory usage for all w3wp process instances were getting near to 1 2gb and not when either of the two web sites individually were reaching 1 2gb am i misunderstanding something or is the memory limit for asp net overall i have read the following article but still find my questions unanswered http www microsoft com whdc system platform server pae paemem mspx our server currently has 4gb ram we are getting a new one would it just be a waste of money getting a new server with 8gb ram will asp net 2 0 and 64 bit windows add anything new in this respect thanks for your help nick hi nick in man article called understanding asp net memory here on my blog i described how memorylimit was changed from machine config to a setting called maximum memory used in the iis manager of iis 6 0 which is default in windows 2003 so instead of setting a percentage you just set this setting to an amount of megabytes specific to each application pool when using memorylimit in iis 5 0 you should be aware that microsoft recommends that it is set to the smaller of 60 and 800 mb which is 800 mb on a machine with 2gb memory leaving it at 60 equal to 1200 mb increase the risk of oom errors not that i believe this is the cause to your problems as i guess you are running iis 6 0 on the other hand if maximum memory used is not set at all it is equal to not having a memorylimit at all which can cause oom s anyway the 3gb memory space you have with the 3gb switch is for each application pool so when you experience an oom it is for that single application pool not both pools together however outofmemory exception can happen for a lot of different reasons none of them documented very well as you can see in my other article multiple application pools impact on virtual memory and pagefile size you will start to get oom s if you run out of physical memory and pagefile what exacttly caused the oom s on your box is hard to say without deeper investigation it could be lack og either virtual memory on the app pool or lack of physical memory for the os you can t just run an endless number of application pools on a box and at some point adding an extra application pool will impact performance because memory is swapped to disk best regards jesper jørgensen www sitecore net posted in asp net performance leave a comment multiple application pools impact on virtual memory and pagefile size september 21 2007 hi the last couple of weeks i have been assigned the task of finding out how many asp net websites can be hosted on a windows 2003 server the testing was a joint venture between sitecore and cohaesio personified by rune mariboe for reference the sites tested were sitecore cms websites you can t really answer this question without making some assumtions about external factors so we did too the machine we tested was a 3ghz dual core machine with 4gb ram 32 bit we assumed that every site would generate somewhere around 15 pagehits a minute each site used a sql express database and as our initial testing showed that each website on average resulted in an increase of about 100mb virtual memory public bytes in perfmon knowing that we would risk outofmemory oom exceptions if public bytes exceeded 1200mb we chose to have a maximum of 10 sites per application pool then we started testing with increments of 10 sites per test we managed to run 60 sites simultaneously at a total traffik of 14 79 pageviews per second the size of public bytes were around 700 to 1400 mb per application pool at this point we jumped to test 80 sites but although response times were fine we could see that we started to get http 500 errors in the responses to ms application center test some of the sites simply failed with oom s what actually happens when you create e g 8 application pools is that you get 8 times 2 gb 16gb virtual memory potentially because each application pool runs in its own process however as the machine only has 4gb physical memory obviously all this virtual memory cannot be held in physical memory all at once actually this only becomes a problem if the asp net applications actually use a lot of the 2gb virtual memory assigned but in this case each pool did use 700 1400mb virtual memory as described above if we just say that each pool on average used 1100mb then 8 pools would use 8 8gb memory now what windows does when virtual memory exceeds physical memory is to swap some of the memory to the pagefile which is recommended to be somewhere between 1 5 and 3 times the size of physical memory with a maximum of 4096 mb in our case the pagefile was the maximum 4096mb so in total the system could handle 8gb virtual memory now as we estimated that the application pools used 8 8gb virtual memory all in all it is not strange that th ewebsite started to throw oom exceptions there has simply not been anywhere in the system that new memory could be allocated but i guess very few get the chance to test a server to the memory limits as we did here and quite impressive to see the practical results of such abuse now it actually turns out that you can have more than one pagefile in windows http support microsoft com default aspx scid kb en us 237740 product win2000 so we tried to have 3 pagefiles of 4gb each on the same disk for a total of 12gb pagefiles 4gb physical memory additional testing showed that we could run 100 sites 10 app pools without oom s at low traffic however when we simulated traffic around 15 hits minute site we could run 40 sites but not 50 page faults simply became too frequent and the disk too slow to serve the incoming requests in a timely manner theory states that we should place each pagefile on its own raid 0 disk to make sure that reading from the pagefiles was optimal but this was a bit overkill for our test i believe the above tests pictures a hosting environment where a 64 bit windows would show it s strengths that would allow more physical memory to be added as well as larger pagefiles i hope that the above has given you a little further insigt to windows memory handling and what happens when you get too close to the memory borders it certainly did to me cheers jesper additional reading http www petri co il pagefile_optimization htm posted in asp net performance 2 comments who s hitting my website june 6 2007 yesterday i went to a company suffering from periodic performance on their net website initially we could see from the logfiles that in one hour during the night 18 000 hits were received by the webserver the it responsible stated that this number was way beyond normal traffic patterns the question was asked if these requests could be sent from a single server no problem in a few minutes i created the following script for logparser c program files log parser 2 2 logparser select top 10 count c ip into toptenips txt from ex070601 log where extract_extension cs uri stem aspx group by c ip order by count desc the output was the following count all c ip 100033 82 17 208 4 153 214 150 46 211 47 39 99 13 122 30 196 2 114 1 16 82 52 143 18 11 126 225 159 150 9 66 55 208 94 7 66 55 208 179 7 201 47 30 107 4 66 55 212 236 100k hits from the same ip is of course very extreme they were able to relate the ip address to an inhouse search engine crawling the website at up to 17 000 hits per hour or more than 3 hits per second so be careful with webcrawlers if foreign ip s are hammering your website find a way to reject the requests before they spend to many resources on your server posted in asp net performance leave a comment advanced stress testing with application center test may 31 2007 at work i am facing a challenge of testing how many websites can be hosted on a single server as you never know the real circumstances that real world websites and users create you have to make some assumptions for such a test to make sense in this case we know that all the sites will be variations from the same original site so we will just use this site for testing regarding traffic patterns we are lucky enough to have real world logfiles from similar websites that we can use after spending most of my working hours trying to understand what goes on under the hood of websites mainly asp net but 99 is http requests anyway i have learned not to care so much about simultaneous users and just cut to the bone by answering the question and how many requests is that per second from my experience the webserver do not care much if 10 users clicks once a minute or 5 users click every 30 seconds to make a long story short we are going to use logparser from microsoft to find the average number of requests per second during peak hours from these logfiles this will give me a number of requests per second minute or hour whatever per website say a website receives 2 requests per minute and i want to stress test 17 identical websites overall this will be 1765 milliseconds between each request but what is the best way to test if this performs fine well i have been looking at microsofts application center test act made for the purpose act has a nice feature where i can record clicks in a browser and save it in vnscript files however having to click in 17 different but identical sites seems just too tiresome and what do i do when i later on want to test with 34 identical sites and how do i get it right with the 1765 milliseconds not to think of the sizes of these vbscript files then it hit me vbscript programming language work smarter not harder so i recorded a sample script and manipulated it into a highly dynamical one it has two arrays one with the list of host names and another with a list of the relative urls we are going to test it also has a delay that i can set to anything i want e g 1765 milliseconds later on i might want to make the number random around an average number to make it more realistic the script then just picks a random domain and a random url at each request to simulate real life traffic i think it is kinda neat the script goes here option explicit dim fenabledelays fenabledelays true sub sendrequest1 p_domain p_url p_delay dim oconnection orequest oresponse oheaders strstatuscode if fenabledelays true then test sleep p_delay set oconnection test createconnection p_domain 80 false if oconnection is nothing then test trace error unable to create connection to p_domain else set orequest test createrequest orequest path p_url orequest verb get orequest httpversion http 1 1 set oheaders orequest headers oheaders removeall oheaders add accept image gif image x xbitmap image jpeg image pjpeg application vnd ms excel application vnd ms powerpoint application msword application x shockwave flash oheaders add accept language en us oheaders add accept encoding gzip deflate oheaders add user agent mozilla 4 0 compatible msie 6 0 windows nt 5 1 sv1 infopath 1 net clr 1 1 4322 net clr 2 0 50727 oheaders add host automatic oheaders add cookie automatic set oresponse oconnection send orequest if oresponse is nothing then test trace error failed to receive response for url to p_url else strstatuscode oresponse resultcode end if oconnection close end if end sub sub main dim ardomain arurl dim i delay dim domainindex urlindex dim ubounddomain uboundurl delay 500 ardomain array www mysite net arurl array product aspx customers aspx parners aspx ubounddomain ubound ardomain uboundurl ubound arurl randomize for i 0 to 30 domainindex int ubounddomain rnd urlindex int uboundurl rnd call sendrequest1 ardomain domainindex arurl urlindex delay next end sub main when i set the delay to 500 milliseconds and run it with 2 simultaneous users i can see the graph flatlining around 4 requests per second which is exactly as expected so to add more sites i just need to add the extra domains and adjust the delay to simulate the extra stress happy testing posted in web technology leave a comment keep your newsletters out of spam filters may 28 2007 spam emails are becoming more and more of a plaque in your and my inboxes what is not yet common knowledge is that the fight against spam may also result in your legitimate newsletters getting caught up in spam filters did you ever get complaints that hotmail users never got yournewsletters well microsoft who owns hotmail are playing hardball in the fight against spam by enforsing senders to use the sender policy framework spf when sending emails to hotmail users if not used emails are bounced and never received by the hotmail user it is not really a bad move because spf is kinda cool is easy to implement and it now gets a lot of deserved attention so what is it about well more and more people have tried to receive underliverable emails to users they never sent emails to the reason is that spammers have used their domain to send emails from and if they are rejected you get the email not them spf is about making life hard for spammers who want to abuse your domain when implementing spf the sender sets up an spf text record in their dns stating which servers are allowed to send emails from this domain a receiving mailserver screening incoming mails can then check the domain against the ip address of the sender and see if they match if not the mail is rejected and that is what happens when hotmails are bounced of course the receiving mail servers also have to support spf to avoid spam but that really isn t your headache what is your headache is that you should make sure that the spf record is set up for your domain that way your newsletter will also arrive at mailservers checking the spf records read more about the sender policy framework and how to set up spf records here http www openspf org introduction posted in web technology leave a comment understanding asp net memory may 23 2007 applies to 32 bit windows as many a developer has experienced memory is not an unlimited resource when using in process memory like the asp net cache ruuning out of it shows symptoms like the process recycling or outofmemory and memorylimit exceded exceptions here and there having a basic understanding of what is going on will help you a lot resolving problems like this fact in a standard setup your worker process always have 2gb virtual memory available no matter if you have 1 2 or 4gb physical memory in the machine if you use 1 5gb memory in your application but your machine only has 1gb physical memory some of it is just swapped to disk thats why it is virtual memory this also means that if you are running out of virtual memory it doesn t help to add more physical memory so why am i limited to 2gb virtual memory well a 32bit operating system os is only able to address 4gb memory with these 32 bits in a standard setup 2 of these are reserved for the os and the remaining 2 reserved for applications like asp net a common error in memory heavy applications is the ou...