The grade 9 English assignment demanded that each of us to write a 2- or 3-page essay describing how we would improve society: What would we do to improve the quality of life for all Canadians?
This was 1986, just after pro-"wrestling" and break-dancing fads started thankfully fading from mass appeal. This was an era when global nuclear warfare (would you like to play a game?) still seemed not only possible, but probable - though Gorbechev's glasnost policies were definitely reducing tensions from the paranoid levels a few years earlier - so the concepts of freedom, democracy, and bomb-shelters appeared in quite a few of the submissions.
For my submission - a creation of pure literary genius, or so I thought - I combined the fundamentals of democracy with my recent discovery of local BBSs. I hypothesized that soon we'd be in a nationally connected world that would allow citizens from coast to coast to communicate with each other and access common resources on their home computer (be it Vic-20, or ultra-high end Commodore-64). Basically I was just describing the existing packet-switched commercial services, and the burgeoning Internet (I later created a multi-"channel", packet-oriented modem protocol on my Atari ST - basically a really primitive, foolish version of TCP), but envisioned it as a government built, publicly owned system, supplying every Canadian with this basic piece of infrastructure.
With this data communications network, I argued, we could finally build a system where government could be implemented as a pure democracy.
No longer would we have to elect local officials to carry our agenda to parliament, but now we could simply put every policy question to the people, allowing the populace to directly decide how the country will be governed.
I was certain that my idea was brilliant, and was a little disappointed when it was returned to me after marking (I was sure it would be passed on to important people for implementation. Perhaps they photocopied it?). Aside from a mark, the teacher - whose name I don't recall, though I do remember that her and her husband owned a car dealership - wrote a rather cryptic line about it being idealist and unworkable, which stung a bit, hence why this story sticks with me still today.
If for some reason I were required to rewrite that paper today, I'd probably concede the teacher's point. I would thank her for giving me a bit of cynicism and insight that perhaps I didn't have before.
After years of watching public opinion ebb and flow, I'm now of the opinion that a pure democracy would be an absolute disaster.
Apart from the fact that it would likely lead to a tyranny of the majority (where 50%+1 = someone else's agenda forced down your throat. This is of course how our system generally currently works, but in a more time-limited, detached manner), the core problem is that many voters simply don't take the responsibility required even for once-every-4-year trips to the ballot box, much less flippantly deciding each and every issue facing the government.
I certainly don't believe in an illuminati running government, and a democracy is empirically the ultimate form of government, but the small disconnect between the public and the government (the interface being elected representatives who are accountable for the government and its decisions) allows government to do what is necessary and right.
In essence it allows government to take actions that might temporarily anger the public in a short-sighted manner, but which we'll come to appreciate as time goes on. There have been countless times where polls indicated that the public was signfiicantly against of behind X, but to follow such an agenda would be disastrous. The government largely ignores such polls, not falling to populism and pandering to every shift in perception, and it blows over and the public sees the big picture.
Imagine if, instead, every night when you came home (or perhaps only once a week) there were several policy issues requiring your input.
"Should the bridge to the island airport be built?"
"Should the department of departments be privatized?"
Consider how little thought and attention people give to their several-times-a-decade visit to the ballot box. Now imagine how much worse it would be if everyone were questioned on every single government initiative.
"Well then making voting optional! Let the people who know about the topic vote!"
Such an opt-in arrangement is how "special interests" are born, and it's how they have much more sway than they perhaps should.
"That design might work for a stateful desktop app, but it isn't appropriate for the stateless web."
"O/RM isn't appropriate for stateless environments like HTTP!"
"This component wasn't made for the stateless environment of HTTP!"
"...but HTTP is stateless!"
If you've done any sort of web development, you've probably heard proclamations like these. You may have even made them yourself.
But what do they really mean? Do they add any value to the conversation?
Stateless refers to an architecture where each HTTP request is fundamentally detached from requests that came before, and unrelated to requests that will follow.
In a stateless world, the browser initiates a TCP connection on port 80 - traditionally, or port 443 if it's a secure connection - and then sends some basic commands, such as the desired document (e.g /images/coolpicture.jpg), along with this-request preferences like the user's desired language.
With no prior information about the caller - acting only on the newly generated information in the request (e.g. the document requested, along with user submitted form values) - the server sends the results.
> GET /images/coolpicture.jpg
< the binary data for /images/coolpicture.jpg..
After the single request is serviced, the connection is torn down in this stateless scenario. The desired goal was to service each request as quickly as possibly, freeing the resource-heavy, finite-quantity connection to service other callers.
Maximum output with minimum resources.
This served the early web very well. Mirsky's Worst of the Web could be served out to thousands of anonymous consumers with gusto on minimal hardware, fulfilling the liberal information sharing origins of HTTP.
For a historic analogy, think of the 411 telephone service - you dial the number and establish the connection. You tell the operator the person whose number you require, and they provide a number in response. The call is disconnected, freeing the line and the operator for the next caller.
This is stateless in that the service relies upon no contextual information preceding the call to provide the service, allowing a small number of operators and connections to handle a large number of lookup requests, needing no resources beyond a simple phone book.
A stateful 411, on the other hand, would be one where you called 411 and left the phone off the hook, maintaining the connection for perhaps days at a time. With each number lookup request, they would try to interpret what you really mean based upon the requests that came before.
"Earlier you asked for a bait store on Main street, and now you're looking for a tackle store. I'm going to guess that you probably want one on or near Main street. The number is..."
Such a stateful connection wouldn't even require you to maintain the call - they could just pull up your records based upon the calling phone number, immediately having the history of your interactions to draw from in a stateful manner, regardless of the transience of the individual call.
The stateless definition of HTTP was used to contrast with existing services like telnet and FTP, where a TCP connection (itself a stateful protocol) was made, after which a state was maintained and modified from command to command -- whether you were logged in, what directory you were in, what application was running, and so on.
The state was alive and changing until the connection was dropped, with a block of server resources dedicated to keeping alive a world just for you.
That design worked for those services because connections were generally "higher value" per request - a long running file transfer that couldn't serve many clients anyways, as a function of the large number of bytes per request; a professor running some batch jobs; etc.
Most readers will know that almost all websites these days appear to be stateful.
You log on. It presents data that is specific to you, using preferences that are individual to you. As you do things, the environment changes and adapts, incorporating your interactions into following requests.
This isn't just an illusion, or a bastardization of the web: THESE WEBSITES ARE STATEFUL.
So how did the web sneak up and become stateful on everyone? Well, generally via the magic of cookies (alternately via URL-appended session identifiers to simulate cookies), an addition to the HTTP protocol that was first implemented by Netscape back in 1995.
A session cookie is often nothing more than a unique identifier (preferably with enough entropy that users can't guess each other session identifiers, for instance a randomly generated GUID), passed to the server on each request, allowing the web server to tie requests together, building a set of session data to provide state for a given client - The logon form changes the home page render changes the topic listing changes the calendar selector changes the news view, and so on, with each page having available a set of stateful information about the client, forming a sort of virtual "persistent connection" over many individual, seemingly isolated HTTP requests.
Ignoring the fact that in the modern world HTTP connections are reused (given that a client will often request dozens or more documents to build a single page - or in the case of Digg about 37,528 - it was found to be cheaper to just let the client reuse a built connection for multiple requests), often people differentiate HTTP from being "stateful" because it doesn't maintain a constant connection for the entire session.
Yet what is a connection? In this case it would be TCP, a "stateful" protocol. TCP is stateful in that it changes based upon what has happened before, and each packet for the duration of a connection relies upon those before them getting through okay.
You can establish a connection, let it sit for a while, and occasionally pass data back and forth.
TCP is stateful in contrast to IP (or its very light encapsulation, UDP), which is individual packets that live or die by themselves, with no consciousness of packets that came before, or those that will follow.
But wait, isn't it TCP/IP? TCP on top of IP?
Why yes, it is. TCP is fundamentally "IP with cookies", allowing it to maintain session state, tying many stateless packets together into a nice, clean stateful correspondence. This differs little from HTTP with cookies, a fundamentally stateful protocol when coupled in virtually any post-1996 implementation, where the idea of sessions and statefulness are the norm.
So why does everyone keep yabbering nonsense about HTTP being stateless (pedantically true, but practically irrelevant and entirely misleading)? Why do so many people talk about the web being stateless in the face of endless contradictory evidence?
I think it's just a cop out: People want to validate their crappy web apps - possibly due to laziness or a desire to migrate back to fat apps - so they clutch onto the justification that it's a fundamental limitation of the platform that limits their abilities, constrains their design or forces them into hackish implementations.
In reality, the web that we've been developing against for the past 10 years has allowed tremendous statefulness, including building up and maintaining enormous quantities of server-side state for every session (just like a fat app or a DCOM component): Just because that isn't appropriate for a very high volume, low value-per-transaction anonymous user website should in no way guide you in your implementation of a low user count, very high value-per-transaction vertical market web app.
You have the ability, and the mandate, to do what's right for the problem, and no one solution or dogma fits all web needs.
Last Wednesday I was mentioned in the Wall Street Journal (right there on the front of the second section of one of the world's most prestigious newspapers), being referred to as the "world's pre-eminent domainologist" (an article that has been referenced in countless other sources now, including some errant attributions, such as the Toronto Star -- my hometown paper -- seemingly making me a Verisign employee, which of course I'm not).
Apparently -- or so my wife tells me, given that I don't listen to or read anything that involves me in any way, and even when she talks about this stuff I cover my ears and basically repeated "LaLaLa"s to drown it out -- it was a well-written, humorous piece. While I apparently played the part of a fringe, bit-player, my name does appear quite early in the article, and that's pretty neat to me.
The mention doesn't bring me monetary rewards, and it really doesn't contribute to my professional success in any measurable way (though it's very neat being mentioned, and it was a hugely fun process working with Lee to get the raw material and provide some basic quotes, I'm not really in the business of domain names, and it isn't really a hobby of mine -- being attributed in such a way isn't really something I really want to leverage), but it is yet another weird, discordant mention in mainstream media.
So long as it isn't the notorious sort of mention, somehow it all works into my grand plan of world domination. Bwahahahaha! <rubs eyebrows>
It all began with a couple of emails from Lee. He indicated that he was from the WSJ, and was interested in talking with me about an article he was considering. After some difficulty finding a common point of availability, we finally chatted in person. This was around Wednesday of the week before.
That evening Lee recorded an initial phone interview, indicating that he had come across my article from back in March, and knew that it had seen a lot of success (for those who didn't see it, it was an article that took off like wildfire across the net, seeing front page action on Digg, Reddit, and mentions from numerous `A-list' bloggers. Quite a few of the entries on here have seen wide "link-love", but the domain name entries absolutely blew all prior -- and following -- records away, seeing close to 100,000 visitors a day for a period of time, still maintaining a lot of incoming interest).
Given that he hadn't come across similar research (he did ask if I knew anyone else doing similar research, perhaps probing to see if I was just a sub-eminent domainologist, and perhaps I would defer to a great authority), he decided to base his article on information I provided, both in the initial article and numerous follow-up queries he asked me to run.
One particularly exhaustive query took around 20 hours of runtime.
All in all it was a lot of fun, and from my end was nothing more than a couple of very brief phone interviews, and then some randomly kicked off queries and emailed results.
Despite the fact that the article in question provides limited personally identifying information (and while it's accurate, it is a bit misleading for some. For instance I'm not in New York City -- I'm actually here in a suburb of Toronto -- and the article of course apparently doesn't mention this blog), the immediate effect of the article was dozens of phone calls from people across the US -- and the world -- asking for my opinions on business ideas, asking if domain names people held were good ones, asking if I was interested in partnering on some project or other, asking how to get access to the raw data (see the comments in the main entry -- there's a link to the fax forms), and asking how I ended up being referenced in a WSJ article.
This blog also saw a lot of activity because of the article, with a number of people coming here after searching up obvious terms like "Dennis Forbes domain name". I'm still seeing WSJ-related search activity today (maybe hermits are just adding the issue to their apartment newspaper mountains).
I've received requests for radio interviews (I've done a couple of those before, and it isn't my favourite genre: I'm too full of self-doubt when it comes to accuracy, and mortally fear the possibility of saying something incorrect in response to an adhoc question. In such an instance I'd rather say nothing until I can verify, with certainty, that what I'm saying is correct. I haven't been "blessed" with the arrogance and confidence that allows some to make the most absurd of proclamations with zero self-doubt or hesitation), and have gotten requests for, and responded to, several email interviews.
All in all a very entertaining process, and it was interesting to take part in it. It has me looking for my next angle for media exposure.
Of course Lee was being facetious when he assigned me with this title, and really I found it gut-busting hilarious when I heard it myself.
The original domain name article actually came about because I needed a medium-sized database to demonstrate high-performance database operations. While I was indeed curious about domain names, ultimately I requested access purely to have a large set of data to demonstrate some index-backed operations. I was shocked when I discovered that one could actually acquire a copy of the zone file.
I really haven't been poring over zone files for years, amazingly reading trends and consistencies from streams of raw data.
After receiving the data, I saw that it really was interesting and entertaining, so in a single night I threw together the original article: Right after getting my credentials from Verisign, I downloaded the 850MB compressed file, extracted, imported and cleansed it, and then ran some humorous queries to see if it yielded interesting results. Seeing some of the answers, I thought it would be good blog fodder so I tossed an article together and put it online.
Over the next week I only had a free moment here and there, so I belatedly put up a follow-up article, in my haste skipping many of the tests that I had promised (for instance the English language queries, which I only finally finished at Lee's request).
My interest was short-term, and my technique was mostly driven by the biggest bang-for-the-buck queries that would yield interesting blog material, while allowing me to save my time for my family and my profession (in that order). I wasn't really sitting there month after month anxiously watching streaming domain name data, inferring complex patterns like a savant. Instead it was a couple of low-hanging fruit queries against the imported dataset, writing up the results when it was unexpected or entertaining.
Of course then the material seemed to be exhausted (the follow-up article saw much less attention), and my personal curiousity waned. The database then sat and collected bitular rust.
It's a marvel that it didn't get deleted to free up room for my prime-number database, or my ridiculously expanding set of digital pictures.
Then Lee called, I fired up the database -- to my surprize I still had it -- and the rest is history.
Populism has seldom been a goal of these entries, but a couple of entries, not to mention observations of the meme sites, have given me some insights into what are some elements that increase the probability of an entry taking off. Let's just say that I'm the World's Pre-Eminent Meme Site Popularity Assessment Expert (WPEMSPA, aka Wimpy-Sumpa).
That's about it. Create entries covering everyday topics, and populate it with easy to digest graphics, and summaries that give cursory linkubators comfort that they're linking something interesting.
Enjoy the endless incoming traffic!
Today -- apparently on the front page of section 2* -- my name was mentioned in the Wall Street Journal. Unrelated to my general professional pursuits, but still it's sort of neat to appear in such a prestigious paper.
* - I don't generally read things about me, or listen to things with me. Maybe it's a superstition, but I just find it creepy.
Way back in junior high I had a good friend who was a huge fan of military aircraft.
His bedroom walls were covered with huge, hard to procure and often expensive posters of these deadly devices. His desk featured an actual (albeit non-functional) 20mm shell, of the variety used in the depleted-uranium spewing gatling gun.
His favourite military fighter jet happened to be the F-15 Eagle.
Feeling a little left out, I started pouring over his resources, carefully reading his encyclopedia's of fighter aircraft, absorbing all of their attributes. I decided that my favourite fighter jet was the F-14 Tomcat: Clearly its ability to land on carriers, its swing-wing engineering, and the long range phoenix missiles it supported, made it the superior aircraft.
There was no way the F-15 Eagle compared, I argued. The F-14 Tomcat was obviously the choice of those in the know. The enlightened ones, if you will.
Yet the reality -- and I think my friend Brian always knew it -- is that I chose the F-14 primarily because it wasn't the F-15. After picking a natural alternative, I started building layers and layers of justifications for my decision.
I see the same sort of thing fairly typically in software development: Big up front design versus agile designs; Getters/Setters versus fields; namespace naming guidelines of type A or type B; variable naming standards; stored procedure naming standards (or the religious "stored procedure versus dynamic SQL" argument that rages on in teams across the lands); the sorts of types to use for primary keys; the languages and platforms to choose; whether or not to use XML, and what to use it for.
So many times, it seems, people choose their positions based not on actual analysis and honest beliefs, but rather because they're countering someone else in their team -- especially when attempting to undermine authority, actual or perceived -- or they battling someone else in their organization (that dastardly team in Sector G that's trying to get kudos by setting the development guidelines!), or they're deriding someone in the industry.
Often They're just trying to be different and difficult, and the beauty of software development is that there are many, many right ways to do it, and it's easy to find allies in discussion groups to assure one that everyone else is idiots, and their new position is the One True Way.
It's easy to appeal to authority, given that there's some big name or organization that, in some form, promotes just about every software development practice and standard imaginable (Microsoft is a particularly good example of this, as throughout the organization they follow so many standards and practices, that one can easily find an example conforming with their dogma, using it as an example that it's the "Microsoft way", ignoring the many exceptions).
Of course all of this doesn't preclude disagreement on standards and processes and techniques -- people often truly disagree because they legitimately and rationally believe something different. In a full of intelligent, self-directed professionals, such disparate beliefs and conclusions can be enormously beneficial. The problem is when interpersonal issues materialize as technical disagreements.
Lately I've taken a minor interest in nutrition, paying a bit more attention to some of the many nutrition/health related stories featured on the meme sites over the past couple of years.
My primary motivation is my offspring: I have a concern that my children, 1 and 3 years old, might miss some nutrient or other, preventing them from reaching their potential. Omega-3s (DHAs, EPAs, and ALA/LNAs), 6s, 9s, minerals, vitamins, macronutrients: something that we're not providing in their diet -- we evolved, presuming you believe in that whole concept, with a diet much different than we generally eat today -- or something in the foods that they've aesthetically chosen to reject (children have an amazing ability to pass judgement on foods before it's even on their plate, spurning it for months on end based upon that initial rejection), that they really need to grow and stay healthy.
Something that won't be there for the building of their brains, or their circulatory systems, or in the creation of necessary hormones, and so on.
I'm also always on the lookout for anything that might harm them -- trans-fats, for instance, which has long been banned from our household, a prohibition that's becoming easier and easier as food products are being reformulated to eliminate them (sidenote: McDonalds -- hardly a bastion of healthy food, but still -- has been really dragging its feet on reducing or eliminating trans-fats. They don't need to rush because it doesn't financially hurt them: So many customers are completely ignorant of, or in denial about, the whole issue that it is reducing the consumption of their foods).
My secondary motivation is, of course, ensuring that my wife and I's "machine" (living creatures are the most extraordinarily complex, and still much unknown, mechanisms) run optimally, and with the greatest MTBF. I've circled the sun some 33 times now, so there is a growing sense of mortality that just isn't there when you're younger. Actions and decisions now, and in the decades already past, can make the difference between being a sedentary, chronic-disease-ridden 50 year old, or a healthy, active 65 year old.
My interest has me stopping at the "nutrition" section of the local grocery stores, and even specialty nutrition stores such as GNC when I pass one at the mall, perusing some of their wares. I don't go out of my way as a trip unto itself, but if I've gone to Walmart to pick up a sprinker or toy, I might drop into the supplements section to see what sort of Omega-3 products that outlet stocks (mmm, fish oil gelcaps. You aren't supposed to bite them?).
What I've learned is that it's a massive industry, predominately catering to the elderly and sick. There are tens or hundreds of thousands of products, covering virtually every supplement imaginable -- if there was ever a study that found the benefits of some compound or nutrient, even if the study used dubious methodology and was refuted by dozens of followup studies, there will be a supplement on the shelves containing large quantities of it. The aisles are generally full of fearful of quickly approaching death seniors looking for something that'll undo a lifetime of damage.
The gamut of available pills, usually monstrous throat clogging pills, is extraordinary.
What fascinates me, however, is how reactive most people are, rather than being proactive. To give an example, I generally use artificial sweetener (Sucralose aka Splenda) in drinks, and drink diet drinks containing the same (the possible carcinogenic factor is a completely different topic). Yet I'm not overweight, or at least I don't think I am. I've gotten comments, of the sort that only a male would get, that this perplexes people because I'm not overweight.
Exactly.
I drink lots of drinks in a day, so I try to limit the amount of sugar calories. It doesn't mean that I'm trying to lose weight, and it doesn't mean that I've bought into some sort of Atkins no-carbs B.S. It's simply an easy way to slightly reduce the number of calories I ingest in a day -- not to mention that sugars have always been a no no for nutritionists, and a single can of soda often features twice the sugar of two whole bowls of Fruit Loops, themselves hardly a low-sugar option -- with minimal/no impact on my lifestyle, to prevent the situation where I'm overweight. If I didn't have the sugar substitute options, I'd drink less, or I'd drink water.
On the same theme, the supplement section is overwhelmingly filled with a) the elderly, b) people suffering from serious ailments, such as cancer. It isn't full of 20 year olds realizing that the next couple of decades will determine how long they live, and more importantly how well they will live during that period.
It's a perplexing, destructive situation that many of us only start caring about our bodies in our twilight years, when something has gone seriously wrong, or when we look in the mirror and realize that we're obese. It's like getting your car rustproofed after half of it has crumbled away, and changing your oil after your engine has seized. It's carefully applying layers and layers of wax after the paint is scratched and dinged, and discoloured by the sun.
Of course this isn't to say that the elderly or those suffering from terrible afflictions shouldn't be concerned with keeping themselves as healthy as possible -- of course they should, and of course it's rightly important to them -- it's just that people need to think more preventatively: If an occasional cup of lycopene rich tomato juice wards off prostate cancer, for instance, well then I'd rather have an occasional cup of tomato juice rather than drinking gallons of it after the fateful diagnosis, in an often futile attempt to stop what's already been done. If some extra lutein, in the form of a delicious salad containing spinach leaves, provides anti-oxidants that maintain vision and skin health, well then it's probably a good idea to keep it in mind before the eyes are dried, degraded orbs, and the skin is withered and destroyed.
It seems like nutrition and fitness should be something all of us should be concerned with, especially when we're at the seemingly epitome of health. We shouldn't only worry about calories when we realize we're medically obese, and we shouldn't only start paying to nutrition when our body has mostly broken down.
