Resource: UN DESA Statistics Databases

The UN Department of Economic and Social Affairs has been collecting data in such areas as social and economic concerns, climate change, international development, poverty and hunger, migration, and sustainable development for decades. Now DESA is making all these statistical databases available for free, in a searchable form, through a single web site. You can browse though information or do a keyword search.

Difficulty in Covering Studies

Via Slashdot (a site for technology news and comment), I came across a thoughtful blog post by a scientist using about covering scientific studies. This should be a must read for every journalist, science writer or not. The author notes that any scientific study sits on a set of assumptions, and that it's common for someone to eventually show some of them are wrong, making the conclusions wrong. Journalists, who probably don't have an extensive background in the subject, now have a problem:

How, then, do you effectively cover a story laden with valid assumptions, some likely to be correct, many likely to be incorrect? Let us use climate models as an example. In order to avoid long computing times, the use of super computers, or simply (and usually) because the information does not exist, modelers are forced to typically make 100’s of assumptions when devising their code. Now, I’m not saying these models are not at all useful. Smart modelers have determined ways of lining up their assumptions with observations of the real world (often, modelers must predict what we already know to verify their assumptions - i.e. does it work?).

Here, the same problem exists - how do you, the science journalist, determine which of these assumptions could bring the entire model crashing down? Furthermore, if such an linchpin exists, is it an important one? How important? Is it likely to be incorrect? How likely? Unfortunately, these questions have no definitive answers, except with respect to each other, and with respect to the particular researcher.

His context is science, but it could be sociology, psychology, political science, linguistics. Any time you see a study or hear an assertion by some expert, it may be completely wrong, based solely on assumptions and not even considering self-interest that can drive the person to try spinning reality to his or her own advantage.

The article doesn't even touch on another major area of error: poor statistical and sampling methods. Any time you collect sets of information and attempt to make inferences, you're in dangerous territory. I spoke with the chief marketing officer of a law firm. He had a PhD in market research, actually is one of the people who understands how the math works. As part of our discussion, he pointed out that if you had a study where you approached 5,000 professionals and eventually only got 500 to respond to a survey, the best accuracy you could get in the results would be plus or minus 20 points or so. That's enough variation to toss almost any conclusion out the window - and from my own study of the subject, that doesn't even include one of the biggest causes of error: the way the study phrases and orders questions.

I'm not saying to give up using studies, only to be more judicious and suspicious. To quote any sort of study in your work, you need to ensure an adequate grasp of some fundamentals. No, you don't need to apply to graduate school. But there is a lot you can learn in a short amount of time to help you see at least the obvious red flags. Here's an article from American Demographics that can act as a jumping off point for further learning. And here is a checklist of some aspects to consider.

Blog Links and Responsible Writing

While looking at stats for this blog last night, I had a minor revelation. The article I wrote about SPJ's support for National Geographic in its law suit was fairly popular popular, but with two links in it, not even 10 percent of the readers went beyond what I wrote. That got me thinking about statistics for all my blogs, and I realized that many people never click on links that lead off the blog page.

It was a depressing thought, in a way. It could be a result of a skewing of my audiences, and this is a small sample, but I'm now wondering to what degree people actually use links. In other words, if you provide links for additional information and to back up what you claim, very few people have a practical care. They just read what you wrote and go on to something else.

That puts a great burden on the writer. You can't reliably use links as a way to help explain a story. You can't use statements that are cryptic unless understood in the context of a reference you provided. In short, we may all need to assume that for many people, what we write could be it.

Let that sink in. Posts really need to be thorough, recap all the necessary information, and be able to stand on their own if necessary. Most need to have the discipline of miniature reported articles. That's just on the craft and writing side. How about marketing? Getting a link to your piece in someone else's story is probably going to draw a lot less traffic than you might otherwise want.

We all have a lot of learning facging us when it comes to these new media. No one can give you certain answers because they don't know them. The experience does suggest that paying scrupulous attention to the usage numbers of your blog are important for writing quality and responsibility in addition to better controlling your marketing.

Here's to finding out that this "easy" form of writing is a lot more difficult than one might think.