«« Overview: a tool for exploring large document sets | Does journalism work? »»

Dec 10 2010

A full-text visualization of the Iraq War Logs

Update (Apr 2012): the exploratory work described in this post has since blossomed into the Overview Project, an open-source large document set visualization tool for investigative journalists and other curious people, and we’ve now completed several stories with this technique. If you’d like to apply this type of visualization to your own documents, give Overview a try!

Last month, my colleague Julian Burgess and I took a shot a peering into the Iraq War Logs by visualizing them in bulk, as opposed to using keyword searches in an attempt to figure out which of the 391,832 SIGACT reports we should be reading. Other people have created visualizations of this unique document set, such as plots of the incident locations on a map of Iraq, and graphs of monthly casualties. We wanted to go a step further, by designing a visualization based on the the richest part of each report: the free text summary, where a real human describes what happened, in jargon-inflected English.

Also, we wanted to investigate more general visualization techniques. At the Associated Press we get huge document dumps on a weekly or sometimes daily basis. It’s not unusual to get 10,000 pages from a FOIA request — emails, court records, meeting minutes, and many other types of documents, most of which don’t have latitude and longitude that can be plotted on a map. And all of us are increasingly flooded by large document sets released under government transparency initiatives. Such huge files are far too large to read, so they’re only as useful as our tools to access them. But how do you visualize a random bunch of documents?

We’ve found at least one technique that yields interesting results, a graph visualization where each document is node, and edges between them are weighted using cosine-similarity on TF-IDF vectors. I’ll explain exactly what that is and how to interpret it in a moment. But first, the journalism. We learned some things about the Iraq war. That’s one sense in which our experiment was a success; the other valuable lesson is that there are a boatload of research-grade visual analytics techniques just waiting to be applied to journalism.

click for super hi-res version

Interpreting the Iraq War, December 2006
This is a picture of the 11,616 SIGACT (“significant action”) reports from December 2006, the bloodiest month of the war. Each report is a dot. Each dot is labelled by the three most “characteristic” words in that report. Documents that are “similar” have edges drawn between them. The location of the dot is abstract, and has nothing to do with geography. Instead, dots with edges between them are pulled closer together. This produces a series of clusters, which are labelled by the words that are most “characteristic” of the reports in that cluster. I’ll explain precisely what “similar” and “characteristic” mean later, but that’s the intuition.

We colored each report/dot by the “incident type”, which is an existing field in the SIGACT, entered by military personnel. It’s important to note that the incident type field was not used to place the reports in the diagram — the placement depends only on the text of the document. This plots one one variable (color, which is incident type) against another (position, which depends on the summary text).

And it works. The central cluster is blue, the color for the “criminal event” type, and the documents within it all include the word “corpse.” There are a heartbreaking number of them, because this was the height of the Iraqi civil war. Sub-clusters include various modifiers such as “shot.” (Click any image for hi-res version.)

Above this, the blue murders merge into the green “enemy action” reports. At the interface we have “civ, killed, shot,” which are apparently reports of civilians wounded in battle. Enemy actions also have their own clusters  labelled with “mortar,” “female,” “officer,” and “injured.” We haven’t looked into the “female”/”enemy action” cluster yet, and I wonder if there’s a story there.

There is a red cluster off to the side. Red signifies that the military coded these reports as “explosive hazard,” and the documents here all include the words “tanker truck.” Sure enough, there are contemporaneous press reports of tankers being used as explosive weapons, and this cluster shows that there were at least several dozen such incidents throughout Iraq in Dec 2006 — though it doesn’t immediately distinguish between explosions and attempted or threatened explostions.

There’s another cluster of blue criminal action reports, labelled “blindfolded, feet, hands.” Bound feet and hands were common in sectarian violence at the time, and some reports include the word “torture.” There’s a nearby cluster of abductions.

It goes on. December 2006 was a vicious and disturbing and complicated time in Iraq, and the visualization has patterns at all scales, especially if you look at the hi-res image and read the tiny single-report labels. There are some dark green “friendly action” reports labelled “convoy,” and other “friendly actions” which mention the troublesome town of Hadithah (near bottom left). And there is the oil connection, a group of reports which include the word “pipeline.”

How we did it, and what we can and can’t learn from this picture
Visualization is metaphor. Certain details are thrown away, other are emphasized. The algorithms used to produce the visualization have their own sensitivities and blind spots. Without understanding these, a viewer will make false inferences. I’m going to explain in some detail about how this picture was produced, both so that others can replicate this research, and so that those looking at such visualizations can interpret them honestly.

We used standard text-analytics techniques, borrowed from information retrieval: the bag-of-words model, TF-IDF term weighting, and cosine similarity to compare documents. This is the stuff from which search engines are built, among other things. The geeky among us can learn as much as they could ever want to know from this wonderful free information retrieval textbook.

We start by turning each document into a fixed-length vector of numbers. There are as many numbers in this vector as their are words in the vocabulary of all the documents, over 17,000 distinct terms in the case of the Iraq War Logs. If “pipeline” appears three times in a report, we put a three in the count for “pipeline.” Of course the reports are much shorter than 17,000 words, usually just a couple hundred words, so most of the numbers in each document vector are zero.

We also don’t quite store the count of each word. Instead we store the frequency, that is, we divide the counts by the number of words in the document. If the document is 100 words long then “‘pipeline’ appeared three times” becomes  “3% of the words in this document are ‘pipeline.’” This is “term frequency,” the TF part of TF-IDF.

Then we normalize again by how commonly the word appears across documents. It’s not enough to know that “pipeline” is common in a document.” We need to know that “pipeline” is unusually common in this document. So we count the fraction of documents where “pipeline” appears, and divide the term frequency by this document frequency. (Technically, by the logarithm). This has the effect of de-emphasizing terms which appear in almost every document, and it’s the “inverse document frequency” or IDF part of TF-IDF.

This is the sense in which that the labels on the documents and the clusters are “characteristic” words: they are words that occur frequently in those specific documents, but don’t appear at all in most other documents.

But by turning each document into a list of numbers, the order of the words is lost. Once we crunch the text in this way, “the insurgents fired on the civilians” and “the civilians fired on the insurgents” are indistinguishable. Both will appear in the same cluster. This is why a vector of TF-IDF numbers is called a “bag of words” model; it’s as if we cut out all the individual words and put them in a bag, losing their relationships before further processing. And so we get to:

  • Important caveat #1: any visualization based on a bag-of-words model cannot show distinctions that depend on word order.

Once we have all the documents encoded as TF-IDF vectors, we compare every pair of documents to determine how similar they are. We call two documents similar if their characteristic words overlap, and we determine this by taking the dot product of the two document vectors. Why? The dot product multiplies the corresponding numbers at each position in the two vectors. If two documents both have a big number for “pipeline”, the dot product will be large. If one document has a big number for “pipeline” but zero for “abducted”, while the other has a large number for “abducted” but zero for “pipeline”, then the dot product will be zero. This is called the cosine similarity method of comparing documents, because of geometrical relationships between the cosine function and the dot product. Cosine similarity assigns a number to every pair of documents, from zero for “they are completely different” to one for “they are the same.” (At least, the same as far as the bag of words model is concerned.)

Each document is a dot in the visualization. To this we add edges, and the “weight” or strength of the edge — which shows up as line width in this visualization — is the cosine similarity. But we don’t put edges between every pair of documents, only those that are above some threshold of similarity. For this visualization, that threshold was 0.6.

And then we lay out the graph. We used Gephi, a free graph visualization tool. Generally, graph layout algorithms try to bring nodes with strong edges closer together. We found the Fruchterman-Reingold algorithm gave the clearest layout in this case, but the general idea is that points with strong ties gradually move closer as the algorithm runs. But there are conflicting demands; a node marked “corpse” and “abducted” may be pulled towards both clusters. Where a node ends up also depends a lot on where it started, and the nodes start in essentially random positions.

Cosine similarity-weighted graph layout is not the only way to view the relationships between thousands of documents in a 17,000-dimensional space. There are other techniques such as multi-dimensional scaling. But however the documents are visualized, we are trying to understand the structure of a something very complicated in only two dimensions, like trying to guess an object from its shadow. Depending on which angle you take, the shadow is going to be more or less revealing, and perhaps more or less misleading. This is:

  • Important caveat #2: the positions of the dots are sort of arbitrary, though we hope that nearby dots actually represent similar documents.

In other words, quantitative measurements of distances on this visualization won’t mean much. Arguing that “these events are unrelated because they are on opposite sides of the image” is similarly fallacious.

What can we learn from this visualization technique? Clusters are fairly reliable structures. Using color to plot one type of information against another can reveal patterns. And we believe that this visualization captures some important macro-scale aspects of the War Logs. This picture isn’t a story in the usual sense, but we find it insightful nonetheless, and maybe it tells us where to look further. A search tool only can only answer the questions we ask, but a visualization tool lets us make maps.

Much more is possible
To begin with, we’d like to try coloring each dot according to the number of casualties, another field already available in the SIGACTs. We know that over 4000 U.S. forces and 100,000 civilians died in Iraq, but what were the circumstances of their deaths? Perhaps we can start to answer that question. We also want to find a way to animate this diagram through time, so we can see how the war changed as it progressed.

But there are plenty of other visualization techniques waiting to be applied to journalism, and plenty of other document sets to apply them to. It seems likely that TF-IDF and cosine similarity will be generally useful for full-text visualizations of a variety of document types, but it won’t always work. Threaded displays might be much more revealing for things like emails, where it’s important to identify and isolate conversations. In other contexts, entity-relationship diagrams can be insightful; theyrule.net is the granddaddy of this type of analysis, today being seriously pursued by Muckety.

Visualization is also only one part of the problem. This is a static image, but what we really need is an interactive system where a computer draws the pictures and a human directs the exploration. Visualization has to be combined with filtering and selection tools to allow an investigator to “zoom in” on only those documents of interest. Such complete systems exist in other fields, such as the Jigsaw visual analytics software, but there’s currently nothing that really works well for journalism. Performance is a huge issue when dealing with very large document sets, and data import and clean-up are often the real-world bottlenecks. Clean-up is often the most time consuming part of document set analysis, and new tools such as Google Refine give us hope that it can be streamlined.

The potential applications of an industrial-strength journalistic visual analytics system are far broader than document dumps. We got interested in visual analytics because we faced document sets that were so large that they were completely opaque without special tools. But a newsroom also has its archives, and the data and stories it generates every day. We’ve heard interest from historians, and at the other end of the immediacy scale are potential real-time monitoring applications, technologies that are being seriously pursued by organizations such as UN Global Pulse.

We see so much potential that we — the Associated Press in conjunction with several top-notch researchers — are embarking on a serious attempt to build an open-source system for journalistic visualization of very large document sets, be they document dumps, news archives, or the streams of data that now surround civilization. We have preliminary designs for a system called Overview, and we have applied for a Knight News Challenge grant to hire full-time developers to create it. I’ll soon post a more detailed description of the system we’d like to build. We’re going to need help from the journalist-programmer community.

Share This:
  • Twitter
  • Facebook
  • Digg
  • del.icio.us
  • Google Bookmarks
  • Tumblr
  • email
  • StumbleUpon
  • Yahoo! Bookmarks
  • Ping.fm

65 responses so far

65 Responses to “A full-text visualization of the Iraq War Logs”

  1. Jeremy Antleyon 10 Dec 2010 at 5:31 pm

    Very nice breakdown. Despite the limitations, I think this project has serious merit in terms of overall data comprehension. Just as doctors use multiple tests and historians multiple sources, journalists, too, need multiple tools in order to acquire an appreciable grasp of what the data means. The animation feature, for me, is one of the best ideas for further development, as it would be too easy otherwise to mistake a moment for its significance without the proper understanding of the events before and after.

    I hope the project is funded, but if it is not are there plans for development sans grant?

  2. Dain Binderon 12 Dec 2010 at 1:10 am

    This is extremely impressive; amazing work guys!

  3. [...] How to make sense of Wikileaks data? One way is visual analysis, as we see here, via Jonathan Stray of Associated Press: [...]

  4. [...] Jonathan Stray » A full-text visualization of the Iraq War Logs. [...]

  5. xincon 14 Dec 2010 at 12:21 am

    Excellent work, and similarly excellent writeup. This post sent me off on a three-hour Wikipedia and related reading bender.

    Did you end up implementing your own TF-IDF and similarity calculations, or were there tools available to assist with that portion of the gruntwork?

  6. adminon 14 Dec 2010 at 7:42 am

    Julian Burgess wrote our TF-IDF and cosine similarity code in Ruby. They’re pretty straightforward algorithms, though you have to be careful in certain ways if you want good performance on big data sets (e.g. document vectors must be stored in sparse representation.) Ruby is also a terrible language for high-performance software. We’re investigating our options for the production system.

  7. Chris Bainon 14 Dec 2010 at 8:04 am

    Good work! I look forward to reading more. If your interested in hearing about my stories as an Iraq Veteran my website is http://www.warriorbain.com.

  8. new world orderon 16 Dec 2010 at 4:05 am

    wow. thanks for this

  9. [...] The author of the Guardian article Jonathan Stray, explains more about visualisation in his blog: A full-text visualization of the Iraq War Logs, in which he links to a page in Columbia Journalism review, which surveys visualisation projects: [...]

  10. Reg Chuaon 27 Dec 2010 at 10:00 pm

    Jonathan, nicely done! And a very clear explanation as well, thanks.

    As Jeremy notes in the comment above, this can be a very useful tool in a big toolkit of tools that newsrooms can use. A couple of quick questions: 1. How long did it take/does it take to prep the data and send it through the algorithm? 2. How much training will it take for your average but data-savvy journalist to understand how to use this well? 3. Is the visualization interactive? Can I dive into a cluster and look at individual reports?

    Really nice work.

    Reg

  11. adminon 28 Dec 2010 at 10:03 am

    This image took about two weeks to create, but most of that was working out the technique. We could do another one — another month in the war, say — in a day or two. It’s a bit awkward because we’re working with prototype tools and code. The actual processing time is minimal, an hour at most. As you suggest, eventually we hope to have an interactive system which will allow the production of this type of visualization, and others, on deadline. Zooming in, clicking on individual reports, linked selection between different types of displays would all be useful tools.

    As far as training, I hope I’ve been able to get across the key points of how to interpret this picture in the post above. Using this type of system will be a little different than what CAR reporters traditionally do, but I’d imagine that it would be possible to get to a basic fluency in a day of training. How long it would take to become expert, I can’t say — we’ll find out when these tools are in the hands of many more people.

    – Jonathan

  12. [...] Overflowing Toolkit Jonathan Stray of the AP has a fascinating post on how it visualized a massive document dump of the Iraq warlogs.  It looks like [...]

  13. [...] metodologia e gli strumenti della ricerca sono spiegati nel dettaglio in questo post, mentre a questo indirizzo si può scaricare un versione in alta risoluzione [...]

  14. [...] make sense of it all.  For example, Jonathan Stray, at the AP, has written about their efforts to visualize 390,000 Iraq war reports – it’s a fascinating project that goes beyond simply mapping [...]

  15. Network Visualizationon 26 Jan 2011 at 11:30 am

    [...] thing that happened in network visualization land is this full-text visualization of the Wikileaks Iraq War Logs by Jonathan Stray and Julian Burgess. Each document is a node, and edges between them are weighted [...]

  16. [...] JONATHAN STRAY: A full-text visualization of the Iraq War Logs [...]

  17. Jim Cumminson 13 Jun 2011 at 2:43 am

    Jonathan,

    I just watched your talk on this and it was excellent. Thanks for all the hard work and for making this available to the rest of us!

    Jim

  18. [...] Stray » A full-text visualization of the Iraq War Logs http://jonathanstray.com/a-full-text-visualization-of-the-iraq-war-logs Also, we wanted to investigate more general visualization techniques. At the Associated Press we [...]

  19. [...] « A full-text visualization of the Iraq War Logs » (Jonathan Stray est journaliste technologique) [...]

  20. [...] Overview. Developed by a team of journalists at The Associated Press including Jonathan Stray, this project got $475,000 to develop visualization tools that will help journalists explore large data sets. In one early prototype of what the project hopes to do, Stray created a visualization of all the text in the Iraqi war logs. [...]

  21. [...] may know Jonathan as a Nieman Lab writer. If you've been following his blog, you've already seen an early sketch of what Overview will try to [...]

  22. [...] Overview. Developed by a team of journalists at The Associated Press including Jonathan Stray, this project got $475,000 to develop visualization tools that will help journalists explore large data sets. In one early prototype of what the project hopes to do, Stray created a visualization of all the text in the Iraqi war logs. [...]

  23. [...] capacidad de los periodistas en filtrar grandes cantidades de datos y visualizarlos correctamente. El prototipo se usó para interpretar 11.616 actos de violencia en Irak en diciembre de 2006, el mes más sangriento de la invasión estadounidense a ese [...]

  24. [...] gerado na Comunicação para aplicações mercadológicas (conheça três deles aqui, aqui e aqui). Falo especificamente da minha área, da análise de enquadramentos. Não estou dizendo que não [...]

  25. [...] Data journalism is not graphics and visualisations. It’s about telling the story in the best way possible. Sometimes that will be a visualisation or a map (see the work of David McCandless or Jonathan Stray). [...]

  26. [...] la soluzione migliore è una visualizzazione o una mappa (vedi il lavoro di David McCandless o di Jonathan Stray), ma a volte è semplicemente un nuovo articolo. Altre volte, poi, è sufficiente finanche [...]

  27. [...] Le data journalisme ne se résume pas à des graphiques et à des visualisations. Le but est de raconter des histoires, de la meilleure façon possible. Parfois ce sera une visualisation ou une carte (voyez le travail de David McCandless ou Jonathan Stray). [...]

  28. [...] mais detidamente pelos jornalistas. A iniciativa é explicada abaixo no vídeo e também no blog pessoal de um dos integrantes do [...]

  29. Quoraon 20 Jan 2012 at 7:13 pm

    What are some visual representations that would improve your experience of Quora?…

    There are many beautiful visual representations of text out there. However to answer this question we need to ask what do we need to represent that would allow users to get more out of quora.  Good questions to represent might be: * What is trending no…

  30. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  31. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  32. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  33. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  34. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  35. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  36. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  37. [...] journalist Jonathan Stray from The Associated Press produced another of the highlighted examples: a visualization of the keywords used in the more than 390,000 Iraqi war logs and diplomatic cables that were leaked by [...]

  38. [...] possible. Sometimes that will be a visualisation or a map (see the work of David McCandless or Jonathan Stray). But sometimes it’s a news story. Sometimes, just publishing the number is [...]

  39. [...] http://jonathanstray.com/a-full-text-visualization-of-the-iraq-war-logs [...]

  40. [...] http://jonathanstray.com/a-full-text-visualization-of-the-iraq-war-logs [...]

  41. [...] Jonathan. ‘A full-text visualization of the Iraq War Logs.’ Web. 22 Sept. [...]

  42. What is data journalim? | julianne0811on 04 Mar 2013 at 6:01 pm

    [...] Data journalism is not graphics and visualisations. It’s about telling the story in the best way possible. Sometimes that will be a visualisation or a map (see the work of David McCandless or Jonathan Stray). [...]

  43. [...] examples:http://www.guardian.co.uk/profile/davidmccandlesshttp://jonathanstray.com/a-full-text-visualization-of-the-iraq-war-logs Share this:TwitterFacebookLike this:Like Loading… This entry was posted in Uncategorized. Bookmark the permalink. ← Previous Post [...]

  44. [...] Los periodistas Jonathan Stray y Julian Burgess realizaron un trabajo de investigación sobre los registros (logs) de la Guerra de Irak. Se trató de una llamativa incursión en el análisis de texto y la visualización, utilizando [...]

  45. top 6 essay writing tipson 05 Oct 2013 at 4:45 am

    You are so interesting! I do not believe I’ve read through a single thing like this before.
    So nice to discover somebody with original thoughts on this subject.

    Seriously.. thanks for starting this up. This web site is one thing that’s
    needed on the web, someone with a bit of originality!

    My web-site; top 6 essay writing tips

  46. [...] shedding new light on data such as patterns, links and structure in a text. However According to Jonathan Stray ‘Visualisation is a metaphor’ all visualisations have their own sensitivities and blind spots. [...]

  47. Carolon 24 May 2014 at 5:21 am

    Reading this article, you can just see the potential for very useful tools in the future. Maybe I missed it, but I’m wondering how the visual was presented to readers/subscribers when it was first developed. Was there a story with it? Or the map with info on how to read it?

  48. Janice Archeron 25 May 2014 at 7:25 am

    That was an incredible job Jonathan. It gives a much clearer insight to the plights of the Iraqi war. Data journalism definitely shows a much broader picture than just words. Thank you.

  49. […] A full text visualization of the Iraqi War Logs […]

  50. benefits of Magnetic Reading Glasseson 05 Jul 2014 at 9:51 pm

    Undeniably believe that which you stated. Your favorite reason seemed to be
    on the net the easiest thing to be aware of. I say to you, I
    certainly get irked while people consider worries that they plainly do not know about.
    You managed to hit the nail upon the top as well as defined out the
    whole thing without having side effect , people can take a
    signal. Will likely be back to get more. Thanks

  51. Changon 19 Jul 2014 at 4:12 am

    Thanks a lot for sharing this with all folks
    you actually know what you are talkig approximately!
    Bookmarked. Kindly additionally discuss with my
    web site =). We can have a hyperlink alternate agreement among us

    My page – buying a house (Chang)

  52. fingerprints on stainless applianceson 25 Jul 2014 at 10:30 pm

    This blog was… how do you say it? Relevant!!
    Finally I have found something that helped me. Thanks a lot!

    Here is my blog – fingerprints on stainless appliances

  53. I was recommended this website by my cousin.
    I am not sure whether this poost is writtten by him as nobody else know such detailed about my difficulty.
    You are incredible! Thanks!

    Here iis my website … http://claimyourexcellence.info/conveyancingquotations784904

  54. Isabelleon 06 Aug 2014 at 11:34 am

    Usually,this type oof bellows has tiny size and high precision.
    Maxillary occlusal cant- TADs can fully intrude the
    cant without the typical extrusive side effects
    in the non-affected side. The drawing toolbar is always
    visible to the user in the top-right toolbar.

    My page … silver extrusion press; Isabelle,

  55. Emilieon 06 Aug 2014 at 7:09 pm

    Start and Stopp metho iss a very powerful method to prolong yolur ejaculation. In fact,
    the best male enhancement treatments ccan increase penis size, ramp up your sexx
    drive, and boost your stamina. Some herbs offer the best treatment
    for sexual disorders like erectile dysfunction, premature ejaculation annd impotence.

    Look at my web page – increase stamkina in bed, Emilie,

  56. Karlaon 12 Aug 2014 at 6:19 pm

    I’d like to thank you for the efforts you’ve put in writing this site.
    I am hoping to view the same high-grade blog posts from you in the future as well.
    In fact, your creative writing abilities has encouraged me to get my owwn website now ;)

    Feel free to visit my website :: quote (Karla)

  57. ilikeit.comon 16 Aug 2014 at 11:54 pm

    Hey! Someone in my Myspace group shared this sie wityh us so I came to give
    it a look. I’m definitely loving the information. I’m book-marking and wiill be tweeting this to my followers!

    Great blpog and wonderful style and design.

    Here is my web page ilikeit.com

  58. Alyciaon 18 Aug 2014 at 9:19 am

    Hey there! I know this is kind of off topic but I wass wondering if you knew where I could locate a captcha plugin for mmy comment form?
    I’m using the same blog platform as yours and I’m having difficulty
    finding one? Thanks a lot!

    My blog: conveyancing; Alycia,

  59. condoon 20 Aug 2014 at 10:45 am

    Hello, after reading this awesome piecce of writing i am too delighted tto share my knowledge here with friends.

    Feel frere to surf to my blog post: condo

  60. Monstercoffeedrinker.wordpress.comon 28 Aug 2014 at 6:37 pm

    Coffee makers are mainly distinguished into two popular types i.

    Another unique characteristic when it comes to thhe design of
    Bunn airpot coffee brewers is that there iss a spray
    head which saturates the coffee to create an even-tasting brew.
    Althouugh each type features a different burr design, both are
    capable of producing a great espresso grind.

    Here is my web site … drip coffee maker – Monstercoffeedrinker.wordpress.com -

  61. http://coffeemakerguru.blog.comon 30 Aug 2014 at 7:30 pm

    We are a group of volunteers and starting a new scheme inn our community.
    Your website provided us ith valuable information to work
    on. You have done a formidable job annd our whole community will be grateful
    to you.

    my weblog best coffee maker consumer review (http://coffeemakerguru.blog.com)

  62. Hack For Sims Freeplayon 23 Sep 2014 at 10:28 am

    What i do not realoze is in reality hhow you’re no longer really muuch more well-liked thwn you might be now.
    You’re soo intelligent. You recognize therefore significantly in the case of this subject,
    produced me in my view believe it from numerous numerous angles.
    Its like men and women are not involved unless it is something to doo with Lady gaga!
    Your personql stuffss outstanding. All the time deal with it up!

  63. envoy financialon 25 Sep 2014 at 10:37 pm

    Today, I went to the beach with my kids. I found a sea shell and gave
    it to my 4 year old daughter and said “You can hear the ocean if you put this to your ear.”
    She put the shell to her ear and screamed. There was
    a hermit crab inside and it pinched her ear. She never wants to go back!
    LoL I know this is completely off topic but I had to tell someone!

  64. likeon 30 Sep 2014 at 6:50 am

    Just want to say your article is as surprising. The clearness in your post is simply excellent and i could assume you are an expert on this subject.
    Well with your permission let me to grab your feed to keep
    up to date with forthcoming post. Thanks a million and please
    carry on the gratifying work.

  65. Magnificent beat ! I would like to apprentice while you amend your
    site, how could i subscribe for a blog web site?
    The account helped me a acceptable deal. I had been tiny bit acquainted of
    this your broadcast offered bright clear idea

Trackback URI | Comments RSS

Leave a Reply

«« Overview: a tool for exploring large document sets | Does journalism work? »»